d77aaf4858b245f6f2c1b4e754f977f50d9d95a3:2025-11-22:42439
=== RUN TestAddons/serial/Volcano
addons_test.go:850: skipping: crio not supported
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable volcano --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable volcano --alsologtostderr -v=1: exit status 11 (237.750194ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:05.763601 24338 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:05.763750 24338 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:05.763759 24338 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:05.763763 24338 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:05.763971 24338 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:05.764204 24338 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:05.764527 24338 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:05.764542 24338 addons.go:622] checking whether the cluster is paused
I1122 01:58:05.764621 24338 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:05.764636 24338 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:05.765017 24338 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:05.783391 24338 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:05.783432 24338 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:05.799218 24338 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:05.890938 24338 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:05.891010 24338 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:05.917874 24338 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:05.917916 24338 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:05.917922 24338 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:05.917927 24338 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:05.917937 24338 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:05.917947 24338 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:05.917955 24338 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:05.917959 24338 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:05.917964 24338 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:05.917973 24338 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:05.917979 24338 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:05.917981 24338 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:05.917984 24338 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:05.917987 24338 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:05.917989 24338 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:05.918000 24338 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:05.918007 24338 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:05.918012 24338 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:05.918014 24338 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:05.918018 24338 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:05.918025 24338 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:05.918029 24338 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:05.918037 24338 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:05.918041 24338 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:05.918048 24338 cri.go:89] found id: ""
I1122 01:58:05.918093 24338 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:05.931042 24338 out.go:203]
W1122 01:58:05.931996 24338 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:05Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:05Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:05.932016 24338 out.go:285] *
*
W1122 01:58:05.935379 24338 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_9bd16c244da2144137a37071fb77e06a574610a0_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_9bd16c244da2144137a37071fb77e06a574610a0_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:05.936805 24338 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable volcano addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable volcano --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/serial/Volcano (0.24s)
=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:382: registry stabilized in 3.244003ms
addons_test.go:384: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Running
addons_test.go:384: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.002732931s
addons_test.go:387: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Running
addons_test.go:387: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.002348268s
addons_test.go:392: (dbg) Run: kubectl --context addons-416530 delete po -l run=registry-test --now
addons_test.go:397: (dbg) Run: kubectl --context addons-416530 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:397: (dbg) Done: kubectl --context addons-416530 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.249415186s)
addons_test.go:411: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 ip
2025/11/22 01:58:28 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable registry --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable registry --alsologtostderr -v=1: exit status 11 (239.019442ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:28.206267 26995 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:28.206536 26995 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:28.206546 26995 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:28.206550 26995 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:28.206735 26995 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:28.206972 26995 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:28.207280 26995 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:28.207294 26995 addons.go:622] checking whether the cluster is paused
I1122 01:58:28.207394 26995 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:28.207414 26995 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:28.207795 26995 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:28.225607 26995 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:28.225655 26995 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:28.242649 26995 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:28.335233 26995 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:28.335306 26995 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:28.363519 26995 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:28.363543 26995 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:28.363549 26995 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:28.363554 26995 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:28.363557 26995 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:28.363562 26995 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:28.363566 26995 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:28.363570 26995 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:28.363574 26995 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:28.363582 26995 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:28.363589 26995 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:28.363593 26995 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:28.363600 26995 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:28.363604 26995 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:28.363609 26995 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:28.363614 26995 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:28.363616 26995 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:28.363619 26995 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:28.363622 26995 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:28.363624 26995 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:28.363626 26995 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:28.363629 26995 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:28.363631 26995 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:28.363633 26995 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:28.363636 26995 cri.go:89] found id: ""
I1122 01:58:28.363669 26995 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:28.381974 26995 out.go:203]
W1122 01:58:28.382990 26995 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:28Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:28Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:28.383008 26995 out.go:285] *
*
W1122 01:58:28.386073 26995 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_94fa7435cdb0fda2540861b9b71556c8cae5c5f1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_94fa7435cdb0fda2540861b9b71556c8cae5c5f1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:28.387939 26995 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable registry addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable registry --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/Registry (13.69s)
=== RUN TestAddons/parallel/RegistryCreds
=== PAUSE TestAddons/parallel/RegistryCreds
=== CONT TestAddons/parallel/RegistryCreds
addons_test.go:323: registry-creds stabilized in 2.683301ms
addons_test.go:325: (dbg) Run: out/minikube-linux-amd64 addons configure registry-creds -f ./testdata/addons_testconfig.json -p addons-416530
addons_test.go:332: (dbg) Run: kubectl --context addons-416530 -n kube-system get secret -o yaml
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable registry-creds --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable registry-creds --alsologtostderr -v=1: exit status 11 (243.459539ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:31.686957 27436 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:31.687137 27436 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:31.687149 27436 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:31.687155 27436 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:31.687614 27436 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:31.687877 27436 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:31.688199 27436 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:31.688216 27436 addons.go:622] checking whether the cluster is paused
I1122 01:58:31.688311 27436 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:31.688332 27436 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:31.688721 27436 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:31.708898 27436 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:31.708961 27436 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:31.730094 27436 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:31.825734 27436 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:31.825828 27436 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:31.854528 27436 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:31.854550 27436 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:31.854556 27436 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:31.854560 27436 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:31.854563 27436 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:31.854571 27436 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:31.854574 27436 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:31.854576 27436 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:31.854579 27436 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:31.854588 27436 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:31.854591 27436 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:31.854593 27436 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:31.854596 27436 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:31.854599 27436 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:31.854601 27436 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:31.854614 27436 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:31.854623 27436 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:31.854627 27436 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:31.854629 27436 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:31.854631 27436 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:31.854637 27436 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:31.854641 27436 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:31.854645 27436 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:31.854648 27436 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:31.854652 27436 cri.go:89] found id: ""
I1122 01:58:31.854716 27436 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:31.868874 27436 out.go:203]
W1122 01:58:31.869982 27436 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:31Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:31Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:31.869999 27436 out.go:285] *
*
W1122 01:58:31.873054 27436 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_ac42ae7bb4bac5cd909a08f6506d602b3d2ccf6c_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_ac42ae7bb4bac5cd909a08f6506d602b3d2ccf6c_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:31.874085 27436 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable registry-creds addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable registry-creds --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/RegistryCreds (0.40s)
=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run: kubectl --context addons-416530 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run: kubectl --context addons-416530 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run: kubectl --context addons-416530 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:352: "nginx" [a983cfb9-a1e1-44de-ab4b-866d3756cfab] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx" [a983cfb9-a1e1-44de-ab4b-866d3756cfab] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.003987864s
I1122 01:58:31.698800 15072 kapi.go:150] Service nginx in namespace default found.
addons_test.go:264: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:264: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m15.818308842s)
** stderr **
ssh: Process exited with status 28
** /stderr **
addons_test.go:280: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:288: (dbg) Run: kubectl --context addons-416530 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 ip
addons_test.go:299: (dbg) Run: nslookup hello-john.test 192.168.49.2
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestAddons/parallel/Ingress]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect addons-416530
helpers_test.go:243: (dbg) docker inspect addons-416530:
-- stdout --
[
{
"Id": "e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f",
"Created": "2025-11-22T01:56:27.584287741Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 17077,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T01:56:27.613817941Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/hostname",
"HostsPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/hosts",
"LogPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f-json.log",
"Name": "/addons-416530",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-416530:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-416530",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4294967296,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8589934592,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f",
"LowerDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/merged",
"UpperDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/diff",
"WorkDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-416530",
"Source": "/var/lib/docker/volumes/addons-416530/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-416530",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-416530",
"name.minikube.sigs.k8s.io": "addons-416530",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "a84a1139fdf9f1c5f6614dff8a5730de3be10ff02ab6e2ce0893ba9deff6ec84",
"SandboxKey": "/var/run/docker/netns/a84a1139fdf9",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"Networks": {
"addons-416530": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "0f97d816d659b52225bff66dff129151eee14e3e59b4f6fb58d41ac4cda7d6d1",
"EndpointID": "81a28cd7edbe706c48d0a8829ad258e82d8a87068e6625b300c933d704f9847e",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"MacAddress": "4e:f4:79:70:fd:ed",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-416530",
"e7bf60a2902b"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-416530 -n addons-416530
helpers_test.go:252: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p addons-416530 logs -n 25: (1.061292547s)
helpers_test.go:260: TestAddons/parallel/Ingress logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ --download-only -p binary-mirror-401760 --alsologtostderr --binary-mirror http://127.0.0.1:33657 --driver=docker --container-runtime=crio │ binary-mirror-401760 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ delete │ -p binary-mirror-401760 │ binary-mirror-401760 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ addons │ disable dashboard -p addons-416530 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ addons │ enable dashboard -p addons-416530 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ start │ -p addons-416530 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:58 UTC │
│ addons │ addons-416530 addons disable volcano --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable gcp-auth --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ enable headlamp -p addons-416530 --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable headlamp --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable metrics-server --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable nvidia-device-plugin --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable amd-gpu-device-plugin --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable yakd --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ ip │ addons-416530 ip │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ 22 Nov 25 01:58 UTC │
│ addons │ addons-416530 addons disable registry --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ ssh │ addons-416530 ssh cat /opt/local-path-provisioner/pvc-de3d74e0-2542-4162-9a8a-737fae1d53f9_default_test-pvc/file1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ 22 Nov 25 01:58 UTC │
│ addons │ addons-416530 addons disable storage-provisioner-rancher --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable inspektor-gadget --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ configure registry-creds -f ./testdata/addons_testconfig.json -p addons-416530 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ 22 Nov 25 01:58 UTC │
│ addons │ addons-416530 addons disable registry-creds --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ ssh │ addons-416530 ssh curl -s http://127.0.0.1/ -H 'Host: nginx.example.com' │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable cloud-spanner --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable volumesnapshots --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable csi-hostpath-driver --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ ip │ addons-416530 ip │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 02:00 UTC │ 22 Nov 25 02:00 UTC │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 01:56:03
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 01:56:03.882452 16415 out.go:360] Setting OutFile to fd 1 ...
I1122 01:56:03.882683 16415 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:56:03.882692 16415 out.go:374] Setting ErrFile to fd 2...
I1122 01:56:03.882696 16415 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:56:03.882865 16415 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:56:03.883342 16415 out.go:368] Setting JSON to false
I1122 01:56:03.884100 16415 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2307,"bootTime":1763774257,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 01:56:03.884181 16415 start.go:143] virtualization: kvm guest
I1122 01:56:03.885951 16415 out.go:179] * [addons-416530] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 01:56:03.887240 16415 out.go:179] - MINIKUBE_LOCATION=21946
I1122 01:56:03.887236 16415 notify.go:221] Checking for updates...
I1122 01:56:03.889469 16415 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 01:56:03.890862 16415 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:56:03.891868 16415 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 01:56:03.892823 16415 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 01:56:03.893812 16415 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 01:56:03.894949 16415 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 01:56:03.916881 16415 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 01:56:03.916976 16415 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:56:03.972325 16415 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-11-22 01:56:03.96278976 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:56:03.972422 16415 docker.go:319] overlay module found
I1122 01:56:03.973947 16415 out.go:179] * Using the docker driver based on user configuration
I1122 01:56:03.974898 16415 start.go:309] selected driver: docker
I1122 01:56:03.974940 16415 start.go:927] validating driver "docker" against <nil>
I1122 01:56:03.974953 16415 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 01:56:03.975501 16415 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:56:04.032953 16415 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-11-22 01:56:04.024162176 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:56:04.033113 16415 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 01:56:04.033291 16415 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 01:56:04.034781 16415 out.go:179] * Using Docker driver with root privileges
I1122 01:56:04.035827 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:04.035878 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:04.035888 16415 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 01:56:04.035996 16415 start.go:353] cluster config:
{Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:
AutoPauseInterval:1m0s}
I1122 01:56:04.037039 16415 out.go:179] * Starting "addons-416530" primary control-plane node in "addons-416530" cluster
I1122 01:56:04.037933 16415 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 01:56:04.038943 16415 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 01:56:04.039767 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:04.039791 16415 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 01:56:04.039800 16415 cache.go:65] Caching tarball of preloaded images
I1122 01:56:04.039850 16415 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 01:56:04.039915 16415 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 01:56:04.039925 16415 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 01:56:04.040246 16415 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json ...
I1122 01:56:04.040267 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json: {Name:mkfe3435fd16d3af05650c6f93d4e6d9acdbe613 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:04.055074 16415 cache.go:163] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a to local cache
I1122 01:56:04.055185 16415 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local cache directory
I1122 01:56:04.055204 16415 image.go:68] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local cache directory, skipping pull
I1122 01:56:04.055210 16415 image.go:137] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in cache, skipping pull
I1122 01:56:04.055223 16415 cache.go:166] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a as a tarball
I1122 01:56:04.055234 16415 cache.go:176] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a from local cache
I1122 01:56:15.894707 16415 cache.go:178] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a from cached tarball
I1122 01:56:15.894748 16415 cache.go:243] Successfully downloaded all kic artifacts
I1122 01:56:15.894800 16415 start.go:360] acquireMachinesLock for addons-416530: {Name:mk5d8c50816691bb3aeb15cb1d764825c28c289f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 01:56:15.894893 16415 start.go:364] duration metric: took 72.476µs to acquireMachinesLock for "addons-416530"
I1122 01:56:15.894936 16415 start.go:93] Provisioning new machine with config: &{Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath:
SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 01:56:15.895022 16415 start.go:125] createHost starting for "" (driver="docker")
I1122 01:56:15.896595 16415 out.go:252] * Creating docker container (CPUs=2, Memory=4096MB) ...
I1122 01:56:15.896828 16415 start.go:159] libmachine.API.Create for "addons-416530" (driver="docker")
I1122 01:56:15.896859 16415 client.go:173] LocalClient.Create starting
I1122 01:56:15.896994 16415 main.go:143] libmachine: Creating CA: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 01:56:16.482821 16415 main.go:143] libmachine: Creating client certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 01:56:16.761824 16415 cli_runner.go:164] Run: docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 01:56:16.779303 16415 cli_runner.go:211] docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 01:56:16.779370 16415 network_create.go:284] running [docker network inspect addons-416530] to gather additional debugging logs...
I1122 01:56:16.779402 16415 cli_runner.go:164] Run: docker network inspect addons-416530
W1122 01:56:16.794481 16415 cli_runner.go:211] docker network inspect addons-416530 returned with exit code 1
I1122 01:56:16.794505 16415 network_create.go:287] error running [docker network inspect addons-416530]: docker network inspect addons-416530: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-416530 not found
I1122 01:56:16.794515 16415 network_create.go:289] output of [docker network inspect addons-416530]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-416530 not found
** /stderr **
I1122 01:56:16.794617 16415 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 01:56:16.810351 16415 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00166aa70}
I1122 01:56:16.810393 16415 network_create.go:124] attempt to create docker network addons-416530 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1122 01:56:16.810429 16415 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-416530 addons-416530
I1122 01:56:16.853453 16415 network_create.go:108] docker network addons-416530 192.168.49.0/24 created
I1122 01:56:16.853480 16415 kic.go:121] calculated static IP "192.168.49.2" for the "addons-416530" container
I1122 01:56:16.853550 16415 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 01:56:16.868458 16415 cli_runner.go:164] Run: docker volume create addons-416530 --label name.minikube.sigs.k8s.io=addons-416530 --label created_by.minikube.sigs.k8s.io=true
I1122 01:56:16.884901 16415 oci.go:103] Successfully created a docker volume addons-416530
I1122 01:56:16.884987 16415 cli_runner.go:164] Run: docker run --rm --name addons-416530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --entrypoint /usr/bin/test -v addons-416530:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 01:56:23.286663 16415 cli_runner.go:217] Completed: docker run --rm --name addons-416530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --entrypoint /usr/bin/test -v addons-416530:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib: (6.401626965s)
I1122 01:56:23.286694 16415 oci.go:107] Successfully prepared a docker volume addons-416530
I1122 01:56:23.286733 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:23.286766 16415 kic.go:194] Starting extracting preloaded images to volume ...
I1122 01:56:23.286829 16415 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-416530:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 01:56:27.514471 16415 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-416530:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.227602248s)
I1122 01:56:27.514504 16415 kic.go:203] duration metric: took 4.227751662s to extract preloaded images to volume ...
W1122 01:56:27.514602 16415 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 01:56:27.514646 16415 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 01:56:27.514716 16415 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 01:56:27.569852 16415 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-416530 --name addons-416530 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-416530 --network addons-416530 --ip 192.168.49.2 --volume addons-416530:/var --security-opt apparmor=unconfined --memory=4096mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
I1122 01:56:27.862531 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Running}}
I1122 01:56:27.883206 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:27.901597 16415 cli_runner.go:164] Run: docker exec addons-416530 stat /var/lib/dpkg/alternatives/iptables
I1122 01:56:27.948414 16415 oci.go:144] the created container "addons-416530" has a running status.
I1122 01:56:27.948446 16415 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa...
I1122 01:56:28.116402 16415 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 01:56:28.147180 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:28.166602 16415 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 01:56:28.166633 16415 kic_runner.go:114] Args: [docker exec --privileged addons-416530 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 01:56:28.223128 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:28.243182 16415 machine.go:94] provisionDockerMachine start ...
I1122 01:56:28.243318 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.262485 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.262735 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.262751 16415 main.go:143] libmachine: About to run SSH command:
hostname
I1122 01:56:28.389051 16415 main.go:143] libmachine: SSH cmd err, output: <nil>: addons-416530
I1122 01:56:28.389074 16415 ubuntu.go:182] provisioning hostname "addons-416530"
I1122 01:56:28.389131 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.406812 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.407066 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.407084 16415 main.go:143] libmachine: About to run SSH command:
sudo hostname addons-416530 && echo "addons-416530" | sudo tee /etc/hostname
I1122 01:56:28.542547 16415 main.go:143] libmachine: SSH cmd err, output: <nil>: addons-416530
I1122 01:56:28.542620 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.559221 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.559426 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.559443 16415 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-416530' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-416530/g' /etc/hosts;
else
echo '127.0.1.1 addons-416530' | sudo tee -a /etc/hosts;
fi
fi
I1122 01:56:28.684438 16415 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 01:56:28.684461 16415 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 01:56:28.684491 16415 ubuntu.go:190] setting up certificates
I1122 01:56:28.684505 16415 provision.go:84] configureAuth start
I1122 01:56:28.684559 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:28.700631 16415 provision.go:143] copyHostCerts
I1122 01:56:28.700693 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 01:56:28.700797 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 01:56:28.700856 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 01:56:28.700920 16415 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.addons-416530 san=[127.0.0.1 192.168.49.2 addons-416530 localhost minikube]
I1122 01:56:28.849018 16415 provision.go:177] copyRemoteCerts
I1122 01:56:28.849062 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 01:56:28.849091 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.865009 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:28.957612 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1122 01:56:28.974952 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 01:56:28.990566 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 01:56:29.005623 16415 provision.go:87] duration metric: took 321.108461ms to configureAuth
I1122 01:56:29.005642 16415 ubuntu.go:206] setting minikube options for container-runtime
I1122 01:56:29.005780 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:29.005867 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.022319 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:29.022501 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:29.022517 16415 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 01:56:29.274460 16415 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 01:56:29.274487 16415 machine.go:97] duration metric: took 1.031283196s to provisionDockerMachine
I1122 01:56:29.274499 16415 client.go:176] duration metric: took 13.377633461s to LocalClient.Create
I1122 01:56:29.274523 16415 start.go:167] duration metric: took 13.377696309s to libmachine.API.Create "addons-416530"
I1122 01:56:29.274533 16415 start.go:293] postStartSetup for "addons-416530" (driver="docker")
I1122 01:56:29.274547 16415 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 01:56:29.274596 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 01:56:29.274635 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.291192 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.384228 16415 ssh_runner.go:195] Run: cat /etc/os-release
I1122 01:56:29.387289 16415 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 01:56:29.387313 16415 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 01:56:29.387322 16415 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 01:56:29.387377 16415 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 01:56:29.387407 16415 start.go:296] duration metric: took 112.867009ms for postStartSetup
I1122 01:56:29.387747 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:29.403546 16415 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json ...
I1122 01:56:29.403752 16415 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 01:56:29.403786 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.420244 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.509028 16415 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 01:56:29.512916 16415 start.go:128] duration metric: took 13.617868174s to createHost
I1122 01:56:29.512944 16415 start.go:83] releasing machines lock for "addons-416530", held for 13.61803963s
I1122 01:56:29.512994 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:29.529872 16415 ssh_runner.go:195] Run: cat /version.json
I1122 01:56:29.529944 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.529947 16415 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 01:56:29.530001 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.545555 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.547195 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.695628 16415 ssh_runner.go:195] Run: systemctl --version
I1122 01:56:29.701248 16415 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 01:56:29.733319 16415 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 01:56:29.737451 16415 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 01:56:29.737517 16415 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 01:56:29.760489 16415 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 01:56:29.760510 16415 start.go:496] detecting cgroup driver to use...
I1122 01:56:29.760543 16415 detect.go:190] detected "systemd" cgroup driver on host os
I1122 01:56:29.760580 16415 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 01:56:29.774596 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 01:56:29.785310 16415 docker.go:218] disabling cri-docker service (if available) ...
I1122 01:56:29.785359 16415 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 01:56:29.799660 16415 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 01:56:29.814899 16415 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 01:56:29.891742 16415 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 01:56:29.972359 16415 docker.go:234] disabling docker service ...
I1122 01:56:29.972436 16415 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 01:56:29.988755 16415 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 01:56:29.999604 16415 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 01:56:30.081383 16415 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 01:56:30.156244 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 01:56:30.166759 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 01:56:30.179053 16415 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 01:56:30.179096 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.188112 16415 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 01:56:30.188160 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.195836 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.203406 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.210884 16415 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 01:56:30.217843 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.225333 16415 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.237087 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.244558 16415 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 01:56:30.251023 16415 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1122 01:56:30.251067 16415 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1122 01:56:30.261593 16415 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 01:56:30.268527 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:30.343514 16415 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 01:56:30.466814 16415 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 01:56:30.466898 16415 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 01:56:30.470559 16415 start.go:564] Will wait 60s for crictl version
I1122 01:56:30.470602 16415 ssh_runner.go:195] Run: which crictl
I1122 01:56:30.473762 16415 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 01:56:30.495791 16415 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 01:56:30.495887 16415 ssh_runner.go:195] Run: crio --version
I1122 01:56:30.520301 16415 ssh_runner.go:195] Run: crio --version
I1122 01:56:30.546199 16415 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 01:56:30.547288 16415 cli_runner.go:164] Run: docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 01:56:30.563578 16415 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I1122 01:56:30.567110 16415 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 01:56:30.576386 16415 kubeadm.go:884] updating cluster {Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketV
MnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 01:56:30.576504 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:30.576560 16415 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 01:56:30.605157 16415 crio.go:514] all images are preloaded for cri-o runtime.
I1122 01:56:30.605178 16415 crio.go:433] Images already preloaded, skipping extraction
I1122 01:56:30.605220 16415 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 01:56:30.627804 16415 crio.go:514] all images are preloaded for cri-o runtime.
I1122 01:56:30.627823 16415 cache_images.go:86] Images are preloaded, skipping loading
I1122 01:56:30.627830 16415 kubeadm.go:935] updating node { 192.168.49.2 8443 v1.34.1 crio true true} ...
I1122 01:56:30.627935 16415 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-416530 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 01:56:30.627997 16415 ssh_runner.go:195] Run: crio config
I1122 01:56:30.668708 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:30.668735 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:30.668755 16415 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 01:56:30.668791 16415 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-416530 NodeName:addons-416530 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernet
es/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 01:56:30.668977 16415 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-416530"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.49.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 01:56:30.669050 16415 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 01:56:30.676291 16415 binaries.go:51] Found k8s binaries, skipping transfer
I1122 01:56:30.676334 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 01:56:30.683050 16415 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
I1122 01:56:30.693970 16415 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 01:56:30.707129 16415 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2209 bytes)
I1122 01:56:30.717989 16415 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I1122 01:56:30.721059 16415 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 01:56:30.729548 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:30.804178 16415 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 01:56:30.827635 16415 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530 for IP: 192.168.49.2
I1122 01:56:30.827656 16415 certs.go:195] generating shared ca certs ...
I1122 01:56:30.827675 16415 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:30.827808 16415 certs.go:241] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 01:56:31.322089 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt ...
I1122 01:56:31.322116 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt: {Name:mkee2cce2c0bb57574527a8fcce15f8a2721c548 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.322274 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key ...
I1122 01:56:31.322284 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key: {Name:mk4a850944466b014e1287e08b680a4883f1d754 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.322360 16415 certs.go:241] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 01:56:31.607868 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt ...
I1122 01:56:31.607894 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt: {Name:mk03d73d5ae26491d26dddbae2e6a363070d3d00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.608056 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key ...
I1122 01:56:31.608068 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key: {Name:mk84febd4550efaafa59bcfd5eeb57edb2040be3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.608139 16415 certs.go:257] generating profile certs ...
I1122 01:56:31.608192 16415 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key
I1122 01:56:31.608207 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt with IP's: []
I1122 01:56:31.752866 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt ...
I1122 01:56:31.752892 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: {Name:mk3bbd92f837e80949fcde7e67e392df7a74ae7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.753046 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key ...
I1122 01:56:31.753058 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key: {Name:mkc363d12973c9b3dd5e892606e81b0c8d114ba3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.753134 16415 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e
I1122 01:56:31.753152 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I1122 01:56:32.087412 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e ...
I1122 01:56:32.087441 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e: {Name:mkfe41cbb8f30330202e5e9679908e6205369ddc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.087605 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e ...
I1122 01:56:32.087618 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e: {Name:mkb572021a8958432aa9e00f76c8966a9c807df2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.087692 16415 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt
I1122 01:56:32.087784 16415 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key
I1122 01:56:32.087839 16415 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key
I1122 01:56:32.087857 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt with IP's: []
I1122 01:56:32.314580 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt ...
I1122 01:56:32.314609 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt: {Name:mka618c3db053226289e75dc89fd94df0c009519 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.314774 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key ...
I1122 01:56:32.314785 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key: {Name:mk7f088f6437aec0482c9e27f204c313d8855d8b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.314969 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 01:56:32.315002 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 01:56:32.315025 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 01:56:32.315053 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 01:56:32.315660 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 01:56:32.332250 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 01:56:32.347860 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 01:56:32.363273 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 01:56:32.378678 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I1122 01:56:32.393836 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 01:56:32.409272 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 01:56:32.424508 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 01:56:32.440154 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 01:56:32.458227 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 01:56:32.469465 16415 ssh_runner.go:195] Run: openssl version
I1122 01:56:32.475004 16415 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 01:56:32.484765 16415 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.487988 16415 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.488046 16415 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.521476 16415 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 01:56:32.528722 16415 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 01:56:32.531690 16415 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 01:56:32.531745 16415 kubeadm.go:401] StartCluster: {Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 01:56:32.531814 16415 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:56:32.531869 16415 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:56:32.555365 16415 cri.go:89] found id: ""
I1122 01:56:32.555427 16415 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 01:56:32.562283 16415 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 01:56:32.569143 16415 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 01:56:32.569188 16415 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 01:56:32.575991 16415 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 01:56:32.576003 16415 kubeadm.go:158] found existing configuration files:
I1122 01:56:32.576029 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1122 01:56:32.582816 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 01:56:32.582852 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 01:56:32.589127 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1122 01:56:32.595675 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 01:56:32.595745 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 01:56:32.602036 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1122 01:56:32.608473 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 01:56:32.608512 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 01:56:32.614959 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1122 01:56:32.621402 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 01:56:32.621436 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 01:56:32.627677 16415 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 01:56:32.679559 16415 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 01:56:32.730076 16415 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 01:56:41.338720 16415 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 01:56:41.338768 16415 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 01:56:41.338859 16415 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 01:56:41.338960 16415 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 01:56:41.339031 16415 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 01:56:41.339106 16415 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 01:56:41.339191 16415 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 01:56:41.339278 16415 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 01:56:41.339355 16415 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 01:56:41.339428 16415 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 01:56:41.339499 16415 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 01:56:41.339579 16415 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 01:56:41.339659 16415 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 01:56:41.339755 16415 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 01:56:41.339874 16415 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 01:56:41.339981 16415 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 01:56:41.340035 16415 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 01:56:41.341346 16415 out.go:252] - Generating certificates and keys ...
I1122 01:56:41.341408 16415 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 01:56:41.341461 16415 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 01:56:41.341514 16415 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 01:56:41.341562 16415 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 01:56:41.341611 16415 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 01:56:41.341651 16415 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 01:56:41.341697 16415 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 01:56:41.341797 16415 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [addons-416530 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1122 01:56:41.341881 16415 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 01:56:41.342037 16415 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [addons-416530 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1122 01:56:41.342133 16415 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 01:56:41.342226 16415 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 01:56:41.342297 16415 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 01:56:41.342383 16415 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 01:56:41.342457 16415 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 01:56:41.342544 16415 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 01:56:41.342638 16415 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 01:56:41.342739 16415 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 01:56:41.342791 16415 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 01:56:41.342871 16415 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 01:56:41.342957 16415 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 01:56:41.344093 16415 out.go:252] - Booting up control plane ...
I1122 01:56:41.344221 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 01:56:41.344317 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 01:56:41.344382 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 01:56:41.344473 16415 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 01:56:41.344557 16415 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 01:56:41.344646 16415 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 01:56:41.344735 16415 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 01:56:41.344787 16415 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 01:56:41.344990 16415 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 01:56:41.345147 16415 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 01:56:41.345235 16415 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001588796s
I1122 01:56:41.345363 16415 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 01:56:41.345456 16415 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
I1122 01:56:41.345553 16415 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 01:56:41.345658 16415 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 01:56:41.345762 16415 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 1.00520899s
I1122 01:56:41.345827 16415 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 1.527191887s
I1122 01:56:41.345927 16415 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 3.001542702s
I1122 01:56:41.346097 16415 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 01:56:41.346237 16415 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 01:56:41.346288 16415 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 01:56:41.346472 16415 kubeadm.go:319] [mark-control-plane] Marking the node addons-416530 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 01:56:41.346526 16415 kubeadm.go:319] [bootstrap-token] Using token: 1yfhb2.w0hpuq9jknzevoj9
I1122 01:56:41.347770 16415 out.go:252] - Configuring RBAC rules ...
I1122 01:56:41.347857 16415 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 01:56:41.347946 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 01:56:41.348070 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 01:56:41.348189 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 01:56:41.348338 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 01:56:41.348471 16415 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 01:56:41.348589 16415 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 01:56:41.348625 16415 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 01:56:41.348693 16415 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 01:56:41.348702 16415 kubeadm.go:319]
I1122 01:56:41.348789 16415 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 01:56:41.348798 16415 kubeadm.go:319]
I1122 01:56:41.348857 16415 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 01:56:41.348865 16415 kubeadm.go:319]
I1122 01:56:41.348884 16415 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 01:56:41.348962 16415 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 01:56:41.349034 16415 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 01:56:41.349043 16415 kubeadm.go:319]
I1122 01:56:41.349115 16415 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 01:56:41.349124 16415 kubeadm.go:319]
I1122 01:56:41.349188 16415 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 01:56:41.349197 16415 kubeadm.go:319]
I1122 01:56:41.349271 16415 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 01:56:41.349340 16415 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 01:56:41.349395 16415 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 01:56:41.349400 16415 kubeadm.go:319]
I1122 01:56:41.349464 16415 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 01:56:41.349535 16415 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 01:56:41.349547 16415 kubeadm.go:319]
I1122 01:56:41.349616 16415 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 1yfhb2.w0hpuq9jknzevoj9 \
I1122 01:56:41.349710 16415 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 01:56:41.349734 16415 kubeadm.go:319] --control-plane
I1122 01:56:41.349743 16415 kubeadm.go:319]
I1122 01:56:41.349813 16415 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 01:56:41.349822 16415 kubeadm.go:319]
I1122 01:56:41.349893 16415 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 1yfhb2.w0hpuq9jknzevoj9 \
I1122 01:56:41.350019 16415 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 01:56:41.350029 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:41.350036 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:41.351212 16415 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1122 01:56:41.352216 16415 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 01:56:41.356091 16415 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 01:56:41.356106 16415 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 01:56:41.368156 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 01:56:41.555657 16415 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 01:56:41.555787 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:41.555795 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-416530 minikube.k8s.io/updated_at=2025_11_22T01_56_41_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=addons-416530 minikube.k8s.io/primary=true
I1122 01:56:41.565182 16415 ops.go:34] apiserver oom_adj: -16
I1122 01:56:41.635751 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:42.135840 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:42.636798 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:43.135816 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:43.636413 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:44.136549 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:44.636541 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:45.136521 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:45.636229 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.136849 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.636205 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.702190 16415 kubeadm.go:1114] duration metric: took 5.14645036s to wait for elevateKubeSystemPrivileges
I1122 01:56:46.702234 16415 kubeadm.go:403] duration metric: took 14.170492333s to StartCluster
I1122 01:56:46.702271 16415 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:46.702399 16415 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:56:46.702850 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:46.703074 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 01:56:46.703117 16415 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 01:56:46.703161 16415 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:true storage-provisioner:true storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I1122 01:56:46.703302 16415 addons.go:70] Setting default-storageclass=true in profile "addons-416530"
I1122 01:56:46.703313 16415 addons.go:70] Setting yakd=true in profile "addons-416530"
I1122 01:56:46.703330 16415 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "addons-416530"
I1122 01:56:46.703336 16415 addons.go:70] Setting registry=true in profile "addons-416530"
I1122 01:56:46.703352 16415 addons.go:70] Setting ingress-dns=true in profile "addons-416530"
I1122 01:56:46.703370 16415 addons.go:70] Setting registry-creds=true in profile "addons-416530"
I1122 01:56:46.703379 16415 addons.go:239] Setting addon ingress-dns=true in "addons-416530"
I1122 01:56:46.703371 16415 addons.go:70] Setting nvidia-device-plugin=true in profile "addons-416530"
I1122 01:56:46.703390 16415 addons.go:70] Setting storage-provisioner-rancher=true in profile "addons-416530"
I1122 01:56:46.703385 16415 addons.go:70] Setting cloud-spanner=true in profile "addons-416530"
I1122 01:56:46.703421 16415 addons.go:239] Setting addon nvidia-device-plugin=true in "addons-416530"
I1122 01:56:46.703425 16415 addons_storage_classes.go:34] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-416530"
I1122 01:56:46.703434 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703437 16415 addons.go:239] Setting addon cloud-spanner=true in "addons-416530"
I1122 01:56:46.703480 16415 addons.go:70] Setting inspektor-gadget=true in profile "addons-416530"
I1122 01:56:46.703498 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703500 16415 addons.go:239] Setting addon inspektor-gadget=true in "addons-416530"
I1122 01:56:46.703526 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703533 16415 addons.go:70] Setting amd-gpu-device-plugin=true in profile "addons-416530"
I1122 01:56:46.703547 16415 addons.go:239] Setting addon amd-gpu-device-plugin=true in "addons-416530"
I1122 01:56:46.703561 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703572 16415 addons.go:70] Setting ingress=true in profile "addons-416530"
I1122 01:56:46.703587 16415 addons.go:239] Setting addon ingress=true in "addons-416530"
I1122 01:56:46.703641 16415 addons.go:70] Setting volcano=true in profile "addons-416530"
I1122 01:56:46.703745 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703756 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703952 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704056 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704074 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704154 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704282 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.704608 16415 addons.go:239] Setting addon volcano=true in "addons-416530"
I1122 01:56:46.712951 16415 out.go:179] * Verifying Kubernetes components...
I1122 01:56:46.703381 16415 addons.go:239] Setting addon registry-creds=true in "addons-416530"
I1122 01:56:46.718311 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.718347 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.719257 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.719398 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703528 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.720100 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:46.713739 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703337 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:46.703364 16415 addons.go:239] Setting addon registry=true in "addons-416530"
I1122 01:56:46.721868 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.722473 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.723101 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703386 16415 addons.go:70] Setting storage-provisioner=true in profile "addons-416530"
I1122 01:56:46.726663 16415 addons.go:239] Setting addon storage-provisioner=true in "addons-416530"
I1122 01:56:46.726862 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.704877 16415 addons.go:70] Setting gcp-auth=true in profile "addons-416530"
I1122 01:56:46.727254 16415 mustload.go:66] Loading cluster: addons-416530
I1122 01:56:46.727472 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:46.727762 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.728351 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704982 16415 addons.go:70] Setting metrics-server=true in profile "addons-416530"
I1122 01:56:46.731950 16415 addons.go:239] Setting addon metrics-server=true in "addons-416530"
I1122 01:56:46.732092 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.705328 16415 addons.go:70] Setting volumesnapshots=true in profile "addons-416530"
I1122 01:56:46.732170 16415 addons.go:239] Setting addon volumesnapshots=true in "addons-416530"
I1122 01:56:46.732314 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703331 16415 addons.go:239] Setting addon yakd=true in "addons-416530"
I1122 01:56:46.737126 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.705362 16415 addons.go:70] Setting csi-hostpath-driver=true in profile "addons-416530"
I1122 01:56:46.737371 16415 addons.go:239] Setting addon csi-hostpath-driver=true in "addons-416530"
I1122 01:56:46.737410 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.738034 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.738421 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.741614 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.742398 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.756971 16415 out.go:179] - Using image docker.io/kicbase/minikube-ingress-dns:0.0.4
I1122 01:56:46.758499 16415 addons.go:436] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I1122 01:56:46.758523 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2889 bytes)
I1122 01:56:46.758585 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.760004 16415 addons.go:239] Setting addon storage-provisioner-rancher=true in "addons-416530"
I1122 01:56:46.760051 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.760271 16415 addons.go:239] Setting addon default-storageclass=true in "addons-416530"
I1122 01:56:46.760301 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.763076 16415 out.go:179] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.9
I1122 01:56:46.763546 16415 out.go:179] - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
I1122 01:56:46.764397 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.764505 16415 addons.go:436] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1122 01:56:46.764519 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
I1122 01:56:46.764573 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.768350 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.768501 16415 out.go:179] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.18.0
I1122 01:56:46.770514 16415 out.go:179] - Using image docker.io/registry:3.0.0
I1122 01:56:46.772686 16415 addons.go:436] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1122 01:56:46.772704 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I1122 01:56:46.772762 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.772947 16415 addons.go:436] installing /etc/kubernetes/addons/registry-rc.yaml
I1122 01:56:46.772971 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I1122 01:56:46.773021 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.776869 16415 out.go:179] - Using image docker.io/upmcenterprises/registry-creds:1.10
I1122 01:56:46.778286 16415 addons.go:436] installing /etc/kubernetes/addons/registry-creds-rc.yaml
I1122 01:56:46.778303 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-creds-rc.yaml (3306 bytes)
I1122 01:56:46.778370 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.786118 16415 out.go:179] - Using image registry.k8s.io/metrics-server/metrics-server:v0.8.0
I1122 01:56:46.787048 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1122 01:56:46.787066 16415 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1122 01:56:46.787129 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.797898 16415 out.go:179] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.46.0
I1122 01:56:46.799232 16415 out.go:179] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I1122 01:56:46.800053 16415 addons.go:436] installing /etc/kubernetes/addons/ig-deployment.yaml
I1122 01:56:46.800077 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (15034 bytes)
I1122 01:56:46.800134 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.800387 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1122 01:56:46.800407 16415 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I1122 01:56:46.800470 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
W1122 01:56:46.809713 16415 out.go:285] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
I1122 01:56:46.810982 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/controller:v1.14.0
I1122 01:56:46.811625 16415 out.go:179] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.43
I1122 01:56:46.813172 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:46.813266 16415 addons.go:436] installing /etc/kubernetes/addons/deployment.yaml
I1122 01:56:46.813630 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I1122 01:56:46.814097 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.817480 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.818489 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:46.819923 16415 addons.go:436] installing /etc/kubernetes/addons/ingress-deploy.yaml
I1122 01:56:46.819987 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I1122 01:56:46.820066 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.830256 16415 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 01:56:46.830277 16415 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 01:56:46.830333 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.842891 16415 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 01:56:46.844127 16415 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 01:56:46.844270 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 01:56:46.844439 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.861180 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.864096 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.865939 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.866693 16415 out.go:179] - Using image docker.io/marcnuri/yakd:0.0.5
I1122 01:56:46.866808 16415 out.go:179] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I1122 01:56:46.867570 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.867711 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-ns.yaml
I1122 01:56:46.867728 16415 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I1122 01:56:46.867783 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.868012 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.869202 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 01:56:46.869370 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.869443 16415 out.go:179] - Using image docker.io/busybox:stable
I1122 01:56:46.870565 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.871833 16415 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1122 01:56:46.871849 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I1122 01:56:46.871894 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.871958 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I1122 01:56:46.874760 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I1122 01:56:46.875417 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.877084 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I1122 01:56:46.878672 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.881105 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I1122 01:56:46.882163 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I1122 01:56:46.883217 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I1122 01:56:46.884178 16415 out.go:179] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I1122 01:56:46.885050 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.885281 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.886283 16415 out.go:179] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I1122 01:56:46.887300 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I1122 01:56:46.887353 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I1122 01:56:46.887431 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.898892 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.914393 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
W1122 01:56:46.915700 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.915735 16415 retry.go:31] will retry after 357.801287ms: ssh: handshake failed: EOF
I1122 01:56:46.926606 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.930720 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
W1122 01:56:46.931260 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.931283 16415 retry.go:31] will retry after 234.770967ms: ssh: handshake failed: EOF
W1122 01:56:46.931599 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.931617 16415 retry.go:31] will retry after 315.440077ms: ssh: handshake failed: EOF
I1122 01:56:46.956355 16415 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 01:56:47.017061 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I1122 01:56:47.027125 16415 addons.go:436] installing /etc/kubernetes/addons/registry-svc.yaml
I1122 01:56:47.027209 16415 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I1122 01:56:47.027462 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-creds-rc.yaml
I1122 01:56:47.028751 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I1122 01:56:47.031489 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 01:56:47.038882 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1122 01:56:47.038914 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I1122 01:56:47.048598 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1122 01:56:47.048622 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I1122 01:56:47.056162 16415 addons.go:436] installing /etc/kubernetes/addons/registry-proxy.yaml
I1122 01:56:47.056181 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I1122 01:56:47.062870 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1122 01:56:47.062890 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I1122 01:56:47.064036 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I1122 01:56:47.067892 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ig-deployment.yaml
I1122 01:56:47.069613 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1122 01:56:47.072880 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1122 01:56:47.078499 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 01:56:47.083070 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1122 01:56:47.083129 16415 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1122 01:56:47.095648 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I1122 01:56:47.116313 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1122 01:56:47.116405 16415 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1122 01:56:47.117181 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1122 01:56:47.117262 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I1122 01:56:47.150056 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1122 01:56:47.150145 16415 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I1122 01:56:47.192407 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1122 01:56:47.192680 16415 addons.go:436] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:47.192700 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I1122 01:56:47.202373 16415 node_ready.go:35] waiting up to 6m0s for node "addons-416530" to be "Ready" ...
I1122 01:56:47.203690 16415 start.go:977] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I1122 01:56:47.246966 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:47.366231 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1122 01:56:47.436160 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-sa.yaml
I1122 01:56:47.436251 16415 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I1122 01:56:47.490109 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-crb.yaml
I1122 01:56:47.490133 16415 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I1122 01:56:47.493273 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I1122 01:56:47.493362 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I1122 01:56:47.532081 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-svc.yaml
I1122 01:56:47.532111 16415 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I1122 01:56:47.539252 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1122 01:56:47.539277 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I1122 01:56:47.568368 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-dp.yaml
I1122 01:56:47.568396 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I1122 01:56:47.596945 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1122 01:56:47.596974 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I1122 01:56:47.598219 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I1122 01:56:47.631295 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I1122 01:56:47.631392 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I1122 01:56:47.669180 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1122 01:56:47.669210 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I1122 01:56:47.704566 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1122 01:56:47.704590 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I1122 01:56:47.718653 16415 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-416530" context rescaled to 1 replicas
I1122 01:56:47.753127 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1122 01:56:47.753216 16415 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I1122 01:56:47.790642 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1122 01:56:47.790667 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I1122 01:56:47.812298 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1122 01:56:47.812396 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I1122 01:56:47.833576 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1122 01:56:47.833661 16415 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I1122 01:56:47.854115 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1122 01:56:48.135537 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (1.071467212s)
I1122 01:56:48.135576 16415 addons.go:495] Verifying addon ingress=true in "addons-416530"
I1122 01:56:48.135666 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ig-deployment.yaml: (1.067727417s)
I1122 01:56:48.135713 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.062755196s)
I1122 01:56:48.135725 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.057212085s)
I1122 01:56:48.135698 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (1.066021129s)
I1122 01:56:48.135759 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (1.040092191s)
I1122 01:56:48.135770 16415 addons.go:495] Verifying addon registry=true in "addons-416530"
I1122 01:56:48.135856 16415 addons.go:495] Verifying addon metrics-server=true in "addons-416530"
I1122 01:56:48.141752 16415 out.go:179] * Verifying registry addon...
I1122 01:56:48.141753 16415 out.go:179] * Verifying ingress addon...
I1122 01:56:48.143404 16415 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I1122 01:56:48.143530 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I1122 01:56:48.145288 16415 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1122 01:56:48.145465 16415 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
I1122 01:56:48.145487 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:48.530803 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.283630017s)
W1122 01:56:48.530848 16415 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1122 01:56:48.530870 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.164552076s)
I1122 01:56:48.530871 16415 retry.go:31] will retry after 168.242369ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1122 01:56:48.531205 16415 addons.go:495] Verifying addon csi-hostpath-driver=true in "addons-416530"
I1122 01:56:48.533265 16415 out.go:179] * Verifying csi-hostpath-driver addon...
I1122 01:56:48.533262 16415 out.go:179] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-416530 service yakd-dashboard -n yakd-dashboard
I1122 01:56:48.535549 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1122 01:56:48.537820 16415 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1122 01:56:48.537843 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:48.646192 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:48.646420 16415 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1122 01:56:48.646437 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:48.699819 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:49.037874 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:49.146781 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:49.146884 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:49.205023 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:49.538929 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:49.646225 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:49.646435 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:50.038507 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:50.145967 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:50.146116 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:50.538423 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:50.646652 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:50.646711 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:51.038817 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:51.142662 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.442806743s)
I1122 01:56:51.145816 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:51.146035 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:51.538124 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:51.646712 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:51.646764 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:51.704530 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:52.038664 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:52.146299 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:52.146485 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:52.538735 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:52.645701 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:52.645768 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:53.039024 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:53.145814 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:53.145968 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:53.538343 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:53.646767 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:53.646937 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:53.705017 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:54.038766 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:54.145568 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:54.145809 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:54.475275 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I1122 01:56:54.475341 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:54.492311 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:54.538959 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:54.591148 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I1122 01:56:54.602564 16415 addons.go:239] Setting addon gcp-auth=true in "addons-416530"
I1122 01:56:54.602604 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:54.602964 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:54.619559 16415 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I1122 01:56:54.619620 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:54.635721 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:54.646671 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:54.646814 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:54.725629 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:54.726779 16415 out.go:179] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I1122 01:56:54.727782 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I1122 01:56:54.727796 16415 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I1122 01:56:54.739538 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I1122 01:56:54.739553 16415 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I1122 01:56:54.751169 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1122 01:56:54.751185 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I1122 01:56:54.762670 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1122 01:56:55.038207 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:55.040732 16415 addons.go:495] Verifying addon gcp-auth=true in "addons-416530"
I1122 01:56:55.041861 16415 out.go:179] * Verifying gcp-auth addon...
I1122 01:56:55.043633 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I1122 01:56:55.138939 16415 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1122 01:56:55.138955 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:55.145702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:55.145895 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:55.537521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:55.546013 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:55.646066 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:55.646315 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:56.038673 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:56.046504 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:56.145463 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:56.145605 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:56.204299 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:56.538521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:56.546195 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:56.646259 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:56.646347 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:57.037824 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:57.045595 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:57.145438 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:57.145617 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:57.538768 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:57.545511 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:57.645831 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:57.646040 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:58.038395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:58.046143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:58.145922 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:58.146195 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:58.204736 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:58.538112 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:58.545855 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:58.645835 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:58.645871 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:59.038115 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:59.045853 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:59.145962 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:59.146233 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:59.538088 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:59.545693 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:59.646282 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:59.646295 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:00.038495 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:00.046190 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:00.145860 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:00.146250 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:00.204964 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:00.537945 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:00.545598 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:00.645432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:00.645603 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:01.039147 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:01.045886 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:01.145655 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:01.145868 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:01.537712 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:01.546395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:01.646931 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:01.647097 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:02.038561 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:02.046355 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:02.146205 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:02.146419 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:02.205069 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:02.538513 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:02.546160 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:02.646198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:02.646320 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:03.038392 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:03.046105 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:03.146029 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:03.146208 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:03.538226 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:03.545880 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:03.645955 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:03.646081 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:04.039127 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:04.045609 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:04.145372 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:04.145532 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:04.538660 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:04.546390 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:04.646262 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:04.646437 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:04.705160 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:05.038494 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:05.046248 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:05.146110 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:05.146317 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:05.538515 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:05.546287 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:05.646634 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:05.646679 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:06.038848 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:06.045340 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:06.146476 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:06.146564 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:06.538579 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:06.546335 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:06.646232 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:06.646360 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:07.038711 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:07.046558 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:07.145497 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:07.145538 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:07.205081 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:07.538436 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:07.546129 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:07.646479 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:07.646577 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:08.038639 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:08.046346 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:08.146200 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:08.146356 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:08.538323 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:08.546056 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:08.646191 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:08.646215 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:09.038576 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:09.046408 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:09.145271 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:09.145464 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:09.538499 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:09.546334 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:09.646844 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:09.646901 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:09.704537 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:10.038006 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:10.045514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:10.145270 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:10.145479 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:10.538078 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:10.545783 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:10.645779 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:10.645838 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:11.038761 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:11.045395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:11.146141 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:11.146528 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:11.538514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:11.546198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:11.646603 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:11.646738 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:11.704738 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:12.038242 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:12.046123 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:12.146137 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:12.146284 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:12.538476 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:12.546189 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:12.646276 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:12.646422 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.038240 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:13.046007 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:13.145828 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:13.146187 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.538407 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:13.546154 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:13.646053 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.646117 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.038039 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:14.046041 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:14.146106 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.146126 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:14.204968 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:14.538290 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:14.545978 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:14.645713 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.645860 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:15.037862 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:15.045628 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:15.145874 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:15.146094 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:15.537638 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:15.546197 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:15.646058 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:15.646275 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:16.038329 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:16.046045 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:16.145869 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:16.146098 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:16.538058 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:16.545748 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:16.645668 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:16.645780 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:16.704363 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:17.037777 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:17.045623 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:17.145419 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:17.145535 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:17.538432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:17.546166 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:17.646076 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:17.646228 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:18.038107 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:18.045740 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:18.145754 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:18.145959 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:18.537767 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:18.545397 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:18.646429 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:18.646624 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:18.705060 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:19.038588 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:19.046353 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:19.146249 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:19.146288 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:19.537872 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:19.545435 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:19.645953 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:19.646133 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:20.038295 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:20.045794 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:20.145616 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:20.145752 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:20.537790 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:20.545523 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:20.645490 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:20.645671 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:21.038704 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:21.046755 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:21.145834 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:21.146041 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:21.204648 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:21.537825 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:21.545792 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:21.646098 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:21.646198 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:22.038516 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:22.046309 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:22.146521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:22.146627 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:22.537618 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:22.546323 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:22.646173 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:22.646364 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:23.038291 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:23.046057 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:23.146622 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:23.147801 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:23.538694 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:23.546420 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:23.662251 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:23.662459 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:23.705170 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:24.037575 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:24.046445 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:24.145526 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:24.145571 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:24.537647 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:24.546382 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:24.646202 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:24.646315 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.038445 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:25.046241 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:25.146188 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.146496 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:25.538432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:25.546213 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:25.646004 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.646214 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:26.038268 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:26.046143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:26.146096 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:26.146151 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:26.204951 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:26.538286 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:26.546043 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:26.645987 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:26.646186 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.038367 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:27.046131 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:27.146183 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:27.146315 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.538812 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:27.549855 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:27.647425 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.647437 16415 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I1122 01:57:27.647468 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:27.705031 16415 node_ready.go:49] node "addons-416530" is "Ready"
I1122 01:57:27.705056 16415 node_ready.go:38] duration metric: took 40.502655134s for node "addons-416530" to be "Ready" ...
I1122 01:57:27.705072 16415 api_server.go:52] waiting for apiserver process to appear ...
I1122 01:57:27.705119 16415 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 01:57:27.719429 16415 api_server.go:72] duration metric: took 41.016272642s to wait for apiserver process to appear ...
I1122 01:57:27.719455 16415 api_server.go:88] waiting for apiserver healthz status ...
I1122 01:57:27.719477 16415 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I1122 01:57:27.723923 16415 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I1122 01:57:27.724745 16415 api_server.go:141] control plane version: v1.34.1
I1122 01:57:27.724769 16415 api_server.go:131] duration metric: took 5.306441ms to wait for apiserver health ...
I1122 01:57:27.724780 16415 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 01:57:27.728323 16415 system_pods.go:59] 20 kube-system pods found
I1122 01:57:27.728351 16415 system_pods.go:61] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.728360 16415 system_pods.go:61] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.728367 16415 system_pods.go:61] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.728373 16415 system_pods.go:61] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.728380 16415 system_pods.go:61] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.728385 16415 system_pods.go:61] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.728391 16415 system_pods.go:61] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.728395 16415 system_pods.go:61] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.728398 16415 system_pods.go:61] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.728403 16415 system_pods.go:61] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.728406 16415 system_pods.go:61] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.728410 16415 system_pods.go:61] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.728415 16415 system_pods.go:61] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.728424 16415 system_pods.go:61] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.728433 16415 system_pods.go:61] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.728438 16415 system_pods.go:61] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.728445 16415 system_pods.go:61] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.728449 16415 system_pods.go:61] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.728455 16415 system_pods.go:61] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.728459 16415 system_pods.go:61] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.728469 16415 system_pods.go:74] duration metric: took 3.684077ms to wait for pod list to return data ...
I1122 01:57:27.728477 16415 default_sa.go:34] waiting for default service account to be created ...
I1122 01:57:27.730188 16415 default_sa.go:45] found service account: "default"
I1122 01:57:27.730203 16415 default_sa.go:55] duration metric: took 1.720911ms for default service account to be created ...
I1122 01:57:27.730211 16415 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 01:57:27.733487 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:27.733523 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.733535 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.733547 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.733555 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.733563 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.733569 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.733575 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.733580 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.733586 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.733593 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.733599 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.733604 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.733612 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.733619 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.733627 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.733636 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.733643 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.733664 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.733672 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.733679 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.733697 16415 retry.go:31] will retry after 222.244878ms: missing components: kube-dns
I1122 01:57:27.962135 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:27.962241 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.962268 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.962310 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.962330 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.962341 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.962350 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.962357 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.962371 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.962377 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.962388 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.962393 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.962399 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.962406 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.962415 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.962424 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.962444 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.962453 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.962461 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.962471 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.962479 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.962502 16415 retry.go:31] will retry after 283.084564ms: missing components: kube-dns
I1122 01:57:28.059376 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:28.059490 16415 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1122 01:57:28.059509 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:28.159469 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:28.159574 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:28.261112 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:28.261141 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:28.261148 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:28.261157 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:28.261163 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:28.261168 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:28.261171 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:28.261176 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:28.261179 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:28.261182 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:28.261187 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:28.261191 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:28.261195 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:28.261204 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:28.261209 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:28.261215 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:28.261220 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:28.261227 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:28.261244 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.261254 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.261260 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:28.261278 16415 retry.go:31] will retry after 325.086575ms: missing components: kube-dns
I1122 01:57:28.538979 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:28.545902 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:28.591011 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:28.591047 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:28.591059 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:28.591070 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:28.591080 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:28.591088 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:28.591096 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:28.591103 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:28.591108 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:28.591114 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:28.591124 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:28.591129 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:28.591140 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:28.591147 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:28.591156 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:28.591170 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:28.591178 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:28.591186 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:28.591196 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.591205 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.591213 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:28.591231 16415 retry.go:31] will retry after 583.847165ms: missing components: kube-dns
I1122 01:57:28.646746 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:28.646821 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:29.039143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:29.138862 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:29.145829 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:29.145975 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:29.178901 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:29.178944 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:29.178953 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Running
I1122 01:57:29.178963 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:29.178972 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:29.178991 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:29.178999 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:29.179004 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:29.179009 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:29.179015 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:29.179023 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:29.179029 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:29.179035 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:29.179043 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:29.179053 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:29.179064 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:29.179072 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:29.179082 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:29.179087 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:29.179095 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:29.179104 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Running
I1122 01:57:29.179115 16415 system_pods.go:126] duration metric: took 1.448897723s to wait for k8s-apps to be running ...
I1122 01:57:29.179127 16415 system_svc.go:44] waiting for kubelet service to be running ....
I1122 01:57:29.179173 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 01:57:29.191198 16415 system_svc.go:56] duration metric: took 12.066031ms WaitForService to wait for kubelet
I1122 01:57:29.191219 16415 kubeadm.go:587] duration metric: took 42.488068986s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 01:57:29.191241 16415 node_conditions.go:102] verifying NodePressure condition ...
I1122 01:57:29.193509 16415 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 01:57:29.193538 16415 node_conditions.go:123] node cpu capacity is 8
I1122 01:57:29.193555 16415 node_conditions.go:105] duration metric: took 2.302045ms to run NodePressure ...
I1122 01:57:29.193572 16415 start.go:242] waiting for startup goroutines ...
I1122 01:57:29.539940 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:29.545960 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:29.646732 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:29.646870 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:30.041064 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:30.048490 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:30.146794 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:30.146830 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:30.539014 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:30.546188 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:30.647060 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:30.647154 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:31.039400 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:31.046326 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:31.147705 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:31.147858 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:31.538533 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:31.546392 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:31.646442 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:31.646507 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:32.038603 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:32.046305 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:32.147421 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:32.147455 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:32.539365 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:32.546524 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:32.645953 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:32.646086 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:33.039395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:33.046165 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:33.146553 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:33.146622 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:33.538893 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:33.546023 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:33.646819 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:33.647105 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.040226 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:34.046397 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:34.147333 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:34.147405 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.539474 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:34.546201 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:34.646801 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.646974 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.039478 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:35.046702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:35.146736 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.146780 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:35.539479 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:35.546571 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:35.647502 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.647570 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:36.038699 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:36.046716 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:36.146711 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:36.146769 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:36.538590 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:36.546212 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:36.647060 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:36.647127 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:37.039441 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:37.046204 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:37.146244 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:37.146252 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:37.545341 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:37.550465 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:37.647607 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:37.647771 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:38.038461 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:38.046251 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:38.147482 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:38.147540 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:38.538311 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:38.545958 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:38.646271 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:38.646364 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.038044 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:39.045514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:39.145578 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:39.145651 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.538702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:39.546642 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:39.646300 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.646360 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.040076 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:40.045899 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:40.146670 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.146833 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:40.538819 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:40.546864 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:40.646630 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.646697 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:41.039142 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:41.046383 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:41.147385 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:41.147447 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:41.539125 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:41.546201 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:41.647079 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:41.647201 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:42.038847 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:42.138811 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:42.239307 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:42.239651 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:42.539369 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:42.546386 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:42.647648 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:42.647757 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:43.038597 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:43.046466 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:43.145985 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:43.146059 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:43.546809 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:43.546888 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:43.646820 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:43.646830 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.050621 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:44.050870 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:44.152769 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:44.152784 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.538812 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:44.546692 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:44.646629 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.646674 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.039192 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:45.045746 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:45.146063 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.146191 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:45.539138 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:45.545731 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:45.646367 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.646501 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:46.040055 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:46.045994 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:46.146643 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:46.146814 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:46.538528 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:46.546038 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:46.646156 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:46.646171 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:47.039023 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:47.045742 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:47.146777 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:47.146787 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:47.539486 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:47.547068 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:47.647646 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:47.647942 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:48.039895 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:48.046215 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:48.146887 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:48.146967 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:48.539053 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:48.545851 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:48.646108 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:48.646248 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:49.039006 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:49.045433 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:49.145296 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:49.145457 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:49.538050 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:49.546288 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:49.647169 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:49.647219 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:50.039035 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:50.045695 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:50.145574 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:50.145773 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:50.540014 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:50.546011 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:50.646776 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:50.646824 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:51.038652 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:51.046176 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:51.146266 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:51.146411 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:51.540094 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:51.546103 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:51.647046 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:51.647131 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.039101 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:52.045674 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:52.146680 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:52.146846 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.541329 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:52.547414 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:52.646589 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.647529 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:53.039253 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:53.046651 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:53.147181 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:53.147184 16415 kapi.go:107] duration metric: took 1m5.003655053s to wait for kubernetes.io/minikube-addons=registry ...
I1122 01:57:53.538628 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:53.546458 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:53.646281 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:54.039673 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:54.046577 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:54.146494 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:54.538521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:54.546961 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:54.646423 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:55.038352 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:55.045976 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:55.146675 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:55.538808 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:55.546640 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:55.646432 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:56.039186 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:56.046299 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:56.147345 16415 kapi.go:107] duration metric: took 1m8.003935189s to wait for app.kubernetes.io/name=ingress-nginx ...
I1122 01:57:56.538944 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:56.545473 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:57.042326 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:57.048462 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:57.539247 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:57.546169 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:58.039468 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:58.046842 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:58.539311 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:58.546416 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:59.039894 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:59.046968 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:59.538888 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:59.546198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:00.038008 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:00.045355 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:00.539233 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:00.546444 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:01.038763 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:01.046854 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:01.539197 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:01.546174 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:02.038235 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:02.045809 16415 kapi.go:107] duration metric: took 1m7.002173456s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I1122 01:58:02.094720 16415 out.go:179] * Your GCP credentials will now be mounted into every pod created in the addons-416530 cluster.
I1122 01:58:02.096521 16415 out.go:179] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I1122 01:58:02.099205 16415 out.go:179] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I1122 01:58:02.538717 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:03.039360 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:03.539019 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:04.038817 16415 kapi.go:107] duration metric: took 1m15.50326538s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I1122 01:58:04.040412 16415 out.go:179] * Enabled addons: ingress-dns, cloud-spanner, storage-provisioner, registry-creds, inspektor-gadget, nvidia-device-plugin, amd-gpu-device-plugin, metrics-server, default-storageclass, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
I1122 01:58:04.041471 16415 addons.go:530] duration metric: took 1m17.338308597s for enable addons: enabled=[ingress-dns cloud-spanner storage-provisioner registry-creds inspektor-gadget nvidia-device-plugin amd-gpu-device-plugin metrics-server default-storageclass yakd storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
I1122 01:58:04.041512 16415 start.go:247] waiting for cluster config update ...
I1122 01:58:04.041533 16415 start.go:256] writing updated cluster config ...
I1122 01:58:04.041773 16415 ssh_runner.go:195] Run: rm -f paused
I1122 01:58:04.045501 16415 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 01:58:04.048074 16415 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-p4spw" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.051359 16415 pod_ready.go:94] pod "coredns-66bc5c9577-p4spw" is "Ready"
I1122 01:58:04.051379 16415 pod_ready.go:86] duration metric: took 3.280292ms for pod "coredns-66bc5c9577-p4spw" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.052966 16415 pod_ready.go:83] waiting for pod "etcd-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.055841 16415 pod_ready.go:94] pod "etcd-addons-416530" is "Ready"
I1122 01:58:04.055859 16415 pod_ready.go:86] duration metric: took 2.875943ms for pod "etcd-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.057359 16415 pod_ready.go:83] waiting for pod "kube-apiserver-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.060397 16415 pod_ready.go:94] pod "kube-apiserver-addons-416530" is "Ready"
I1122 01:58:04.060415 16415 pod_ready.go:86] duration metric: took 3.035918ms for pod "kube-apiserver-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.061811 16415 pod_ready.go:83] waiting for pod "kube-controller-manager-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.448975 16415 pod_ready.go:94] pod "kube-controller-manager-addons-416530" is "Ready"
I1122 01:58:04.449004 16415 pod_ready.go:86] duration metric: took 387.176283ms for pod "kube-controller-manager-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.649692 16415 pod_ready.go:83] waiting for pod "kube-proxy-srcjh" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.048056 16415 pod_ready.go:94] pod "kube-proxy-srcjh" is "Ready"
I1122 01:58:05.048081 16415 pod_ready.go:86] duration metric: took 398.367916ms for pod "kube-proxy-srcjh" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.248605 16415 pod_ready.go:83] waiting for pod "kube-scheduler-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.649137 16415 pod_ready.go:94] pod "kube-scheduler-addons-416530" is "Ready"
I1122 01:58:05.649164 16415 pod_ready.go:86] duration metric: took 400.536596ms for pod "kube-scheduler-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.649175 16415 pod_ready.go:40] duration metric: took 1.603650475s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 01:58:05.691092 16415 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 01:58:05.693471 16415 out.go:179] * Done! kubectl is now configured to use "addons-416530" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.939829077Z" level=info msg="Running pod sandbox: default/hello-world-app-5d498dc89-x62rw/POD" id=54b9365c-11f3-40a4-b196-43102ad5ad80 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.939939402Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.948073161Z" level=info msg="Got pod network &{Name:hello-world-app-5d498dc89-x62rw Namespace:default ID:be8ecb2271f4a4c7725f7ba95ee92fb27bbaff769f262db7e5f1a77e0737562b UID:48b2b3c3-3d6a-4665-a697-cc22bba87909 NetNS:/var/run/netns/5f6f56cb-1570-4771-ab7f-4e66a71d673d Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00090cb38}] Aliases:map[]}"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.948110466Z" level=info msg="Adding pod default_hello-world-app-5d498dc89-x62rw to CNI network \"kindnet\" (type=ptp)"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.958987095Z" level=info msg="Got pod network &{Name:hello-world-app-5d498dc89-x62rw Namespace:default ID:be8ecb2271f4a4c7725f7ba95ee92fb27bbaff769f262db7e5f1a77e0737562b UID:48b2b3c3-3d6a-4665-a697-cc22bba87909 NetNS:/var/run/netns/5f6f56cb-1570-4771-ab7f-4e66a71d673d Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00090cb38}] Aliases:map[]}"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.959142298Z" level=info msg="Checking pod default_hello-world-app-5d498dc89-x62rw for CNI network kindnet (type=ptp)"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.959982991Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.960719767Z" level=info msg="Ran pod sandbox be8ecb2271f4a4c7725f7ba95ee92fb27bbaff769f262db7e5f1a77e0737562b with infra container: default/hello-world-app-5d498dc89-x62rw/POD" id=54b9365c-11f3-40a4-b196-43102ad5ad80 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.961884143Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=7b88e2e9-b6f2-4013-94a7-61e171203f3e name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.962022643Z" level=info msg="Image docker.io/kicbase/echo-server:1.0 not found" id=7b88e2e9-b6f2-4013-94a7-61e171203f3e name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.962066126Z" level=info msg="Neither image nor artfiact docker.io/kicbase/echo-server:1.0 found" id=7b88e2e9-b6f2-4013-94a7-61e171203f3e name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.9627337Z" level=info msg="Pulling image: docker.io/kicbase/echo-server:1.0" id=34599a93-e785-4422-8754-96106e9392a8 name=/runtime.v1.ImageService/PullImage
Nov 22 02:00:47 addons-416530 crio[779]: time="2025-11-22T02:00:47.978607005Z" level=info msg="Trying to access \"docker.io/kicbase/echo-server:1.0\""
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.833644661Z" level=info msg="Pulled image: docker.io/kicbase/echo-server@sha256:a82eba7887a40ecae558433f34225b2611dc77f982ce05b1ddb9b282b780fc86" id=34599a93-e785-4422-8754-96106e9392a8 name=/runtime.v1.ImageService/PullImage
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.834204628Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=4ef3d98b-7e42-488e-a732-47f97265d218 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.835541098Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=0ea1fa55-1544-4c45-a97d-78293db90f03 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.839091163Z" level=info msg="Creating container: default/hello-world-app-5d498dc89-x62rw/hello-world-app" id=3d50ca21-1c69-40c9-89ff-5beb35162608 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.839213968Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.845422686Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.845600018Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/d2bdc0e132935afe56e837071daed24e4ec8b0d03d6b9b0b0abfac1941f4f47e/merged/etc/passwd: no such file or directory"
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.845631818Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/d2bdc0e132935afe56e837071daed24e4ec8b0d03d6b9b0b0abfac1941f4f47e/merged/etc/group: no such file or directory"
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.84587957Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.876166379Z" level=info msg="Created container 1963c36717bb901ae5387ab68e3d9212233f242401fe7b4e34d61637e5b0f7a8: default/hello-world-app-5d498dc89-x62rw/hello-world-app" id=3d50ca21-1c69-40c9-89ff-5beb35162608 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.876664113Z" level=info msg="Starting container: 1963c36717bb901ae5387ab68e3d9212233f242401fe7b4e34d61637e5b0f7a8" id=78be16f6-1121-47e0-a5ce-63281c5caca9 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:00:48 addons-416530 crio[779]: time="2025-11-22T02:00:48.878626192Z" level=info msg="Started container" PID=9759 containerID=1963c36717bb901ae5387ab68e3d9212233f242401fe7b4e34d61637e5b0f7a8 description=default/hello-world-app-5d498dc89-x62rw/hello-world-app id=78be16f6-1121-47e0-a5ce-63281c5caca9 name=/runtime.v1.RuntimeService/StartContainer sandboxID=be8ecb2271f4a4c7725f7ba95ee92fb27bbaff769f262db7e5f1a77e0737562b
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
1963c36717bb9 docker.io/kicbase/echo-server@sha256:a82eba7887a40ecae558433f34225b2611dc77f982ce05b1ddb9b282b780fc86 Less than a second ago Running hello-world-app 0 be8ecb2271f4a hello-world-app-5d498dc89-x62rw default
62c3f43720ac2 docker.io/upmcenterprises/registry-creds@sha256:93a633d4f2b76a1c66bf19c664dbddc56093a543de6d54320f19f585ccd7d605 About a minute ago Running registry-creds 0 dd6ce9a9326ee registry-creds-764b6fb674-6mwhg kube-system
fbf8ac42284d1 docker.io/library/nginx@sha256:667473807103639a0aca5b49534a216d2b64f0fb868aaa801f023da0cdd781c7 2 minutes ago Running nginx 0 599d6e6ac37b3 nginx default
e96572ccdce05 gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 2 minutes ago Running busybox 0 fea4576034865 busybox default
2185b680b44ce registry.k8s.io/sig-storage/csi-snapshotter@sha256:d844cb1faeb4ecf44bae6aea370c9c6128a87e665e40370021427d79a8819ee5 2 minutes ago Running csi-snapshotter 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
988778748b220 registry.k8s.io/sig-storage/csi-provisioner@sha256:1bc653d13b27b8eefbba0799bdb5711819f8b987eaa6eb6750e8ef001958d5a7 2 minutes ago Running csi-provisioner 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
b5ed1d6e75f9e gcr.io/k8s-minikube/gcp-auth-webhook@sha256:441f351b4520c228d29ba8c02a438d9ba971dafbbba5c91eaf882b1528797fb8 2 minutes ago Running gcp-auth 0 d1b048c07b5c5 gcp-auth-78565c9fb4-fxl9z gcp-auth
ead8f9b1ffe4f registry.k8s.io/sig-storage/livenessprobe@sha256:42bc492c3c65078b1ccda5dbc416abf0cefdba3e6317416cbc43344cf0ed09b6 2 minutes ago Running liveness-probe 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
1a692754170e4 registry.k8s.io/sig-storage/hostpathplugin@sha256:6fdad87766e53edf987545067e69a0dffb8485cccc546be4efbaa14c9b22ea11 2 minutes ago Running hostpath 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
830e2a94a330f ghcr.io/inspektor-gadget/inspektor-gadget@sha256:9a12b3c1d155bb081ff408a9b6c1cec18573c967e0c3917225b81ffe11c0b7f2 2 minutes ago Running gadget 0 57bf7e3b8b785 gadget-trt2m gadget
df5d237ed72bd registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:7caa903cf3f8d1d70c3b7bb3e23223685b05e4f342665877eabe84ae38b92ecc 2 minutes ago Running node-driver-registrar 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
ced9cb41df05f registry.k8s.io/ingress-nginx/controller@sha256:7f2b00bd369a972bfb09acfe8c2525b99caeeeb54ab71d2822343e8fd4222e27 2 minutes ago Running controller 0 f7acbc48b8eb8 ingress-nginx-controller-6c8bf45fb-fndkb ingress-nginx
a0d6ea009d86b gcr.io/k8s-minikube/kube-registry-proxy@sha256:8f72a79b63ca56074435e82b87fca2642a8117e60be313d3586dbe2bfff11cac 2 minutes ago Running registry-proxy 0 b4eb79560826b registry-proxy-l6ggw kube-system
b29121801b415 docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f 2 minutes ago Running amd-gpu-device-plugin 0 6f30c290666a8 amd-gpu-device-plugin-qthwc kube-system
792f724873ba1 registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:317f43813e4e2c3e81823ff16041c8e0714fb80e6d040c6e6c799967ba27d864 2 minutes ago Running csi-external-health-monitor-controller 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
485648275f35d nvcr.io/nvidia/k8s-device-plugin@sha256:20db699f1480b6f37423cab909e9c6df5a4fdbd981b405e0d72f00a86fee5100 3 minutes ago Running nvidia-device-plugin-ctr 0 95174f7f8f5e5 nvidia-device-plugin-daemonset-98gcz kube-system
59cb705b74eea registry.k8s.io/sig-storage/csi-attacher@sha256:66e4ecfa0ec50a88f9cd145e006805816f57040f40662d4cb9e31d10519d9bf0 3 minutes ago Running csi-attacher 0 94aad0857aa63 csi-hostpath-attacher-0 kube-system
3a15e6024a813 registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922 3 minutes ago Running volume-snapshot-controller 0 b091e2adb0237 snapshot-controller-7d9fbc56b8-t8dwd kube-system
14cb3762f40a1 registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922 3 minutes ago Running volume-snapshot-controller 0 5614c28995cf9 snapshot-controller-7d9fbc56b8-cj59x kube-system
b9593030d4f2b registry.k8s.io/sig-storage/csi-resizer@sha256:0629447f7946e53df3ad775c5595888de1dae5a23bcaae8f68fdab0395af61a8 3 minutes ago Running csi-resizer 0 aab8d2e87c1be csi-hostpath-resizer-0 kube-system
a4e934f78ef46 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:f016159150cb72d879e0d3b6852afbed68fe21d86be1e92c62ab7f56515287f5 3 minutes ago Exited patch 0 e9ed01b5555cb ingress-nginx-admission-patch-48xbq ingress-nginx
87f8e5d2d9806 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:f016159150cb72d879e0d3b6852afbed68fe21d86be1e92c62ab7f56515287f5 3 minutes ago Exited create 0 5070df88dd69b ingress-nginx-admission-create-54nh4 ingress-nginx
38f92a0675988 docker.io/kicbase/minikube-ingress-dns@sha256:a0cc6cd76812357245a51bb05fabcd346a616c880e40ca4e0c8c8253912eaae7 3 minutes ago Running minikube-ingress-dns 0 b0a582d851be2 kube-ingress-dns-minikube kube-system
ddc3efb90a97c docker.io/marcnuri/yakd@sha256:8ebd1692ed5271719f13b728d9af7acb839aa04821e931c8993d908ad68b69fd 3 minutes ago Running yakd 0 cf583a682bc00 yakd-dashboard-5ff678cb9-jmp4w yakd-dashboard
0dad432ce915b docker.io/library/registry@sha256:f57ffd2bb01704b6082396158e77ca6d1112bc6fe32315c322864de804750d8a 3 minutes ago Running registry 0 723d574131ee7 registry-6b586f9694-cc4db kube-system
aad91611499fe docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef 3 minutes ago Running local-path-provisioner 0 a3ba8ae5d03f2 local-path-provisioner-648f6765c9-nzslx local-path-storage
982107589ed55 gcr.io/cloud-spanner-emulator/emulator@sha256:7360f5c5ff4b89d75592d9585fc2d59d207b08ccf262a84edfe79ee0613a7099 3 minutes ago Running cloud-spanner-emulator 0 2d97ffccdc604 cloud-spanner-emulator-6f9fcf858b-njfhw default
04799747c7ece registry.k8s.io/metrics-server/metrics-server@sha256:5dd31abb8093690d9624a53277a00d2257e7e57e6766be3f9f54cf9f54cddbc1 3 minutes ago Running metrics-server 0 146202e5dbb40 metrics-server-85b7d694d7-ccqr5 kube-system
503ba38162056 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 3 minutes ago Running coredns 0 17b15b208c353 coredns-66bc5c9577-p4spw kube-system
df7b6a61c743a 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 3 minutes ago Running storage-provisioner 0 2ad1d5c11c095 storage-provisioner kube-system
d8ab0cb5f0070 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 4 minutes ago Running kube-proxy 0 d51c30d072809 kube-proxy-srcjh kube-system
8948dab032502 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 4 minutes ago Running kindnet-cni 0 7935ae92f8d3e kindnet-9xxr6 kube-system
5f0052817eef4 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 4 minutes ago Running kube-scheduler 0 61e2fa067f959 kube-scheduler-addons-416530 kube-system
a03417c044e35 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 4 minutes ago Running etcd 0 e37847b950a69 etcd-addons-416530 kube-system
add672f356f20 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 4 minutes ago Running kube-controller-manager 0 24e50469d5184 kube-controller-manager-addons-416530 kube-system
83bba379fe411 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 4 minutes ago Running kube-apiserver 0 b6a7fe476f40d kube-apiserver-addons-416530 kube-system
==> coredns [503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83] <==
[INFO] 10.244.0.22:43374 - 26747 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000228501s
[INFO] 10.244.0.22:47489 - 32713 "AAAA IN storage.googleapis.com.us-central1-a.c.k8s-minikube.internal. udp 89 false 1232" NXDOMAIN qr,rd,ra 188 0.004532956s
[INFO] 10.244.0.22:49720 - 5913 "A IN storage.googleapis.com.us-central1-a.c.k8s-minikube.internal. udp 89 false 1232" NXDOMAIN qr,rd,ra 188 0.005097202s
[INFO] 10.244.0.22:45994 - 58717 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.005252867s
[INFO] 10.244.0.22:59687 - 33439 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.006160479s
[INFO] 10.244.0.22:36307 - 29824 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004288512s
[INFO] 10.244.0.22:34023 - 2243 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004492758s
[INFO] 10.244.0.22:56981 - 30046 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.000986332s
[INFO] 10.244.0.22:38580 - 58767 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001735796s
[INFO] 10.244.0.26:52662 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000213741s
[INFO] 10.244.0.26:53868 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000170184s
[INFO] 10.244.0.31:37087 - 54464 "A IN accounts.google.com.kube-system.svc.cluster.local. udp 67 false 512" NXDOMAIN qr,aa,rd 160 0.000240105s
[INFO] 10.244.0.31:52993 - 64447 "AAAA IN accounts.google.com.kube-system.svc.cluster.local. udp 67 false 512" NXDOMAIN qr,aa,rd 160 0.000328439s
[INFO] 10.244.0.31:42765 - 37168 "AAAA IN accounts.google.com.svc.cluster.local. udp 55 false 512" NXDOMAIN qr,aa,rd 148 0.000114566s
[INFO] 10.244.0.31:38632 - 7230 "A IN accounts.google.com.svc.cluster.local. udp 55 false 512" NXDOMAIN qr,aa,rd 148 0.000148468s
[INFO] 10.244.0.31:51590 - 31963 "AAAA IN accounts.google.com.cluster.local. udp 51 false 512" NXDOMAIN qr,aa,rd 144 0.000098618s
[INFO] 10.244.0.31:59906 - 11556 "A IN accounts.google.com.cluster.local. udp 51 false 512" NXDOMAIN qr,aa,rd 144 0.000118074s
[INFO] 10.244.0.31:45843 - 50083 "AAAA IN accounts.google.com.us-central1-a.c.k8s-minikube.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 185 0.004811047s
[INFO] 10.244.0.31:47900 - 12974 "A IN accounts.google.com.us-central1-a.c.k8s-minikube.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 185 0.006113591s
[INFO] 10.244.0.31:35362 - 56513 "AAAA IN accounts.google.com.c.k8s-minikube.internal. udp 61 false 512" NXDOMAIN qr,rd,ra 166 0.004321583s
[INFO] 10.244.0.31:36911 - 3817 "A IN accounts.google.com.c.k8s-minikube.internal. udp 61 false 512" NXDOMAIN qr,rd,ra 166 0.00558336s
[INFO] 10.244.0.31:55622 - 9602 "A IN accounts.google.com.google.internal. udp 53 false 512" NXDOMAIN qr,rd,ra 158 0.004751661s
[INFO] 10.244.0.31:52936 - 45295 "AAAA IN accounts.google.com.google.internal. udp 53 false 512" NXDOMAIN qr,rd,ra 158 0.005128737s
[INFO] 10.244.0.31:36348 - 55584 "A IN accounts.google.com. udp 37 false 512" NOERROR qr,rd,ra 72 0.001728301s
[INFO] 10.244.0.31:43156 - 13758 "AAAA IN accounts.google.com. udp 37 false 512" NOERROR qr,rd,ra 84 0.001798074s
==> describe nodes <==
Name: addons-416530
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-416530
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=addons-416530
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T01_56_41_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-416530
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-416530"}
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 01:56:38 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-416530
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:00:44 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:00:45 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:00:45 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:00:45 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:00:45 +0000 Sat, 22 Nov 2025 01:57:27 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-416530
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 423f733e-c016-45a4-a157-39c80f7c1866
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (29 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 2m43s
default cloud-spanner-emulator-6f9fcf858b-njfhw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
default hello-world-app-5d498dc89-x62rw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 2s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 2m26s
gadget gadget-trt2m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
gcp-auth gcp-auth-78565c9fb4-fxl9z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m54s
ingress-nginx ingress-nginx-controller-6c8bf45fb-fndkb 100m (1%) 0 (0%) 90Mi (0%) 0 (0%) 4m1s
kube-system amd-gpu-device-plugin-qthwc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m22s
kube-system coredns-66bc5c9577-p4spw 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 4m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m1s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m1s
kube-system csi-hostpathplugin-mw4bs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m22s
kube-system etcd-addons-416530 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 4m10s
kube-system kindnet-9xxr6 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 4m3s
kube-system kube-apiserver-addons-416530 250m (3%) 0 (0%) 0 (0%) 0 (0%) 4m9s
kube-system kube-controller-manager-addons-416530 200m (2%) 0 (0%) 0 (0%) 0 (0%) 4m9s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
kube-system kube-proxy-srcjh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m3s
kube-system kube-scheduler-addons-416530 100m (1%) 0 (0%) 0 (0%) 0 (0%) 4m9s
kube-system metrics-server-85b7d694d7-ccqr5 100m (1%) 0 (0%) 200Mi (0%) 0 (0%) 4m2s
kube-system nvidia-device-plugin-daemonset-98gcz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m22s
kube-system registry-6b586f9694-cc4db 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
kube-system registry-creds-764b6fb674-6mwhg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
kube-system registry-proxy-l6ggw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m22s
kube-system snapshot-controller-7d9fbc56b8-cj59x 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m1s
kube-system snapshot-controller-7d9fbc56b8-t8dwd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m1s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
local-path-storage local-path-provisioner-648f6765c9-nzslx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
yakd-dashboard yakd-dashboard-5ff678cb9-jmp4w 0 (0%) 0 (0%) 128Mi (0%) 256Mi (0%) 4m1s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (13%) 100m (1%)
memory 638Mi (1%) 476Mi (1%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m2s kube-proxy
Normal NodeHasSufficientMemory 4m13s (x8 over 4m13s) kubelet Node addons-416530 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m13s (x8 over 4m13s) kubelet Node addons-416530 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m13s (x8 over 4m13s) kubelet Node addons-416530 status is now: NodeHasSufficientPID
Normal Starting 4m9s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m9s kubelet Node addons-416530 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m9s kubelet Node addons-416530 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m9s kubelet Node addons-416530 status is now: NodeHasSufficientPID
Normal RegisteredNode 4m4s node-controller Node addons-416530 event: Registered Node addons-416530 in Controller
Normal NodeReady 3m22s kubelet Node addons-416530 status is now: NodeReady
==> dmesg <==
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
[Nov22 01:58] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.019095] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000021] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023876] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023874] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023866] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023868] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000009] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +2.047813] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +4.031574] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +8.127154] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 01:59] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
==> etcd [a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80] <==
{"level":"warn","ts":"2025-11-22T01:56:37.914339Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60988","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.923076Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32780","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.930165Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32800","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.936901Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32810","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.942884Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32818","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.949293Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32860","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.954668Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32862","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.960443Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32868","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.967005Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32884","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.973219Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32910","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.980710Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32928","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.987363Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32952","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.996969Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32958","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.016126Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32988","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.021975Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32994","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.030040Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:33014","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.068562Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:33030","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:48.912022Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56368","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:48.918025Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56388","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.466232Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45462","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.472579Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45480","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.482725Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45500","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.488767Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45520","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:58:34.431624Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"123.703543ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128041479329046332 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/persistentvolumeclaims/default/hpvc\" mod_revision:1407 > success:<request_put:<key:\"/registry/persistentvolumeclaims/default/hpvc\" value_size:1366 >> failure:<request_range:<key:\"/registry/persistentvolumeclaims/default/hpvc\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T01:58:34.431763Z","caller":"traceutil/trace.go:172","msg":"trace[678641285] transaction","detail":"{read_only:false; response_revision:1408; number_of_response:1; }","duration":"199.767529ms","start":"2025-11-22T01:58:34.231974Z","end":"2025-11-22T01:58:34.431742Z","steps":["trace[678641285] 'process raft request' (duration: 75.483587ms)","trace[678641285] 'compare' (duration: 123.630427ms)"],"step_count":2}
==> gcp-auth [b5ed1d6e75f9e2034a8bca0aa4a013823a93cf3c28e39dbc065a2403266ab31c] <==
2025/11/22 01:58:01 GCP Auth Webhook started!
2025/11/22 01:58:05 Ready to marshal response ...
2025/11/22 01:58:05 Ready to write response ...
2025/11/22 01:58:06 Ready to marshal response ...
2025/11/22 01:58:06 Ready to write response ...
2025/11/22 01:58:06 Ready to marshal response ...
2025/11/22 01:58:06 Ready to write response ...
2025/11/22 01:58:21 Ready to marshal response ...
2025/11/22 01:58:21 Ready to write response ...
2025/11/22 01:58:21 Ready to marshal response ...
2025/11/22 01:58:21 Ready to write response ...
2025/11/22 01:58:23 Ready to marshal response ...
2025/11/22 01:58:23 Ready to write response ...
2025/11/22 01:58:24 Ready to marshal response ...
2025/11/22 01:58:24 Ready to write response ...
2025/11/22 01:58:29 Ready to marshal response ...
2025/11/22 01:58:29 Ready to write response ...
2025/11/22 01:58:35 Ready to marshal response ...
2025/11/22 01:58:35 Ready to write response ...
2025/11/22 01:58:50 Ready to marshal response ...
2025/11/22 01:58:50 Ready to write response ...
2025/11/22 02:00:47 Ready to marshal response ...
2025/11/22 02:00:47 Ready to write response ...
==> kernel <==
02:00:49 up 43 min, 0 user, load average: 0.89, 0.80, 0.39
Linux addons-416530 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa] <==
I1122 01:58:46.936340 1 main.go:301] handling current node
I1122 01:58:56.940078 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:58:56.940116 1 main.go:301] handling current node
I1122 01:59:06.938427 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:06.938460 1 main.go:301] handling current node
I1122 01:59:16.938384 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:16.938418 1 main.go:301] handling current node
I1122 01:59:26.941525 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:26.941560 1 main.go:301] handling current node
I1122 01:59:36.938065 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:36.938092 1 main.go:301] handling current node
I1122 01:59:46.937744 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:46.937771 1 main.go:301] handling current node
I1122 01:59:56.937565 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:59:56.937602 1 main.go:301] handling current node
I1122 02:00:06.938033 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:00:06.938067 1 main.go:301] handling current node
I1122 02:00:16.937944 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:00:16.937986 1 main.go:301] handling current node
I1122 02:00:26.937063 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:00:26.937089 1 main.go:301] handling current node
I1122 02:00:36.936382 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:00:36.936414 1 main.go:301] handling current node
I1122 02:00:46.936218 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:00:46.936255 1 main.go:301] handling current node
==> kube-apiserver [83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd] <==
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E1122 01:57:41.713021 1 remote_available_controller.go:462] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.108.1.156:443: connect: connection refused" logger="UnhandledError"
W1122 01:57:42.714409 1 handler_proxy.go:99] no RequestInfo found in the context
W1122 01:57:42.714405 1 handler_proxy.go:99] no RequestInfo found in the context
E1122 01:57:42.714466 1 controller.go:113] "Unhandled Error" err="loading OpenAPI spec for \"v1beta1.metrics.k8s.io\" failed with: Error, could not get list of group versions for APIService" logger="UnhandledError"
I1122 01:57:42.714481 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1122 01:57:42.714485 1 controller.go:102] "Unhandled Error" err=<
loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
I1122 01:57:42.715614 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W1122 01:57:46.721591 1 handler_proxy.go:99] no RequestInfo found in the context
E1122 01:57:46.721658 1 controller.go:146] "Unhandled Error" err=<
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E1122 01:57:46.721661 1 remote_available_controller.go:462] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" logger="UnhandledError"
I1122 01:57:46.730462 1 handler.go:285] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
E1122 01:58:14.328391 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:47612: use of closed network connection
E1122 01:58:14.472065 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:47630: use of closed network connection
I1122 01:58:23.513225 1 controller.go:667] quota admission added evaluator for: ingresses.networking.k8s.io
I1122 01:58:23.687733 1 alloc.go:328] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.108.170.154"}
I1122 01:58:45.341573 1 controller.go:667] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I1122 02:00:47.712133 1 alloc.go:328] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.98.89.0"}
==> kube-controller-manager [add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6] <==
I1122 01:56:45.447693 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 01:56:45.447742 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 01:56:45.447778 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 01:56:45.447799 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 01:56:45.447836 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 01:56:45.448065 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 01:56:45.448204 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 01:56:45.448962 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 01:56:45.450114 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 01:56:45.451233 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:56:45.451351 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 01:56:45.451361 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:56:45.455547 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 01:56:45.459729 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 01:56:45.465968 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
E1122 01:57:15.460717 1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
I1122 01:57:15.460858 1 resource_quota_monitor.go:227] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="volumesnapshots.snapshot.storage.k8s.io"
I1122 01:57:15.460919 1 shared_informer.go:349] "Waiting for caches to sync" controller="resource quota"
I1122 01:57:15.473275 1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
I1122 01:57:15.476382 1 shared_informer.go:349] "Waiting for caches to sync" controller="garbage collector"
I1122 01:57:15.562103 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:57:15.577270 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 01:57:30.390280 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
E1122 01:57:45.566945 1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
I1122 01:57:45.585415 1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
==> kube-proxy [d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000] <==
I1122 01:56:46.500230 1 server_linux.go:53] "Using iptables proxy"
I1122 01:56:46.583517 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 01:56:46.684657 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 01:56:46.684696 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
E1122 01:56:46.684812 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 01:56:46.704500 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 01:56:46.704565 1 server_linux.go:132] "Using iptables Proxier"
I1122 01:56:46.712282 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 01:56:46.719777 1 server.go:527] "Version info" version="v1.34.1"
I1122 01:56:46.743050 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 01:56:46.745082 1 config.go:200] "Starting service config controller"
I1122 01:56:46.745094 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 01:56:46.745116 1 config.go:106] "Starting endpoint slice config controller"
I1122 01:56:46.745126 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 01:56:46.745161 1 config.go:403] "Starting serviceCIDR config controller"
I1122 01:56:46.745166 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 01:56:46.746117 1 config.go:309] "Starting node config controller"
I1122 01:56:46.746137 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 01:56:46.746145 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 01:56:46.845900 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 01:56:46.845987 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 01:56:46.846028 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a] <==
E1122 01:56:38.453519 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 01:56:38.454278 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 01:56:38.454331 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 01:56:38.454333 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 01:56:38.454338 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 01:56:38.454340 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 01:56:38.454476 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 01:56:38.454478 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 01:56:38.454501 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 01:56:38.454542 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 01:56:38.454623 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 01:56:38.454659 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 01:56:39.273533 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 01:56:39.343562 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 01:56:39.353511 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 01:56:39.399249 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 01:56:39.404965 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 01:56:39.416862 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 01:56:39.471452 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 01:56:39.542362 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 01:56:39.544175 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 01:56:39.608370 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 01:56:39.629268 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 01:56:39.640097 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
I1122 01:56:39.951225 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.808181 1305 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc6v8\" (UniqueName: \"kubernetes.io/projected/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-kube-api-access-tc6v8\") pod \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\" (UID: \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\") "
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.808300 1305 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"task-pv-storage\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^c9cc3243-c746-11f0-bdc7-b622d5a23ca4\") pod \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\" (UID: \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\") "
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.808336 1305 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-gcp-creds\") pod \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\" (UID: \"5d702d7a-16d3-4d28-8e7c-ea6bb48146d6\") "
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.808479 1305 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6" (UID: "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.810396 1305 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-kube-api-access-tc6v8" (OuterVolumeSpecName: "kube-api-access-tc6v8") pod "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6" (UID: "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6"). InnerVolumeSpecName "kube-api-access-tc6v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.811225 1305 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/hostpath.csi.k8s.io^c9cc3243-c746-11f0-bdc7-b622d5a23ca4" (OuterVolumeSpecName: "task-pv-storage") pod "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6" (UID: "5d702d7a-16d3-4d28-8e7c-ea6bb48146d6"). InnerVolumeSpecName "pvc-37cb4ac4-07b5-46df-907e-f3254270ec0b". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.909462 1305 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc6v8\" (UniqueName: \"kubernetes.io/projected/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-kube-api-access-tc6v8\") on node \"addons-416530\" DevicePath \"\""
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.909525 1305 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-37cb4ac4-07b5-46df-907e-f3254270ec0b\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^c9cc3243-c746-11f0-bdc7-b622d5a23ca4\") on node \"addons-416530\" "
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.909544 1305 reconciler_common.go:299] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6-gcp-creds\") on node \"addons-416530\" DevicePath \"\""
Nov 22 01:58:57 addons-416530 kubelet[1305]: I1122 01:58:57.914135 1305 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-37cb4ac4-07b5-46df-907e-f3254270ec0b" (UniqueName: "kubernetes.io/csi/hostpath.csi.k8s.io^c9cc3243-c746-11f0-bdc7-b622d5a23ca4") on node "addons-416530"
Nov 22 01:58:58 addons-416530 kubelet[1305]: I1122 01:58:58.009947 1305 reconciler_common.go:299] "Volume detached for volume \"pvc-37cb4ac4-07b5-46df-907e-f3254270ec0b\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^c9cc3243-c746-11f0-bdc7-b622d5a23ca4\") on node \"addons-416530\" DevicePath \"\""
Nov 22 01:58:58 addons-416530 kubelet[1305]: I1122 01:58:58.090385 1305 scope.go:117] "RemoveContainer" containerID="71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d"
Nov 22 01:58:58 addons-416530 kubelet[1305]: I1122 01:58:58.099857 1305 scope.go:117] "RemoveContainer" containerID="71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d"
Nov 22 01:58:58 addons-416530 kubelet[1305]: E1122 01:58:58.100200 1305 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d\": container with ID starting with 71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d not found: ID does not exist" containerID="71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d"
Nov 22 01:58:58 addons-416530 kubelet[1305]: I1122 01:58:58.100238 1305 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d"} err="failed to get container status \"71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d\": rpc error: code = NotFound desc = could not find container \"71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d\": container with ID starting with 71d4d1f5dbb3862ab63f34131c81d3901ad01ee64ff7fc32b9f4dc64ef2d289d not found: ID does not exist"
Nov 22 01:58:58 addons-416530 kubelet[1305]: I1122 01:58:58.561061 1305 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d702d7a-16d3-4d28-8e7c-ea6bb48146d6" path="/var/lib/kubelet/pods/5d702d7a-16d3-4d28-8e7c-ea6bb48146d6/volumes"
Nov 22 01:59:08 addons-416530 kubelet[1305]: I1122 01:59:08.558025 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-l6ggw" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:59:20 addons-416530 kubelet[1305]: I1122 01:59:20.559476 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/amd-gpu-device-plugin-qthwc" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:59:20 addons-416530 kubelet[1305]: I1122 01:59:20.560088 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-98gcz" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:59:30 addons-416530 kubelet[1305]: E1122 01:59:30.570475 1305 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[gcr-creds], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="kube-system/registry-creds-764b6fb674-6mwhg" podUID="f7e86884-4557-4183-86db-e18a395dd7db"
Nov 22 01:59:48 addons-416530 kubelet[1305]: I1122 01:59:48.273153 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/registry-creds-764b6fb674-6mwhg" podStartSLOduration=180.157043389 podStartE2EDuration="3m1.273133611s" podCreationTimestamp="2025-11-22 01:56:47 +0000 UTC" firstStartedPulling="2025-11-22 01:59:46.580780584 +0000 UTC m=+186.104694432" lastFinishedPulling="2025-11-22 01:59:47.696870806 +0000 UTC m=+187.220784654" observedRunningTime="2025-11-22 01:59:48.271647316 +0000 UTC m=+187.795561175" watchObservedRunningTime="2025-11-22 01:59:48.273133611 +0000 UTC m=+187.797047468"
Nov 22 02:00:18 addons-416530 kubelet[1305]: I1122 02:00:18.558890 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-l6ggw" secret="" err="secret \"gcp-auth\" not found"
Nov 22 02:00:23 addons-416530 kubelet[1305]: I1122 02:00:23.558041 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-98gcz" secret="" err="secret \"gcp-auth\" not found"
Nov 22 02:00:47 addons-416530 kubelet[1305]: I1122 02:00:47.737836 1305 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/48b2b3c3-3d6a-4665-a697-cc22bba87909-gcp-creds\") pod \"hello-world-app-5d498dc89-x62rw\" (UID: \"48b2b3c3-3d6a-4665-a697-cc22bba87909\") " pod="default/hello-world-app-5d498dc89-x62rw"
Nov 22 02:00:47 addons-416530 kubelet[1305]: I1122 02:00:47.737890 1305 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8xh5\" (UniqueName: \"kubernetes.io/projected/48b2b3c3-3d6a-4665-a697-cc22bba87909-kube-api-access-k8xh5\") pod \"hello-world-app-5d498dc89-x62rw\" (UID: \"48b2b3c3-3d6a-4665-a697-cc22bba87909\") " pod="default/hello-world-app-5d498dc89-x62rw"
==> storage-provisioner [df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db] <==
W1122 02:00:24.815386 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:26.817794 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:26.821119 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:28.824422 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:28.827648 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:30.829650 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:30.833881 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:32.836274 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:32.839674 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:34.841668 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:34.844640 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:36.847005 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:36.851529 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:38.854284 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:38.857455 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:40.860430 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:40.863698 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:42.865942 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:42.869708 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:44.872107 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:44.875466 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:46.878417 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:46.882307 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:48.884682 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:00:48.887778 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-416530 -n addons-416530
helpers_test.go:269: (dbg) Run: kubectl --context addons-416530 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq
helpers_test.go:282: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context addons-416530 describe pod ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context addons-416530 describe pod ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq: exit status 1 (52.720276ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-54nh4" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-48xbq" not found
** /stderr **
helpers_test.go:287: kubectl --context addons-416530 describe pod ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq: exit status 1
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable ingress-dns --alsologtostderr -v=1: exit status 11 (231.467378ms)
-- stdout --
-- /stdout --
** stderr **
I1122 02:00:50.056523 30729 out.go:360] Setting OutFile to fd 1 ...
I1122 02:00:50.056667 30729 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:00:50.056677 30729 out.go:374] Setting ErrFile to fd 2...
I1122 02:00:50.056681 30729 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:00:50.056886 30729 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:00:50.057167 30729 mustload.go:66] Loading cluster: addons-416530
I1122 02:00:50.057512 30729 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:00:50.057529 30729 addons.go:622] checking whether the cluster is paused
I1122 02:00:50.057611 30729 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:00:50.057628 30729 host.go:66] Checking if "addons-416530" exists ...
I1122 02:00:50.058002 30729 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 02:00:50.075597 30729 ssh_runner.go:195] Run: systemctl --version
I1122 02:00:50.075641 30729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 02:00:50.090586 30729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 02:00:50.181673 30729 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:00:50.181756 30729 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:00:50.209268 30729 cri.go:89] found id: "62c3f43720ac24969153a69236cf0d2d9d03d9160e50e94fec31f7593d482d7f"
I1122 02:00:50.209285 30729 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 02:00:50.209289 30729 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 02:00:50.209292 30729 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 02:00:50.209295 30729 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 02:00:50.209298 30729 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 02:00:50.209300 30729 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 02:00:50.209303 30729 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 02:00:50.209305 30729 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 02:00:50.209310 30729 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 02:00:50.209313 30729 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 02:00:50.209317 30729 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 02:00:50.209321 30729 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 02:00:50.209325 30729 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 02:00:50.209329 30729 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 02:00:50.209334 30729 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 02:00:50.209339 30729 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 02:00:50.209344 30729 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 02:00:50.209349 30729 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 02:00:50.209353 30729 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 02:00:50.209363 30729 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 02:00:50.209369 30729 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 02:00:50.209371 30729 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 02:00:50.209374 30729 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 02:00:50.209377 30729 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 02:00:50.209379 30729 cri.go:89] found id: ""
I1122 02:00:50.209412 30729 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:00:50.223851 30729 out.go:203]
W1122 02:00:50.225145 30729 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:00:50Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:00:50Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:00:50.225164 30729 out.go:285] *
*
W1122 02:00:50.229002 30729 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_4116e8848b7c0e6a40fa9061a5ca6da2e0eb6ead_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_4116e8848b7c0e6a40fa9061a5ca6da2e0eb6ead_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:00:50.230133 30729 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable ingress-dns addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable ingress-dns --alsologtostderr -v=1": exit status 11
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable ingress --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable ingress --alsologtostderr -v=1: exit status 11 (226.972784ms)
-- stdout --
-- /stdout --
** stderr **
I1122 02:00:50.286814 30790 out.go:360] Setting OutFile to fd 1 ...
I1122 02:00:50.286978 30790 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:00:50.286989 30790 out.go:374] Setting ErrFile to fd 2...
I1122 02:00:50.286995 30790 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:00:50.287185 30790 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:00:50.287441 30790 mustload.go:66] Loading cluster: addons-416530
I1122 02:00:50.287788 30790 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:00:50.287810 30790 addons.go:622] checking whether the cluster is paused
I1122 02:00:50.287952 30790 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:00:50.287974 30790 host.go:66] Checking if "addons-416530" exists ...
I1122 02:00:50.288360 30790 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 02:00:50.305370 30790 ssh_runner.go:195] Run: systemctl --version
I1122 02:00:50.305428 30790 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 02:00:50.321344 30790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 02:00:50.412679 30790 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:00:50.412764 30790 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:00:50.439614 30790 cri.go:89] found id: "62c3f43720ac24969153a69236cf0d2d9d03d9160e50e94fec31f7593d482d7f"
I1122 02:00:50.439655 30790 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 02:00:50.439659 30790 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 02:00:50.439674 30790 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 02:00:50.439677 30790 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 02:00:50.439680 30790 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 02:00:50.439682 30790 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 02:00:50.439685 30790 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 02:00:50.439687 30790 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 02:00:50.439692 30790 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 02:00:50.439695 30790 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 02:00:50.439698 30790 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 02:00:50.439700 30790 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 02:00:50.439703 30790 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 02:00:50.439707 30790 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 02:00:50.439718 30790 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 02:00:50.439727 30790 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 02:00:50.439732 30790 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 02:00:50.439736 30790 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 02:00:50.439740 30790 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 02:00:50.439747 30790 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 02:00:50.439754 30790 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 02:00:50.439757 30790 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 02:00:50.439759 30790 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 02:00:50.439762 30790 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 02:00:50.439764 30790 cri.go:89] found id: ""
I1122 02:00:50.439797 30790 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:00:50.452557 30790 out.go:203]
W1122 02:00:50.453584 30790 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:00:50Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:00:50Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:00:50.453599 30790 out.go:285] *
*
W1122 02:00:50.456627 30790 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_62553deefc570c97f2052ef703df7b8905a654d6_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_62553deefc570c97f2052ef703df7b8905a654d6_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:00:50.457655 30790 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable ingress addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable ingress --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/Ingress (147.18s)
=== RUN TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget
=== CONT TestAddons/parallel/InspektorGadget
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:352: "gadget-trt2m" [68279218-08e6-4aea-a25b-d9e331f5a35a] Running
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.002798505s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable inspektor-gadget --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable inspektor-gadget --alsologtostderr -v=1: exit status 11 (228.921537ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:31.304728 27351 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:31.305038 27351 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:31.305048 27351 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:31.305053 27351 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:31.305245 27351 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:31.305469 27351 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:31.305774 27351 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:31.305788 27351 addons.go:622] checking whether the cluster is paused
I1122 01:58:31.305867 27351 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:31.305881 27351 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:31.306216 27351 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:31.323529 27351 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:31.323581 27351 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:31.340134 27351 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:31.432481 27351 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:31.432561 27351 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:31.459050 27351 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:31.459066 27351 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:31.459070 27351 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:31.459073 27351 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:31.459076 27351 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:31.459079 27351 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:31.459081 27351 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:31.459086 27351 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:31.459088 27351 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:31.459093 27351 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:31.459096 27351 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:31.459100 27351 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:31.459105 27351 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:31.459110 27351 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:31.459115 27351 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:31.459122 27351 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:31.459130 27351 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:31.459137 27351 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:31.459142 27351 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:31.459144 27351 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:31.459147 27351 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:31.459149 27351 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:31.459152 27351 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:31.459154 27351 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:31.459156 27351 cri.go:89] found id: ""
I1122 01:58:31.459189 27351 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:31.472091 27351 out.go:203]
W1122 01:58:31.473193 27351 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:31Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:31Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:31.473231 27351 out.go:285] *
*
W1122 01:58:31.476218 27351 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_07218961934993dd21acc63caaf1aa08873c018e_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_07218961934993dd21acc63caaf1aa08873c018e_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:31.477279 27351 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable inspektor-gadget addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable inspektor-gadget --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/InspektorGadget (5.23s)
=== RUN TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:455: metrics-server stabilized in 3.303758ms
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:352: "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Running
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.002678367s
addons_test.go:463: (dbg) Run: kubectl --context addons-416530 top pods -n kube-system
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable metrics-server --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable metrics-server --alsologtostderr -v=1: exit status 11 (230.104389ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:19.817052 25535 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:19.817219 25535 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:19.817229 25535 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:19.817233 25535 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:19.817428 25535 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:19.817653 25535 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:19.817979 25535 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:19.817996 25535 addons.go:622] checking whether the cluster is paused
I1122 01:58:19.818075 25535 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:19.818090 25535 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:19.818459 25535 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:19.835272 25535 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:19.835329 25535 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:19.851785 25535 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:19.943018 25535 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:19.943115 25535 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:19.971473 25535 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:19.971537 25535 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:19.971544 25535 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:19.971547 25535 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:19.971550 25535 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:19.971559 25535 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:19.971565 25535 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:19.971568 25535 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:19.971570 25535 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:19.971577 25535 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:19.971583 25535 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:19.971585 25535 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:19.971588 25535 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:19.971591 25535 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:19.971593 25535 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:19.971599 25535 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:19.971604 25535 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:19.971608 25535 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:19.971611 25535 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:19.971613 25535 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:19.971618 25535 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:19.971621 25535 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:19.971623 25535 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:19.971625 25535 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:19.971627 25535 cri.go:89] found id: ""
I1122 01:58:19.971667 25535 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:19.984833 25535 out.go:203]
W1122 01:58:19.985899 25535 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:19Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:19Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:19.985943 25535 out.go:285] *
*
W1122 01:58:19.988882 25535 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_9e377edc2b59264359e9c26f81b048e390fa608a_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_9e377edc2b59264359e9c26f81b048e390fa608a_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:19.989978 25535 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable metrics-server addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable metrics-server --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/MetricsServer (5.29s)
=== RUN TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI
=== CONT TestAddons/parallel/CSI
I1122 01:58:29.994664 15072 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1122 01:58:29.998173 15072 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1122 01:58:29.998205 15072 kapi.go:107] duration metric: took 3.57024ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:549: csi-hostpath-driver pods stabilized in 3.583182ms
addons_test.go:552: (dbg) Run: kubectl --context addons-416530 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:557: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:562: (dbg) Run: kubectl --context addons-416530 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:567: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:352: "task-pv-pod" [91322ea1-a346-4560-a07c-924bc7b6f847] Pending
helpers_test.go:352: "task-pv-pod" [91322ea1-a346-4560-a07c-924bc7b6f847] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod" [91322ea1-a346-4560-a07c-924bc7b6f847] Running
addons_test.go:567: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 10.00323719s
addons_test.go:572: (dbg) Run: kubectl --context addons-416530 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:577: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:427: (dbg) Run: kubectl --context addons-416530 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:427: (dbg) Run: kubectl --context addons-416530 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:582: (dbg) Run: kubectl --context addons-416530 delete pod task-pv-pod
addons_test.go:588: (dbg) Run: kubectl --context addons-416530 delete pvc hpvc
addons_test.go:594: (dbg) Run: kubectl --context addons-416530 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:599: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:604: (dbg) Run: kubectl --context addons-416530 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:609: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:352: "task-pv-pod-restore" [5d702d7a-16d3-4d28-8e7c-ea6bb48146d6] Pending
helpers_test.go:352: "task-pv-pod-restore" [5d702d7a-16d3-4d28-8e7c-ea6bb48146d6] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod-restore" [5d702d7a-16d3-4d28-8e7c-ea6bb48146d6] Running
addons_test.go:609: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.003028346s
addons_test.go:614: (dbg) Run: kubectl --context addons-416530 delete pod task-pv-pod-restore
addons_test.go:618: (dbg) Run: kubectl --context addons-416530 delete pvc hpvc-restore
addons_test.go:622: (dbg) Run: kubectl --context addons-416530 delete volumesnapshot new-snapshot-demo
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable volumesnapshots --alsologtostderr -v=1: exit status 11 (229.515123ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:58.475384 28449 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:58.475661 28449 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:58.475672 28449 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:58.475676 28449 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:58.475858 28449 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:58.476142 28449 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:58.476466 28449 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:58.476480 28449 addons.go:622] checking whether the cluster is paused
I1122 01:58:58.476565 28449 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:58.476583 28449 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:58.476925 28449 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:58.494780 28449 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:58.494824 28449 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:58.510862 28449 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:58.602820 28449 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:58.602944 28449 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:58.630316 28449 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:58.630342 28449 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:58.630347 28449 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:58.630351 28449 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:58.630355 28449 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:58.630360 28449 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:58.630365 28449 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:58.630368 28449 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:58.630372 28449 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:58.630385 28449 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:58.630389 28449 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:58.630393 28449 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:58.630398 28449 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:58.630403 28449 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:58.630408 28449 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:58.630420 28449 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:58.630428 28449 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:58.630434 28449 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:58.630437 28449 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:58.630440 28449 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:58.630443 28449 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:58.630446 28449 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:58.630450 28449 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:58.630453 28449 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:58.630457 28449 cri.go:89] found id: ""
I1122 01:58:58.630506 28449 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:58.643145 28449 out.go:203]
W1122 01:58:58.644206 28449 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:58Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:58Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:58.644220 28449 out.go:285] *
*
W1122 01:58:58.647209 28449 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_f6150db7515caf82d8c4c5baeba9fd21f738a7e0_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_f6150db7515caf82d8c4c5baeba9fd21f738a7e0_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:58.648270 28449 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable volumesnapshots addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable volumesnapshots --alsologtostderr -v=1": exit status 11
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable csi-hostpath-driver --alsologtostderr -v=1: exit status 11 (229.664044ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:58.706967 28511 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:58.707240 28511 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:58.707249 28511 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:58.707253 28511 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:58.707456 28511 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:58.707727 28511 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:58.708100 28511 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:58.708118 28511 addons.go:622] checking whether the cluster is paused
I1122 01:58:58.708215 28511 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:58.708236 28511 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:58.708642 28511 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:58.725641 28511 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:58.725696 28511 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:58.741639 28511 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:58.832760 28511 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:58.832846 28511 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:58.859728 28511 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:58.859757 28511 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:58.859761 28511 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:58.859764 28511 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:58.859767 28511 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:58.859771 28511 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:58.859774 28511 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:58.859776 28511 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:58.859778 28511 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:58.859796 28511 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:58.859801 28511 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:58.859803 28511 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:58.859806 28511 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:58.859808 28511 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:58.859811 28511 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:58.859817 28511 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:58.859822 28511 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:58.859826 28511 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:58.859829 28511 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:58.859831 28511 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:58.859834 28511 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:58.859837 28511 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:58.859839 28511 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:58.859842 28511 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:58.859844 28511 cri.go:89] found id: ""
I1122 01:58:58.859884 28511 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:58.872732 28511 out.go:203]
W1122 01:58:58.873820 28511 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:58Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:58Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:58.873843 28511 out.go:285] *
*
W1122 01:58:58.876821 28511 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_913eef9b964ccef8b5b536327192b81f4aff5da9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_913eef9b964ccef8b5b536327192b81f4aff5da9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:58.877861 28511 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable csi-hostpath-driver addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable csi-hostpath-driver --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/CSI (28.89s)
=== RUN TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
addons_test.go:808: (dbg) Run: out/minikube-linux-amd64 addons enable headlamp -p addons-416530 --alsologtostderr -v=1
addons_test.go:808: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable headlamp -p addons-416530 --alsologtostderr -v=1: exit status 11 (227.17836ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:14.756811 24696 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:14.757106 24696 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:14.757116 24696 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:14.757121 24696 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:14.757313 24696 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:14.757545 24696 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:14.757859 24696 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:14.757874 24696 addons.go:622] checking whether the cluster is paused
I1122 01:58:14.757971 24696 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:14.757986 24696 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:14.758332 24696 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:14.775036 24696 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:14.775091 24696 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:14.790335 24696 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:14.881585 24696 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:14.881637 24696 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:14.908105 24696 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:14.908135 24696 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:14.908139 24696 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:14.908142 24696 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:14.908145 24696 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:14.908149 24696 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:14.908151 24696 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:14.908154 24696 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:14.908156 24696 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:14.908168 24696 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:14.908171 24696 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:14.908173 24696 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:14.908176 24696 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:14.908179 24696 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:14.908181 24696 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:14.908187 24696 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:14.908193 24696 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:14.908197 24696 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:14.908199 24696 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:14.908202 24696 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:14.908204 24696 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:14.908207 24696 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:14.908209 24696 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:14.908212 24696 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:14.908214 24696 cri.go:89] found id: ""
I1122 01:58:14.908254 24696 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:14.921188 24696 out.go:203]
W1122 01:58:14.922436 24696 out.go:285] X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:14Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:14Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:14.922456 24696 out.go:285] *
*
W1122 01:58:14.925365 24696 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:14.926371 24696 out.go:203]
** /stderr **
addons_test.go:810: failed to enable headlamp addon: args: "out/minikube-linux-amd64 addons enable headlamp -p addons-416530 --alsologtostderr -v=1": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestAddons/parallel/Headlamp]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestAddons/parallel/Headlamp]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect addons-416530
helpers_test.go:243: (dbg) docker inspect addons-416530:
-- stdout --
[
{
"Id": "e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f",
"Created": "2025-11-22T01:56:27.584287741Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 17077,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T01:56:27.613817941Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/hostname",
"HostsPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/hosts",
"LogPath": "/var/lib/docker/containers/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f/e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f-json.log",
"Name": "/addons-416530",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-416530:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-416530",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4294967296,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8589934592,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "e7bf60a2902b3b0d46b08554832926227073391e3ed5413e1752d392446ec47f",
"LowerDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/merged",
"UpperDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/diff",
"WorkDir": "/var/lib/docker/overlay2/3c0f1a102918b3b653018b446daf2325f2667bc9895e23835ded64cf723bf64c/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-416530",
"Source": "/var/lib/docker/volumes/addons-416530/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-416530",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-416530",
"name.minikube.sigs.k8s.io": "addons-416530",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "a84a1139fdf9f1c5f6614dff8a5730de3be10ff02ab6e2ce0893ba9deff6ec84",
"SandboxKey": "/var/run/docker/netns/a84a1139fdf9",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"Networks": {
"addons-416530": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "0f97d816d659b52225bff66dff129151eee14e3e59b4f6fb58d41ac4cda7d6d1",
"EndpointID": "81a28cd7edbe706c48d0a8829ad258e82d8a87068e6625b300c933d704f9847e",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"MacAddress": "4e:f4:79:70:fd:ed",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-416530",
"e7bf60a2902b"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-416530 -n addons-416530
helpers_test.go:252: <<< TestAddons/parallel/Headlamp FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestAddons/parallel/Headlamp]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p addons-416530 logs -n 25: (1.031833589s)
helpers_test.go:260: TestAddons/parallel/Headlamp logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ -o=json --download-only -p download-only-370119 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker --container-runtime=crio │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ │
│ delete │ --all │ minikube │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ 22 Nov 25 01:55 UTC │
│ delete │ -p download-only-370119 │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ 22 Nov 25 01:55 UTC │
│ start │ -o=json --download-only -p download-only-425432 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=crio --driver=docker --container-runtime=crio │ download-only-425432 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ │
│ delete │ --all │ minikube │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ delete │ -p download-only-425432 │ download-only-425432 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ delete │ -p download-only-370119 │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ delete │ -p download-only-425432 │ download-only-425432 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ start │ --download-only -p download-docker-727919 --alsologtostderr --driver=docker --container-runtime=crio │ download-docker-727919 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ delete │ -p download-docker-727919 │ download-docker-727919 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ start │ --download-only -p binary-mirror-401760 --alsologtostderr --binary-mirror http://127.0.0.1:33657 --driver=docker --container-runtime=crio │ binary-mirror-401760 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ delete │ -p binary-mirror-401760 │ binary-mirror-401760 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:56 UTC │
│ addons │ disable dashboard -p addons-416530 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ addons │ enable dashboard -p addons-416530 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ │
│ start │ -p addons-416530 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:56 UTC │ 22 Nov 25 01:58 UTC │
│ addons │ addons-416530 addons disable volcano --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ addons-416530 addons disable gcp-auth --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
│ addons │ enable headlamp -p addons-416530 --alsologtostderr -v=1 │ addons-416530 │ jenkins │ v1.37.0 │ 22 Nov 25 01:58 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 01:56:03
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 01:56:03.882452 16415 out.go:360] Setting OutFile to fd 1 ...
I1122 01:56:03.882683 16415 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:56:03.882692 16415 out.go:374] Setting ErrFile to fd 2...
I1122 01:56:03.882696 16415 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:56:03.882865 16415 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:56:03.883342 16415 out.go:368] Setting JSON to false
I1122 01:56:03.884100 16415 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2307,"bootTime":1763774257,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 01:56:03.884181 16415 start.go:143] virtualization: kvm guest
I1122 01:56:03.885951 16415 out.go:179] * [addons-416530] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 01:56:03.887240 16415 out.go:179] - MINIKUBE_LOCATION=21946
I1122 01:56:03.887236 16415 notify.go:221] Checking for updates...
I1122 01:56:03.889469 16415 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 01:56:03.890862 16415 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:56:03.891868 16415 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 01:56:03.892823 16415 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 01:56:03.893812 16415 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 01:56:03.894949 16415 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 01:56:03.916881 16415 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 01:56:03.916976 16415 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:56:03.972325 16415 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-11-22 01:56:03.96278976 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:56:03.972422 16415 docker.go:319] overlay module found
I1122 01:56:03.973947 16415 out.go:179] * Using the docker driver based on user configuration
I1122 01:56:03.974898 16415 start.go:309] selected driver: docker
I1122 01:56:03.974940 16415 start.go:927] validating driver "docker" against <nil>
I1122 01:56:03.974953 16415 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 01:56:03.975501 16415 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:56:04.032953 16415 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-11-22 01:56:04.024162176 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:56:04.033113 16415 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 01:56:04.033291 16415 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 01:56:04.034781 16415 out.go:179] * Using Docker driver with root privileges
I1122 01:56:04.035827 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:04.035878 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:04.035888 16415 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 01:56:04.035996 16415 start.go:353] cluster config:
{Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:
AutoPauseInterval:1m0s}
I1122 01:56:04.037039 16415 out.go:179] * Starting "addons-416530" primary control-plane node in "addons-416530" cluster
I1122 01:56:04.037933 16415 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 01:56:04.038943 16415 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 01:56:04.039767 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:04.039791 16415 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 01:56:04.039800 16415 cache.go:65] Caching tarball of preloaded images
I1122 01:56:04.039850 16415 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 01:56:04.039915 16415 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 01:56:04.039925 16415 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 01:56:04.040246 16415 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json ...
I1122 01:56:04.040267 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json: {Name:mkfe3435fd16d3af05650c6f93d4e6d9acdbe613 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:04.055074 16415 cache.go:163] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a to local cache
I1122 01:56:04.055185 16415 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local cache directory
I1122 01:56:04.055204 16415 image.go:68] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local cache directory, skipping pull
I1122 01:56:04.055210 16415 image.go:137] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in cache, skipping pull
I1122 01:56:04.055223 16415 cache.go:166] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a as a tarball
I1122 01:56:04.055234 16415 cache.go:176] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a from local cache
I1122 01:56:15.894707 16415 cache.go:178] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a from cached tarball
I1122 01:56:15.894748 16415 cache.go:243] Successfully downloaded all kic artifacts
I1122 01:56:15.894800 16415 start.go:360] acquireMachinesLock for addons-416530: {Name:mk5d8c50816691bb3aeb15cb1d764825c28c289f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 01:56:15.894893 16415 start.go:364] duration metric: took 72.476µs to acquireMachinesLock for "addons-416530"
I1122 01:56:15.894936 16415 start.go:93] Provisioning new machine with config: &{Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath:
SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 01:56:15.895022 16415 start.go:125] createHost starting for "" (driver="docker")
I1122 01:56:15.896595 16415 out.go:252] * Creating docker container (CPUs=2, Memory=4096MB) ...
I1122 01:56:15.896828 16415 start.go:159] libmachine.API.Create for "addons-416530" (driver="docker")
I1122 01:56:15.896859 16415 client.go:173] LocalClient.Create starting
I1122 01:56:15.896994 16415 main.go:143] libmachine: Creating CA: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 01:56:16.482821 16415 main.go:143] libmachine: Creating client certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 01:56:16.761824 16415 cli_runner.go:164] Run: docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 01:56:16.779303 16415 cli_runner.go:211] docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 01:56:16.779370 16415 network_create.go:284] running [docker network inspect addons-416530] to gather additional debugging logs...
I1122 01:56:16.779402 16415 cli_runner.go:164] Run: docker network inspect addons-416530
W1122 01:56:16.794481 16415 cli_runner.go:211] docker network inspect addons-416530 returned with exit code 1
I1122 01:56:16.794505 16415 network_create.go:287] error running [docker network inspect addons-416530]: docker network inspect addons-416530: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-416530 not found
I1122 01:56:16.794515 16415 network_create.go:289] output of [docker network inspect addons-416530]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-416530 not found
** /stderr **
I1122 01:56:16.794617 16415 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 01:56:16.810351 16415 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00166aa70}
I1122 01:56:16.810393 16415 network_create.go:124] attempt to create docker network addons-416530 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1122 01:56:16.810429 16415 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-416530 addons-416530
I1122 01:56:16.853453 16415 network_create.go:108] docker network addons-416530 192.168.49.0/24 created
I1122 01:56:16.853480 16415 kic.go:121] calculated static IP "192.168.49.2" for the "addons-416530" container
I1122 01:56:16.853550 16415 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 01:56:16.868458 16415 cli_runner.go:164] Run: docker volume create addons-416530 --label name.minikube.sigs.k8s.io=addons-416530 --label created_by.minikube.sigs.k8s.io=true
I1122 01:56:16.884901 16415 oci.go:103] Successfully created a docker volume addons-416530
I1122 01:56:16.884987 16415 cli_runner.go:164] Run: docker run --rm --name addons-416530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --entrypoint /usr/bin/test -v addons-416530:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 01:56:23.286663 16415 cli_runner.go:217] Completed: docker run --rm --name addons-416530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --entrypoint /usr/bin/test -v addons-416530:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib: (6.401626965s)
I1122 01:56:23.286694 16415 oci.go:107] Successfully prepared a docker volume addons-416530
I1122 01:56:23.286733 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:23.286766 16415 kic.go:194] Starting extracting preloaded images to volume ...
I1122 01:56:23.286829 16415 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-416530:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 01:56:27.514471 16415 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-416530:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.227602248s)
I1122 01:56:27.514504 16415 kic.go:203] duration metric: took 4.227751662s to extract preloaded images to volume ...
W1122 01:56:27.514602 16415 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 01:56:27.514646 16415 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 01:56:27.514716 16415 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 01:56:27.569852 16415 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-416530 --name addons-416530 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-416530 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-416530 --network addons-416530 --ip 192.168.49.2 --volume addons-416530:/var --security-opt apparmor=unconfined --memory=4096mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
I1122 01:56:27.862531 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Running}}
I1122 01:56:27.883206 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:27.901597 16415 cli_runner.go:164] Run: docker exec addons-416530 stat /var/lib/dpkg/alternatives/iptables
I1122 01:56:27.948414 16415 oci.go:144] the created container "addons-416530" has a running status.
I1122 01:56:27.948446 16415 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa...
I1122 01:56:28.116402 16415 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 01:56:28.147180 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:28.166602 16415 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 01:56:28.166633 16415 kic_runner.go:114] Args: [docker exec --privileged addons-416530 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 01:56:28.223128 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:28.243182 16415 machine.go:94] provisionDockerMachine start ...
I1122 01:56:28.243318 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.262485 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.262735 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.262751 16415 main.go:143] libmachine: About to run SSH command:
hostname
I1122 01:56:28.389051 16415 main.go:143] libmachine: SSH cmd err, output: <nil>: addons-416530
I1122 01:56:28.389074 16415 ubuntu.go:182] provisioning hostname "addons-416530"
I1122 01:56:28.389131 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.406812 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.407066 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.407084 16415 main.go:143] libmachine: About to run SSH command:
sudo hostname addons-416530 && echo "addons-416530" | sudo tee /etc/hostname
I1122 01:56:28.542547 16415 main.go:143] libmachine: SSH cmd err, output: <nil>: addons-416530
I1122 01:56:28.542620 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.559221 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:28.559426 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:28.559443 16415 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-416530' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-416530/g' /etc/hosts;
else
echo '127.0.1.1 addons-416530' | sudo tee -a /etc/hosts;
fi
fi
I1122 01:56:28.684438 16415 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 01:56:28.684461 16415 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 01:56:28.684491 16415 ubuntu.go:190] setting up certificates
I1122 01:56:28.684505 16415 provision.go:84] configureAuth start
I1122 01:56:28.684559 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:28.700631 16415 provision.go:143] copyHostCerts
I1122 01:56:28.700693 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 01:56:28.700797 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 01:56:28.700856 16415 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 01:56:28.700920 16415 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.addons-416530 san=[127.0.0.1 192.168.49.2 addons-416530 localhost minikube]
I1122 01:56:28.849018 16415 provision.go:177] copyRemoteCerts
I1122 01:56:28.849062 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 01:56:28.849091 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:28.865009 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:28.957612 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1122 01:56:28.974952 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 01:56:28.990566 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 01:56:29.005623 16415 provision.go:87] duration metric: took 321.108461ms to configureAuth
I1122 01:56:29.005642 16415 ubuntu.go:206] setting minikube options for container-runtime
I1122 01:56:29.005780 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:29.005867 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.022319 16415 main.go:143] libmachine: Using SSH client type: native
I1122 01:56:29.022501 16415 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I1122 01:56:29.022517 16415 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 01:56:29.274460 16415 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 01:56:29.274487 16415 machine.go:97] duration metric: took 1.031283196s to provisionDockerMachine
I1122 01:56:29.274499 16415 client.go:176] duration metric: took 13.377633461s to LocalClient.Create
I1122 01:56:29.274523 16415 start.go:167] duration metric: took 13.377696309s to libmachine.API.Create "addons-416530"
I1122 01:56:29.274533 16415 start.go:293] postStartSetup for "addons-416530" (driver="docker")
I1122 01:56:29.274547 16415 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 01:56:29.274596 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 01:56:29.274635 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.291192 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.384228 16415 ssh_runner.go:195] Run: cat /etc/os-release
I1122 01:56:29.387289 16415 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 01:56:29.387313 16415 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 01:56:29.387322 16415 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 01:56:29.387377 16415 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 01:56:29.387407 16415 start.go:296] duration metric: took 112.867009ms for postStartSetup
I1122 01:56:29.387747 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:29.403546 16415 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/config.json ...
I1122 01:56:29.403752 16415 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 01:56:29.403786 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.420244 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.509028 16415 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 01:56:29.512916 16415 start.go:128] duration metric: took 13.617868174s to createHost
I1122 01:56:29.512944 16415 start.go:83] releasing machines lock for "addons-416530", held for 13.61803963s
I1122 01:56:29.512994 16415 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-416530
I1122 01:56:29.529872 16415 ssh_runner.go:195] Run: cat /version.json
I1122 01:56:29.529944 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.529947 16415 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 01:56:29.530001 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:29.545555 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.547195 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:29.695628 16415 ssh_runner.go:195] Run: systemctl --version
I1122 01:56:29.701248 16415 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 01:56:29.733319 16415 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 01:56:29.737451 16415 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 01:56:29.737517 16415 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 01:56:29.760489 16415 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 01:56:29.760510 16415 start.go:496] detecting cgroup driver to use...
I1122 01:56:29.760543 16415 detect.go:190] detected "systemd" cgroup driver on host os
I1122 01:56:29.760580 16415 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 01:56:29.774596 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 01:56:29.785310 16415 docker.go:218] disabling cri-docker service (if available) ...
I1122 01:56:29.785359 16415 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 01:56:29.799660 16415 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 01:56:29.814899 16415 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 01:56:29.891742 16415 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 01:56:29.972359 16415 docker.go:234] disabling docker service ...
I1122 01:56:29.972436 16415 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 01:56:29.988755 16415 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 01:56:29.999604 16415 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 01:56:30.081383 16415 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 01:56:30.156244 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 01:56:30.166759 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 01:56:30.179053 16415 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 01:56:30.179096 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.188112 16415 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 01:56:30.188160 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.195836 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.203406 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.210884 16415 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 01:56:30.217843 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.225333 16415 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.237087 16415 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 01:56:30.244558 16415 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 01:56:30.251023 16415 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1122 01:56:30.251067 16415 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1122 01:56:30.261593 16415 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 01:56:30.268527 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:30.343514 16415 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 01:56:30.466814 16415 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 01:56:30.466898 16415 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 01:56:30.470559 16415 start.go:564] Will wait 60s for crictl version
I1122 01:56:30.470602 16415 ssh_runner.go:195] Run: which crictl
I1122 01:56:30.473762 16415 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 01:56:30.495791 16415 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 01:56:30.495887 16415 ssh_runner.go:195] Run: crio --version
I1122 01:56:30.520301 16415 ssh_runner.go:195] Run: crio --version
I1122 01:56:30.546199 16415 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 01:56:30.547288 16415 cli_runner.go:164] Run: docker network inspect addons-416530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 01:56:30.563578 16415 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I1122 01:56:30.567110 16415 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 01:56:30.576386 16415 kubeadm.go:884] updating cluster {Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketV
MnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 01:56:30.576504 16415 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:30.576560 16415 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 01:56:30.605157 16415 crio.go:514] all images are preloaded for cri-o runtime.
I1122 01:56:30.605178 16415 crio.go:433] Images already preloaded, skipping extraction
I1122 01:56:30.605220 16415 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 01:56:30.627804 16415 crio.go:514] all images are preloaded for cri-o runtime.
I1122 01:56:30.627823 16415 cache_images.go:86] Images are preloaded, skipping loading
I1122 01:56:30.627830 16415 kubeadm.go:935] updating node { 192.168.49.2 8443 v1.34.1 crio true true} ...
I1122 01:56:30.627935 16415 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-416530 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 01:56:30.627997 16415 ssh_runner.go:195] Run: crio config
I1122 01:56:30.668708 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:30.668735 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:30.668755 16415 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 01:56:30.668791 16415 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-416530 NodeName:addons-416530 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernet
es/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 01:56:30.668977 16415 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-416530"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.49.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 01:56:30.669050 16415 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 01:56:30.676291 16415 binaries.go:51] Found k8s binaries, skipping transfer
I1122 01:56:30.676334 16415 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 01:56:30.683050 16415 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
I1122 01:56:30.693970 16415 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 01:56:30.707129 16415 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2209 bytes)
I1122 01:56:30.717989 16415 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I1122 01:56:30.721059 16415 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 01:56:30.729548 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:30.804178 16415 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 01:56:30.827635 16415 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530 for IP: 192.168.49.2
I1122 01:56:30.827656 16415 certs.go:195] generating shared ca certs ...
I1122 01:56:30.827675 16415 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:30.827808 16415 certs.go:241] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 01:56:31.322089 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt ...
I1122 01:56:31.322116 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt: {Name:mkee2cce2c0bb57574527a8fcce15f8a2721c548 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.322274 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key ...
I1122 01:56:31.322284 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key: {Name:mk4a850944466b014e1287e08b680a4883f1d754 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.322360 16415 certs.go:241] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 01:56:31.607868 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt ...
I1122 01:56:31.607894 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt: {Name:mk03d73d5ae26491d26dddbae2e6a363070d3d00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.608056 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key ...
I1122 01:56:31.608068 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key: {Name:mk84febd4550efaafa59bcfd5eeb57edb2040be3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.608139 16415 certs.go:257] generating profile certs ...
I1122 01:56:31.608192 16415 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key
I1122 01:56:31.608207 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt with IP's: []
I1122 01:56:31.752866 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt ...
I1122 01:56:31.752892 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: {Name:mk3bbd92f837e80949fcde7e67e392df7a74ae7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.753046 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key ...
I1122 01:56:31.753058 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.key: {Name:mkc363d12973c9b3dd5e892606e81b0c8d114ba3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:31.753134 16415 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e
I1122 01:56:31.753152 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I1122 01:56:32.087412 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e ...
I1122 01:56:32.087441 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e: {Name:mkfe41cbb8f30330202e5e9679908e6205369ddc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.087605 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e ...
I1122 01:56:32.087618 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e: {Name:mkb572021a8958432aa9e00f76c8966a9c807df2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.087692 16415 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt.79ea076e -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt
I1122 01:56:32.087784 16415 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key.79ea076e -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key
I1122 01:56:32.087839 16415 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key
I1122 01:56:32.087857 16415 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt with IP's: []
I1122 01:56:32.314580 16415 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt ...
I1122 01:56:32.314609 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt: {Name:mka618c3db053226289e75dc89fd94df0c009519 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.314774 16415 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key ...
I1122 01:56:32.314785 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key: {Name:mk7f088f6437aec0482c9e27f204c313d8855d8b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:32.314969 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 01:56:32.315002 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 01:56:32.315025 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 01:56:32.315053 16415 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 01:56:32.315660 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 01:56:32.332250 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 01:56:32.347860 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 01:56:32.363273 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 01:56:32.378678 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I1122 01:56:32.393836 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 01:56:32.409272 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 01:56:32.424508 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 01:56:32.440154 16415 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 01:56:32.458227 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 01:56:32.469465 16415 ssh_runner.go:195] Run: openssl version
I1122 01:56:32.475004 16415 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 01:56:32.484765 16415 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.487988 16415 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.488046 16415 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 01:56:32.521476 16415 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 01:56:32.528722 16415 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 01:56:32.531690 16415 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 01:56:32.531745 16415 kubeadm.go:401] StartCluster: {Name:addons-416530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:addons-416530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 01:56:32.531814 16415 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:56:32.531869 16415 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:56:32.555365 16415 cri.go:89] found id: ""
I1122 01:56:32.555427 16415 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 01:56:32.562283 16415 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 01:56:32.569143 16415 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 01:56:32.569188 16415 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 01:56:32.575991 16415 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 01:56:32.576003 16415 kubeadm.go:158] found existing configuration files:
I1122 01:56:32.576029 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1122 01:56:32.582816 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 01:56:32.582852 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 01:56:32.589127 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1122 01:56:32.595675 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 01:56:32.595745 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 01:56:32.602036 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1122 01:56:32.608473 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 01:56:32.608512 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 01:56:32.614959 16415 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1122 01:56:32.621402 16415 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 01:56:32.621436 16415 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 01:56:32.627677 16415 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 01:56:32.679559 16415 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 01:56:32.730076 16415 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 01:56:41.338720 16415 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 01:56:41.338768 16415 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 01:56:41.338859 16415 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 01:56:41.338960 16415 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 01:56:41.339031 16415 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 01:56:41.339106 16415 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 01:56:41.339191 16415 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 01:56:41.339278 16415 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 01:56:41.339355 16415 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 01:56:41.339428 16415 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 01:56:41.339499 16415 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 01:56:41.339579 16415 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 01:56:41.339659 16415 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 01:56:41.339755 16415 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 01:56:41.339874 16415 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 01:56:41.339981 16415 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 01:56:41.340035 16415 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 01:56:41.341346 16415 out.go:252] - Generating certificates and keys ...
I1122 01:56:41.341408 16415 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 01:56:41.341461 16415 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 01:56:41.341514 16415 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 01:56:41.341562 16415 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 01:56:41.341611 16415 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 01:56:41.341651 16415 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 01:56:41.341697 16415 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 01:56:41.341797 16415 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [addons-416530 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1122 01:56:41.341881 16415 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 01:56:41.342037 16415 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [addons-416530 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1122 01:56:41.342133 16415 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 01:56:41.342226 16415 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 01:56:41.342297 16415 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 01:56:41.342383 16415 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 01:56:41.342457 16415 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 01:56:41.342544 16415 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 01:56:41.342638 16415 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 01:56:41.342739 16415 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 01:56:41.342791 16415 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 01:56:41.342871 16415 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 01:56:41.342957 16415 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 01:56:41.344093 16415 out.go:252] - Booting up control plane ...
I1122 01:56:41.344221 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 01:56:41.344317 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 01:56:41.344382 16415 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 01:56:41.344473 16415 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 01:56:41.344557 16415 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 01:56:41.344646 16415 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 01:56:41.344735 16415 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 01:56:41.344787 16415 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 01:56:41.344990 16415 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 01:56:41.345147 16415 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 01:56:41.345235 16415 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001588796s
I1122 01:56:41.345363 16415 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 01:56:41.345456 16415 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
I1122 01:56:41.345553 16415 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 01:56:41.345658 16415 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 01:56:41.345762 16415 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 1.00520899s
I1122 01:56:41.345827 16415 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 1.527191887s
I1122 01:56:41.345927 16415 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 3.001542702s
I1122 01:56:41.346097 16415 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 01:56:41.346237 16415 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 01:56:41.346288 16415 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 01:56:41.346472 16415 kubeadm.go:319] [mark-control-plane] Marking the node addons-416530 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 01:56:41.346526 16415 kubeadm.go:319] [bootstrap-token] Using token: 1yfhb2.w0hpuq9jknzevoj9
I1122 01:56:41.347770 16415 out.go:252] - Configuring RBAC rules ...
I1122 01:56:41.347857 16415 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 01:56:41.347946 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 01:56:41.348070 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 01:56:41.348189 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 01:56:41.348338 16415 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 01:56:41.348471 16415 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 01:56:41.348589 16415 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 01:56:41.348625 16415 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 01:56:41.348693 16415 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 01:56:41.348702 16415 kubeadm.go:319]
I1122 01:56:41.348789 16415 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 01:56:41.348798 16415 kubeadm.go:319]
I1122 01:56:41.348857 16415 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 01:56:41.348865 16415 kubeadm.go:319]
I1122 01:56:41.348884 16415 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 01:56:41.348962 16415 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 01:56:41.349034 16415 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 01:56:41.349043 16415 kubeadm.go:319]
I1122 01:56:41.349115 16415 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 01:56:41.349124 16415 kubeadm.go:319]
I1122 01:56:41.349188 16415 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 01:56:41.349197 16415 kubeadm.go:319]
I1122 01:56:41.349271 16415 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 01:56:41.349340 16415 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 01:56:41.349395 16415 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 01:56:41.349400 16415 kubeadm.go:319]
I1122 01:56:41.349464 16415 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 01:56:41.349535 16415 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 01:56:41.349547 16415 kubeadm.go:319]
I1122 01:56:41.349616 16415 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 1yfhb2.w0hpuq9jknzevoj9 \
I1122 01:56:41.349710 16415 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 01:56:41.349734 16415 kubeadm.go:319] --control-plane
I1122 01:56:41.349743 16415 kubeadm.go:319]
I1122 01:56:41.349813 16415 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 01:56:41.349822 16415 kubeadm.go:319]
I1122 01:56:41.349893 16415 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 1yfhb2.w0hpuq9jknzevoj9 \
I1122 01:56:41.350019 16415 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 01:56:41.350029 16415 cni.go:84] Creating CNI manager for ""
I1122 01:56:41.350036 16415 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 01:56:41.351212 16415 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1122 01:56:41.352216 16415 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 01:56:41.356091 16415 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 01:56:41.356106 16415 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 01:56:41.368156 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 01:56:41.555657 16415 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 01:56:41.555787 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:41.555795 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-416530 minikube.k8s.io/updated_at=2025_11_22T01_56_41_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=addons-416530 minikube.k8s.io/primary=true
I1122 01:56:41.565182 16415 ops.go:34] apiserver oom_adj: -16
I1122 01:56:41.635751 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:42.135840 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:42.636798 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:43.135816 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:43.636413 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:44.136549 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:44.636541 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:45.136521 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:45.636229 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.136849 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.636205 16415 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 01:56:46.702190 16415 kubeadm.go:1114] duration metric: took 5.14645036s to wait for elevateKubeSystemPrivileges
I1122 01:56:46.702234 16415 kubeadm.go:403] duration metric: took 14.170492333s to StartCluster
I1122 01:56:46.702271 16415 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:46.702399 16415 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:56:46.702850 16415 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 01:56:46.703074 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 01:56:46.703117 16415 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 01:56:46.703161 16415 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:true storage-provisioner:true storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I1122 01:56:46.703302 16415 addons.go:70] Setting default-storageclass=true in profile "addons-416530"
I1122 01:56:46.703313 16415 addons.go:70] Setting yakd=true in profile "addons-416530"
I1122 01:56:46.703330 16415 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "addons-416530"
I1122 01:56:46.703336 16415 addons.go:70] Setting registry=true in profile "addons-416530"
I1122 01:56:46.703352 16415 addons.go:70] Setting ingress-dns=true in profile "addons-416530"
I1122 01:56:46.703370 16415 addons.go:70] Setting registry-creds=true in profile "addons-416530"
I1122 01:56:46.703379 16415 addons.go:239] Setting addon ingress-dns=true in "addons-416530"
I1122 01:56:46.703371 16415 addons.go:70] Setting nvidia-device-plugin=true in profile "addons-416530"
I1122 01:56:46.703390 16415 addons.go:70] Setting storage-provisioner-rancher=true in profile "addons-416530"
I1122 01:56:46.703385 16415 addons.go:70] Setting cloud-spanner=true in profile "addons-416530"
I1122 01:56:46.703421 16415 addons.go:239] Setting addon nvidia-device-plugin=true in "addons-416530"
I1122 01:56:46.703425 16415 addons_storage_classes.go:34] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-416530"
I1122 01:56:46.703434 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703437 16415 addons.go:239] Setting addon cloud-spanner=true in "addons-416530"
I1122 01:56:46.703480 16415 addons.go:70] Setting inspektor-gadget=true in profile "addons-416530"
I1122 01:56:46.703498 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703500 16415 addons.go:239] Setting addon inspektor-gadget=true in "addons-416530"
I1122 01:56:46.703526 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703533 16415 addons.go:70] Setting amd-gpu-device-plugin=true in profile "addons-416530"
I1122 01:56:46.703547 16415 addons.go:239] Setting addon amd-gpu-device-plugin=true in "addons-416530"
I1122 01:56:46.703561 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703572 16415 addons.go:70] Setting ingress=true in profile "addons-416530"
I1122 01:56:46.703587 16415 addons.go:239] Setting addon ingress=true in "addons-416530"
I1122 01:56:46.703641 16415 addons.go:70] Setting volcano=true in profile "addons-416530"
I1122 01:56:46.703745 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703756 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703952 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704056 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704074 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704154 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704282 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.704608 16415 addons.go:239] Setting addon volcano=true in "addons-416530"
I1122 01:56:46.712951 16415 out.go:179] * Verifying Kubernetes components...
I1122 01:56:46.703381 16415 addons.go:239] Setting addon registry-creds=true in "addons-416530"
I1122 01:56:46.718311 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.718347 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.719257 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.719398 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703528 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.720100 16415 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 01:56:46.713739 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703337 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:46.703364 16415 addons.go:239] Setting addon registry=true in "addons-416530"
I1122 01:56:46.721868 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.722473 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.723101 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.703386 16415 addons.go:70] Setting storage-provisioner=true in profile "addons-416530"
I1122 01:56:46.726663 16415 addons.go:239] Setting addon storage-provisioner=true in "addons-416530"
I1122 01:56:46.726862 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.704877 16415 addons.go:70] Setting gcp-auth=true in profile "addons-416530"
I1122 01:56:46.727254 16415 mustload.go:66] Loading cluster: addons-416530
I1122 01:56:46.727472 16415 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:56:46.727762 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.728351 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.704982 16415 addons.go:70] Setting metrics-server=true in profile "addons-416530"
I1122 01:56:46.731950 16415 addons.go:239] Setting addon metrics-server=true in "addons-416530"
I1122 01:56:46.732092 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.705328 16415 addons.go:70] Setting volumesnapshots=true in profile "addons-416530"
I1122 01:56:46.732170 16415 addons.go:239] Setting addon volumesnapshots=true in "addons-416530"
I1122 01:56:46.732314 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.703331 16415 addons.go:239] Setting addon yakd=true in "addons-416530"
I1122 01:56:46.737126 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.705362 16415 addons.go:70] Setting csi-hostpath-driver=true in profile "addons-416530"
I1122 01:56:46.737371 16415 addons.go:239] Setting addon csi-hostpath-driver=true in "addons-416530"
I1122 01:56:46.737410 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.738034 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.738421 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.741614 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.742398 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.756971 16415 out.go:179] - Using image docker.io/kicbase/minikube-ingress-dns:0.0.4
I1122 01:56:46.758499 16415 addons.go:436] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I1122 01:56:46.758523 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2889 bytes)
I1122 01:56:46.758585 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.760004 16415 addons.go:239] Setting addon storage-provisioner-rancher=true in "addons-416530"
I1122 01:56:46.760051 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.760271 16415 addons.go:239] Setting addon default-storageclass=true in "addons-416530"
I1122 01:56:46.760301 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.763076 16415 out.go:179] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.9
I1122 01:56:46.763546 16415 out.go:179] - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
I1122 01:56:46.764397 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.764505 16415 addons.go:436] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1122 01:56:46.764519 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
I1122 01:56:46.764573 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.768350 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:46.768501 16415 out.go:179] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.18.0
I1122 01:56:46.770514 16415 out.go:179] - Using image docker.io/registry:3.0.0
I1122 01:56:46.772686 16415 addons.go:436] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1122 01:56:46.772704 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I1122 01:56:46.772762 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.772947 16415 addons.go:436] installing /etc/kubernetes/addons/registry-rc.yaml
I1122 01:56:46.772971 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I1122 01:56:46.773021 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.776869 16415 out.go:179] - Using image docker.io/upmcenterprises/registry-creds:1.10
I1122 01:56:46.778286 16415 addons.go:436] installing /etc/kubernetes/addons/registry-creds-rc.yaml
I1122 01:56:46.778303 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-creds-rc.yaml (3306 bytes)
I1122 01:56:46.778370 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.786118 16415 out.go:179] - Using image registry.k8s.io/metrics-server/metrics-server:v0.8.0
I1122 01:56:46.787048 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1122 01:56:46.787066 16415 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1122 01:56:46.787129 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.797898 16415 out.go:179] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.46.0
I1122 01:56:46.799232 16415 out.go:179] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I1122 01:56:46.800053 16415 addons.go:436] installing /etc/kubernetes/addons/ig-deployment.yaml
I1122 01:56:46.800077 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (15034 bytes)
I1122 01:56:46.800134 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.800387 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1122 01:56:46.800407 16415 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I1122 01:56:46.800470 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
W1122 01:56:46.809713 16415 out.go:285] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
I1122 01:56:46.810982 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/controller:v1.14.0
I1122 01:56:46.811625 16415 out.go:179] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.43
I1122 01:56:46.813172 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:46.813266 16415 addons.go:436] installing /etc/kubernetes/addons/deployment.yaml
I1122 01:56:46.813630 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I1122 01:56:46.814097 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.817480 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.818489 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:46.819923 16415 addons.go:436] installing /etc/kubernetes/addons/ingress-deploy.yaml
I1122 01:56:46.819987 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I1122 01:56:46.820066 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.830256 16415 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 01:56:46.830277 16415 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 01:56:46.830333 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.842891 16415 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 01:56:46.844127 16415 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 01:56:46.844270 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 01:56:46.844439 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.861180 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.864096 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.865939 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.866693 16415 out.go:179] - Using image docker.io/marcnuri/yakd:0.0.5
I1122 01:56:46.866808 16415 out.go:179] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I1122 01:56:46.867570 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.867711 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-ns.yaml
I1122 01:56:46.867728 16415 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I1122 01:56:46.867783 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.868012 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:46.869202 16415 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 01:56:46.869370 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.869443 16415 out.go:179] - Using image docker.io/busybox:stable
I1122 01:56:46.870565 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.871833 16415 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1122 01:56:46.871849 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I1122 01:56:46.871894 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.871958 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I1122 01:56:46.874760 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I1122 01:56:46.875417 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.877084 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I1122 01:56:46.878672 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.881105 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I1122 01:56:46.882163 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I1122 01:56:46.883217 16415 out.go:179] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I1122 01:56:46.884178 16415 out.go:179] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I1122 01:56:46.885050 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.885281 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.886283 16415 out.go:179] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I1122 01:56:46.887300 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I1122 01:56:46.887353 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I1122 01:56:46.887431 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:46.898892 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.914393 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
W1122 01:56:46.915700 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.915735 16415 retry.go:31] will retry after 357.801287ms: ssh: handshake failed: EOF
I1122 01:56:46.926606 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:46.930720 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
W1122 01:56:46.931260 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.931283 16415 retry.go:31] will retry after 234.770967ms: ssh: handshake failed: EOF
W1122 01:56:46.931599 16415 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1122 01:56:46.931617 16415 retry.go:31] will retry after 315.440077ms: ssh: handshake failed: EOF
I1122 01:56:46.956355 16415 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 01:56:47.017061 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I1122 01:56:47.027125 16415 addons.go:436] installing /etc/kubernetes/addons/registry-svc.yaml
I1122 01:56:47.027209 16415 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I1122 01:56:47.027462 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-creds-rc.yaml
I1122 01:56:47.028751 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I1122 01:56:47.031489 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 01:56:47.038882 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1122 01:56:47.038914 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I1122 01:56:47.048598 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1122 01:56:47.048622 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I1122 01:56:47.056162 16415 addons.go:436] installing /etc/kubernetes/addons/registry-proxy.yaml
I1122 01:56:47.056181 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I1122 01:56:47.062870 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1122 01:56:47.062890 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I1122 01:56:47.064036 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I1122 01:56:47.067892 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ig-deployment.yaml
I1122 01:56:47.069613 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1122 01:56:47.072880 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1122 01:56:47.078499 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 01:56:47.083070 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1122 01:56:47.083129 16415 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1122 01:56:47.095648 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I1122 01:56:47.116313 16415 addons.go:436] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1122 01:56:47.116405 16415 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1122 01:56:47.117181 16415 addons.go:436] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1122 01:56:47.117262 16415 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I1122 01:56:47.150056 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1122 01:56:47.150145 16415 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I1122 01:56:47.192407 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1122 01:56:47.192680 16415 addons.go:436] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:47.192700 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I1122 01:56:47.202373 16415 node_ready.go:35] waiting up to 6m0s for node "addons-416530" to be "Ready" ...
I1122 01:56:47.203690 16415 start.go:977] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I1122 01:56:47.246966 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:47.366231 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1122 01:56:47.436160 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-sa.yaml
I1122 01:56:47.436251 16415 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I1122 01:56:47.490109 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-crb.yaml
I1122 01:56:47.490133 16415 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I1122 01:56:47.493273 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I1122 01:56:47.493362 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I1122 01:56:47.532081 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-svc.yaml
I1122 01:56:47.532111 16415 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I1122 01:56:47.539252 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1122 01:56:47.539277 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I1122 01:56:47.568368 16415 addons.go:436] installing /etc/kubernetes/addons/yakd-dp.yaml
I1122 01:56:47.568396 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I1122 01:56:47.596945 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1122 01:56:47.596974 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I1122 01:56:47.598219 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I1122 01:56:47.631295 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I1122 01:56:47.631392 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I1122 01:56:47.669180 16415 addons.go:436] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1122 01:56:47.669210 16415 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I1122 01:56:47.704566 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1122 01:56:47.704590 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I1122 01:56:47.718653 16415 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-416530" context rescaled to 1 replicas
I1122 01:56:47.753127 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1122 01:56:47.753216 16415 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I1122 01:56:47.790642 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1122 01:56:47.790667 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I1122 01:56:47.812298 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1122 01:56:47.812396 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I1122 01:56:47.833576 16415 addons.go:436] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1122 01:56:47.833661 16415 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I1122 01:56:47.854115 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1122 01:56:48.135537 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (1.071467212s)
I1122 01:56:48.135576 16415 addons.go:495] Verifying addon ingress=true in "addons-416530"
I1122 01:56:48.135666 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/ig-deployment.yaml: (1.067727417s)
I1122 01:56:48.135713 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.062755196s)
I1122 01:56:48.135725 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.057212085s)
I1122 01:56:48.135698 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (1.066021129s)
I1122 01:56:48.135759 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (1.040092191s)
I1122 01:56:48.135770 16415 addons.go:495] Verifying addon registry=true in "addons-416530"
I1122 01:56:48.135856 16415 addons.go:495] Verifying addon metrics-server=true in "addons-416530"
I1122 01:56:48.141752 16415 out.go:179] * Verifying registry addon...
I1122 01:56:48.141753 16415 out.go:179] * Verifying ingress addon...
I1122 01:56:48.143404 16415 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I1122 01:56:48.143530 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I1122 01:56:48.145288 16415 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1122 01:56:48.145465 16415 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
I1122 01:56:48.145487 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:48.530803 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.283630017s)
W1122 01:56:48.530848 16415 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1122 01:56:48.530870 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.164552076s)
I1122 01:56:48.530871 16415 retry.go:31] will retry after 168.242369ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1122 01:56:48.531205 16415 addons.go:495] Verifying addon csi-hostpath-driver=true in "addons-416530"
I1122 01:56:48.533265 16415 out.go:179] * Verifying csi-hostpath-driver addon...
I1122 01:56:48.533262 16415 out.go:179] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-416530 service yakd-dashboard -n yakd-dashboard
I1122 01:56:48.535549 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1122 01:56:48.537820 16415 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1122 01:56:48.537843 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:48.646192 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:48.646420 16415 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1122 01:56:48.646437 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:48.699819 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1122 01:56:49.037874 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:49.146781 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:49.146884 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:49.205023 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:49.538929 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:49.646225 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:49.646435 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:50.038507 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:50.145967 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:50.146116 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:50.538423 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:50.646652 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:50.646711 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:51.038817 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:51.142662 16415 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.442806743s)
I1122 01:56:51.145816 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:51.146035 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:51.538124 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:51.646712 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:51.646764 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:51.704530 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:52.038664 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:52.146299 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:52.146485 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:52.538735 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:52.645701 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:52.645768 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:53.039024 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:53.145814 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:53.145968 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:53.538343 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:53.646767 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:53.646937 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:53.705017 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:54.038766 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:54.145568 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:54.145809 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:54.475275 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I1122 01:56:54.475341 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:54.492311 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:54.538959 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:54.591148 16415 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I1122 01:56:54.602564 16415 addons.go:239] Setting addon gcp-auth=true in "addons-416530"
I1122 01:56:54.602604 16415 host.go:66] Checking if "addons-416530" exists ...
I1122 01:56:54.602964 16415 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:56:54.619559 16415 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I1122 01:56:54.619620 16415 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:56:54.635721 16415 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:56:54.646671 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:54.646814 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:54.725629 16415 out.go:179] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.4
I1122 01:56:54.726779 16415 out.go:179] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I1122 01:56:54.727782 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I1122 01:56:54.727796 16415 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I1122 01:56:54.739538 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I1122 01:56:54.739553 16415 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I1122 01:56:54.751169 16415 addons.go:436] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1122 01:56:54.751185 16415 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I1122 01:56:54.762670 16415 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1122 01:56:55.038207 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:55.040732 16415 addons.go:495] Verifying addon gcp-auth=true in "addons-416530"
I1122 01:56:55.041861 16415 out.go:179] * Verifying gcp-auth addon...
I1122 01:56:55.043633 16415 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I1122 01:56:55.138939 16415 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1122 01:56:55.138955 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:55.145702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:55.145895 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:55.537521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:55.546013 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:55.646066 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:55.646315 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:56.038673 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:56.046504 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:56.145463 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:56.145605 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:56.204299 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:56.538521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:56.546195 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:56.646259 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:56.646347 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:57.037824 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:57.045595 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:57.145438 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:57.145617 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:57.538768 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:57.545511 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:57.645831 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:57.646040 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:58.038395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:58.046143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:58.145922 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:58.146195 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:56:58.204736 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:56:58.538112 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:58.545855 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:58.645835 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:58.645871 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:59.038115 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:59.045853 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:59.145962 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:59.146233 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:56:59.538088 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:56:59.545693 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:56:59.646282 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:56:59.646295 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:00.038495 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:00.046190 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:00.145860 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:00.146250 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:00.204964 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:00.537945 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:00.545598 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:00.645432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:00.645603 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:01.039147 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:01.045886 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:01.145655 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:01.145868 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:01.537712 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:01.546395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:01.646931 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:01.647097 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:02.038561 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:02.046355 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:02.146205 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:02.146419 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:02.205069 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:02.538513 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:02.546160 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:02.646198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:02.646320 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:03.038392 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:03.046105 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:03.146029 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:03.146208 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:03.538226 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:03.545880 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:03.645955 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:03.646081 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:04.039127 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:04.045609 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:04.145372 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:04.145532 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:04.538660 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:04.546390 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:04.646262 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:04.646437 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:04.705160 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:05.038494 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:05.046248 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:05.146110 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:05.146317 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:05.538515 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:05.546287 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:05.646634 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:05.646679 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:06.038848 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:06.045340 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:06.146476 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:06.146564 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:06.538579 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:06.546335 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:06.646232 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:06.646360 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:07.038711 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:07.046558 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:07.145497 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:07.145538 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:07.205081 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:07.538436 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:07.546129 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:07.646479 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:07.646577 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:08.038639 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:08.046346 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:08.146200 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:08.146356 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:08.538323 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:08.546056 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:08.646191 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:08.646215 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:09.038576 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:09.046408 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:09.145271 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:09.145464 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:09.538499 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:09.546334 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:09.646844 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:09.646901 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:09.704537 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:10.038006 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:10.045514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:10.145270 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:10.145479 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:10.538078 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:10.545783 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:10.645779 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:10.645838 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:11.038761 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:11.045395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:11.146141 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:11.146528 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:11.538514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:11.546198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:11.646603 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:11.646738 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:11.704738 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:12.038242 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:12.046123 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:12.146137 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:12.146284 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:12.538476 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:12.546189 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:12.646276 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:12.646422 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.038240 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:13.046007 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:13.145828 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:13.146187 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.538407 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:13.546154 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:13.646053 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:13.646117 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.038039 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:14.046041 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:14.146106 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.146126 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:14.204968 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:14.538290 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:14.545978 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:14.645713 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:14.645860 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:15.037862 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:15.045628 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:15.145874 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:15.146094 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:15.537638 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:15.546197 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:15.646058 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:15.646275 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:16.038329 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:16.046045 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:16.145869 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:16.146098 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:16.538058 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:16.545748 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:16.645668 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:16.645780 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:16.704363 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:17.037777 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:17.045623 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:17.145419 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:17.145535 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:17.538432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:17.546166 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:17.646076 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:17.646228 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:18.038107 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:18.045740 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:18.145754 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:18.145959 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:18.537767 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:18.545397 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:18.646429 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:18.646624 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:18.705060 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:19.038588 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:19.046353 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:19.146249 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:19.146288 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:19.537872 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:19.545435 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:19.645953 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:19.646133 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:20.038295 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:20.045794 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:20.145616 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:20.145752 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:20.537790 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:20.545523 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:20.645490 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:20.645671 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:21.038704 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:21.046755 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:21.145834 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:21.146041 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:21.204648 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:21.537825 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:21.545792 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:21.646098 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:21.646198 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:22.038516 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:22.046309 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:22.146521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:22.146627 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:22.537618 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:22.546323 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:22.646173 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:22.646364 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:23.038291 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:23.046057 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:23.146622 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:23.147801 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:23.538694 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:23.546420 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:23.662251 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:23.662459 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:23.705170 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:24.037575 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:24.046445 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:24.145526 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:24.145571 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:24.537647 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:24.546382 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:24.646202 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:24.646315 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.038445 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:25.046241 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:25.146188 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.146496 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:25.538432 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:25.546213 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:25.646004 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:25.646214 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:26.038268 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:26.046143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:26.146096 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:26.146151 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W1122 01:57:26.204951 16415 node_ready.go:57] node "addons-416530" has "Ready":"False" status (will retry)
I1122 01:57:26.538286 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:26.546043 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:26.645987 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:26.646186 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.038367 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:27.046131 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:27.146183 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:27.146315 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.538812 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:27.549855 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:27.647425 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:27.647437 16415 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I1122 01:57:27.647468 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:27.705031 16415 node_ready.go:49] node "addons-416530" is "Ready"
I1122 01:57:27.705056 16415 node_ready.go:38] duration metric: took 40.502655134s for node "addons-416530" to be "Ready" ...
I1122 01:57:27.705072 16415 api_server.go:52] waiting for apiserver process to appear ...
I1122 01:57:27.705119 16415 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 01:57:27.719429 16415 api_server.go:72] duration metric: took 41.016272642s to wait for apiserver process to appear ...
I1122 01:57:27.719455 16415 api_server.go:88] waiting for apiserver healthz status ...
I1122 01:57:27.719477 16415 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I1122 01:57:27.723923 16415 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I1122 01:57:27.724745 16415 api_server.go:141] control plane version: v1.34.1
I1122 01:57:27.724769 16415 api_server.go:131] duration metric: took 5.306441ms to wait for apiserver health ...
I1122 01:57:27.724780 16415 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 01:57:27.728323 16415 system_pods.go:59] 20 kube-system pods found
I1122 01:57:27.728351 16415 system_pods.go:61] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.728360 16415 system_pods.go:61] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.728367 16415 system_pods.go:61] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.728373 16415 system_pods.go:61] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.728380 16415 system_pods.go:61] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.728385 16415 system_pods.go:61] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.728391 16415 system_pods.go:61] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.728395 16415 system_pods.go:61] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.728398 16415 system_pods.go:61] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.728403 16415 system_pods.go:61] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.728406 16415 system_pods.go:61] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.728410 16415 system_pods.go:61] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.728415 16415 system_pods.go:61] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.728424 16415 system_pods.go:61] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.728433 16415 system_pods.go:61] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.728438 16415 system_pods.go:61] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.728445 16415 system_pods.go:61] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.728449 16415 system_pods.go:61] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.728455 16415 system_pods.go:61] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.728459 16415 system_pods.go:61] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.728469 16415 system_pods.go:74] duration metric: took 3.684077ms to wait for pod list to return data ...
I1122 01:57:27.728477 16415 default_sa.go:34] waiting for default service account to be created ...
I1122 01:57:27.730188 16415 default_sa.go:45] found service account: "default"
I1122 01:57:27.730203 16415 default_sa.go:55] duration metric: took 1.720911ms for default service account to be created ...
I1122 01:57:27.730211 16415 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 01:57:27.733487 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:27.733523 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.733535 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.733547 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.733555 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.733563 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.733569 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.733575 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.733580 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.733586 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.733593 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.733599 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.733604 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.733612 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.733619 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.733627 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.733636 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.733643 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.733664 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.733672 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.733679 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.733697 16415 retry.go:31] will retry after 222.244878ms: missing components: kube-dns
I1122 01:57:27.962135 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:27.962241 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:27.962268 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:27.962310 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:27.962330 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:27.962341 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:27.962350 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:27.962357 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:27.962371 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:27.962377 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:27.962388 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:27.962393 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:27.962399 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:27.962406 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:27.962415 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:27.962424 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:27.962444 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:27.962453 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:27.962461 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.962471 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:27.962479 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:27.962502 16415 retry.go:31] will retry after 283.084564ms: missing components: kube-dns
I1122 01:57:28.059376 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:28.059490 16415 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1122 01:57:28.059509 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:28.159469 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:28.159574 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:28.261112 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:28.261141 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:28.261148 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:28.261157 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:28.261163 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:28.261168 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:28.261171 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:28.261176 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:28.261179 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:28.261182 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:28.261187 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:28.261191 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:28.261195 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:28.261204 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:28.261209 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:28.261215 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:28.261220 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:28.261227 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:28.261244 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.261254 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.261260 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:28.261278 16415 retry.go:31] will retry after 325.086575ms: missing components: kube-dns
I1122 01:57:28.538979 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:28.545902 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:28.591011 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:28.591047 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:28.591059 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 01:57:28.591070 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:28.591080 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:28.591088 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:28.591096 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:28.591103 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:28.591108 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:28.591114 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:28.591124 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:28.591129 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:28.591140 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:28.591147 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:28.591156 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:28.591170 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:28.591178 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:28.591186 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:28.591196 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.591205 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:28.591213 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 01:57:28.591231 16415 retry.go:31] will retry after 583.847165ms: missing components: kube-dns
I1122 01:57:28.646746 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:28.646821 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:29.039143 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:29.138862 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:29.145829 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:29.145975 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:29.178901 16415 system_pods.go:86] 20 kube-system pods found
I1122 01:57:29.178944 16415 system_pods.go:89] "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1122 01:57:29.178953 16415 system_pods.go:89] "coredns-66bc5c9577-p4spw" [e7387b2f-be20-4cec-963e-f9e6109b45ce] Running
I1122 01:57:29.178963 16415 system_pods.go:89] "csi-hostpath-attacher-0" [eacdf7f5-1c11-4f63-b72f-1cca4c3e98d5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1122 01:57:29.178972 16415 system_pods.go:89] "csi-hostpath-resizer-0" [bdfcc6f4-2241-41fa-9aea-eb918997f216] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1122 01:57:29.178991 16415 system_pods.go:89] "csi-hostpathplugin-mw4bs" [68a045cc-139e-48f4-99c8-be658eca3fda] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1122 01:57:29.178999 16415 system_pods.go:89] "etcd-addons-416530" [366e75a3-5eac-4894-a647-d57f655923a1] Running
I1122 01:57:29.179004 16415 system_pods.go:89] "kindnet-9xxr6" [03ce1f7a-cc3e-4da7-b90a-1fbc278ab3db] Running
I1122 01:57:29.179009 16415 system_pods.go:89] "kube-apiserver-addons-416530" [f80f7130-c67a-4941-afbe-a4a3ff659cf9] Running
I1122 01:57:29.179015 16415 system_pods.go:89] "kube-controller-manager-addons-416530" [6bbbbad1-9e01-437b-ae8e-ca0cb0d32d3b] Running
I1122 01:57:29.179023 16415 system_pods.go:89] "kube-ingress-dns-minikube" [4bab1817-6881-4172-aefa-1448a25dab6d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I1122 01:57:29.179029 16415 system_pods.go:89] "kube-proxy-srcjh" [1ab0e31d-4f52-4f5d-bf47-d90a302d0d53] Running
I1122 01:57:29.179035 16415 system_pods.go:89] "kube-scheduler-addons-416530" [4559336c-557b-4444-9df3-62abda48bf32] Running
I1122 01:57:29.179043 16415 system_pods.go:89] "metrics-server-85b7d694d7-ccqr5" [0af5976a-ae9c-4573-b609-f395bcd75350] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1122 01:57:29.179053 16415 system_pods.go:89] "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1122 01:57:29.179064 16415 system_pods.go:89] "registry-6b586f9694-cc4db" [e3580bb2-0029-47fb-84a2-8fe368689aa8] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1122 01:57:29.179072 16415 system_pods.go:89] "registry-creds-764b6fb674-6mwhg" [f7e86884-4557-4183-86db-e18a395dd7db] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
I1122 01:57:29.179082 16415 system_pods.go:89] "registry-proxy-l6ggw" [bc2ea383-f344-40e5-ab70-34eb9d6acd5c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1122 01:57:29.179087 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-cj59x" [5b93cbce-06f7-4f19-b226-ed3f16158e10] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:29.179095 16415 system_pods.go:89] "snapshot-controller-7d9fbc56b8-t8dwd" [1666ec58-e48c-4e25-b807-6529907c2504] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1122 01:57:29.179104 16415 system_pods.go:89] "storage-provisioner" [8d309270-cf96-49ab-b968-dc82d949caf3] Running
I1122 01:57:29.179115 16415 system_pods.go:126] duration metric: took 1.448897723s to wait for k8s-apps to be running ...
I1122 01:57:29.179127 16415 system_svc.go:44] waiting for kubelet service to be running ....
I1122 01:57:29.179173 16415 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 01:57:29.191198 16415 system_svc.go:56] duration metric: took 12.066031ms WaitForService to wait for kubelet
I1122 01:57:29.191219 16415 kubeadm.go:587] duration metric: took 42.488068986s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 01:57:29.191241 16415 node_conditions.go:102] verifying NodePressure condition ...
I1122 01:57:29.193509 16415 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 01:57:29.193538 16415 node_conditions.go:123] node cpu capacity is 8
I1122 01:57:29.193555 16415 node_conditions.go:105] duration metric: took 2.302045ms to run NodePressure ...
I1122 01:57:29.193572 16415 start.go:242] waiting for startup goroutines ...
I1122 01:57:29.539940 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:29.545960 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:29.646732 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:29.646870 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:30.041064 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:30.048490 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:30.146794 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:30.146830 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:30.539014 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:30.546188 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:30.647060 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:30.647154 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:31.039400 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:31.046326 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:31.147705 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:31.147858 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:31.538533 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:31.546392 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:31.646442 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:31.646507 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:32.038603 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:32.046305 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:32.147421 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:32.147455 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:32.539365 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:32.546524 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:32.645953 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:32.646086 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:33.039395 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:33.046165 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:33.146553 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:33.146622 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:33.538893 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:33.546023 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:33.646819 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:33.647105 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.040226 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:34.046397 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:34.147333 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:34.147405 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.539474 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:34.546201 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:34.646801 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:34.646974 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.039478 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:35.046702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:35.146736 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.146780 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:35.539479 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:35.546571 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:35.647502 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:35.647570 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:36.038699 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:36.046716 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:36.146711 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:36.146769 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:36.538590 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:36.546212 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:36.647060 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:36.647127 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:37.039441 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:37.046204 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:37.146244 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:37.146252 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:37.545341 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:37.550465 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:37.647607 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:37.647771 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:38.038461 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:38.046251 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:38.147482 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:38.147540 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:38.538311 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:38.545958 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:38.646271 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:38.646364 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.038044 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:39.045514 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:39.145578 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:39.145651 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.538702 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:39.546642 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:39.646300 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:39.646360 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.040076 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:40.045899 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:40.146670 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.146833 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:40.538819 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:40.546864 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:40.646630 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:40.646697 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:41.039142 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:41.046383 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:41.147385 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:41.147447 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:41.539125 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:41.546201 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:41.647079 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:41.647201 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:42.038847 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:42.138811 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:42.239307 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:42.239651 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:42.539369 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:42.546386 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:42.647648 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:42.647757 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:43.038597 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:43.046466 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:43.145985 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:43.146059 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:43.546809 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:43.546888 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:43.646820 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:43.646830 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.050621 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:44.050870 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:44.152769 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:44.152784 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.538812 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:44.546692 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:44.646629 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:44.646674 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.039192 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:45.045746 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:45.146063 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.146191 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:45.539138 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:45.545731 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:45.646367 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:45.646501 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:46.040055 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:46.045994 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:46.146643 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:46.146814 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:46.538528 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:46.546038 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:46.646156 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:46.646171 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:47.039023 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:47.045742 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:47.146777 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:47.146787 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:47.539486 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:47.547068 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:47.647646 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:47.647942 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:48.039895 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:48.046215 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:48.146887 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:48.146967 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:48.539053 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:48.545851 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:48.646108 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:48.646248 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:49.039006 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:49.045433 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:49.145296 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:49.145457 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:49.538050 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:49.546288 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:49.647169 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:49.647219 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:50.039035 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:50.045695 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:50.145574 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:50.145773 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:50.540014 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:50.546011 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:50.646776 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:50.646824 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:51.038652 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:51.046176 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:51.146266 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:51.146411 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:51.540094 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:51.546103 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:51.647046 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:51.647131 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.039101 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:52.045674 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:52.146680 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:52.146846 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.541329 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:52.547414 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:52.646589 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:52.647529 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1122 01:57:53.039253 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:53.046651 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:53.147181 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:53.147184 16415 kapi.go:107] duration metric: took 1m5.003655053s to wait for kubernetes.io/minikube-addons=registry ...
I1122 01:57:53.538628 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:53.546458 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:53.646281 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:54.039673 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:54.046577 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:54.146494 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:54.538521 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:54.546961 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:54.646423 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:55.038352 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:55.045976 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:55.146675 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:55.538808 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:55.546640 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:55.646432 16415 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1122 01:57:56.039186 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:56.046299 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:56.147345 16415 kapi.go:107] duration metric: took 1m8.003935189s to wait for app.kubernetes.io/name=ingress-nginx ...
I1122 01:57:56.538944 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:56.545473 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:57.042326 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:57.048462 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:57.539247 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:57.546169 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:58.039468 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:58.046842 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:58.539311 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:58.546416 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:59.039894 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:59.046968 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:57:59.538888 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:57:59.546198 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:00.038008 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:00.045355 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:00.539233 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:00.546444 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:01.038763 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:01.046854 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:01.539197 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:01.546174 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1122 01:58:02.038235 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:02.045809 16415 kapi.go:107] duration metric: took 1m7.002173456s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I1122 01:58:02.094720 16415 out.go:179] * Your GCP credentials will now be mounted into every pod created in the addons-416530 cluster.
I1122 01:58:02.096521 16415 out.go:179] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I1122 01:58:02.099205 16415 out.go:179] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I1122 01:58:02.538717 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:03.039360 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:03.539019 16415 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1122 01:58:04.038817 16415 kapi.go:107] duration metric: took 1m15.50326538s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I1122 01:58:04.040412 16415 out.go:179] * Enabled addons: ingress-dns, cloud-spanner, storage-provisioner, registry-creds, inspektor-gadget, nvidia-device-plugin, amd-gpu-device-plugin, metrics-server, default-storageclass, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
I1122 01:58:04.041471 16415 addons.go:530] duration metric: took 1m17.338308597s for enable addons: enabled=[ingress-dns cloud-spanner storage-provisioner registry-creds inspektor-gadget nvidia-device-plugin amd-gpu-device-plugin metrics-server default-storageclass yakd storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
I1122 01:58:04.041512 16415 start.go:247] waiting for cluster config update ...
I1122 01:58:04.041533 16415 start.go:256] writing updated cluster config ...
I1122 01:58:04.041773 16415 ssh_runner.go:195] Run: rm -f paused
I1122 01:58:04.045501 16415 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 01:58:04.048074 16415 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-p4spw" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.051359 16415 pod_ready.go:94] pod "coredns-66bc5c9577-p4spw" is "Ready"
I1122 01:58:04.051379 16415 pod_ready.go:86] duration metric: took 3.280292ms for pod "coredns-66bc5c9577-p4spw" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.052966 16415 pod_ready.go:83] waiting for pod "etcd-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.055841 16415 pod_ready.go:94] pod "etcd-addons-416530" is "Ready"
I1122 01:58:04.055859 16415 pod_ready.go:86] duration metric: took 2.875943ms for pod "etcd-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.057359 16415 pod_ready.go:83] waiting for pod "kube-apiserver-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.060397 16415 pod_ready.go:94] pod "kube-apiserver-addons-416530" is "Ready"
I1122 01:58:04.060415 16415 pod_ready.go:86] duration metric: took 3.035918ms for pod "kube-apiserver-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.061811 16415 pod_ready.go:83] waiting for pod "kube-controller-manager-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.448975 16415 pod_ready.go:94] pod "kube-controller-manager-addons-416530" is "Ready"
I1122 01:58:04.449004 16415 pod_ready.go:86] duration metric: took 387.176283ms for pod "kube-controller-manager-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:04.649692 16415 pod_ready.go:83] waiting for pod "kube-proxy-srcjh" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.048056 16415 pod_ready.go:94] pod "kube-proxy-srcjh" is "Ready"
I1122 01:58:05.048081 16415 pod_ready.go:86] duration metric: took 398.367916ms for pod "kube-proxy-srcjh" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.248605 16415 pod_ready.go:83] waiting for pod "kube-scheduler-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.649137 16415 pod_ready.go:94] pod "kube-scheduler-addons-416530" is "Ready"
I1122 01:58:05.649164 16415 pod_ready.go:86] duration metric: took 400.536596ms for pod "kube-scheduler-addons-416530" in "kube-system" namespace to be "Ready" or be gone ...
I1122 01:58:05.649175 16415 pod_ready.go:40] duration metric: took 1.603650475s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 01:58:05.691092 16415 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 01:58:05.693471 16415 out.go:179] * Done! kubectl is now configured to use "addons-416530" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 01:58:03 addons-416530 crio[779]: time="2025-11-22T01:58:03.452329578Z" level=info msg="Starting container: 2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0" id=0d4bbff1-dd45-4b69-9895-b5834db12feb name=/runtime.v1.RuntimeService/StartContainer
Nov 22 01:58:03 addons-416530 crio[779]: time="2025-11-22T01:58:03.454562596Z" level=info msg="Started container" PID=6160 containerID=2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0 description=kube-system/csi-hostpathplugin-mw4bs/csi-snapshotter id=0d4bbff1-dd45-4b69-9895-b5834db12feb name=/runtime.v1.RuntimeService/StartContainer sandboxID=04a38cdc2cf547b25904449bdcf22d3aa5b44ae639cef23e5f90849348552c59
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.496429737Z" level=info msg="Running pod sandbox: default/busybox/POD" id=0750c91e-ad40-4571-8f71-e4b6610f777d name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.496496976Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.503464138Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:fea4576034865f6a51e4a6b07358cdbe08181727c3d6c8404c90c6776728a6e6 UID:239d109d-62b1-4acc-82d0-9e4940ee5d0a NetNS:/var/run/netns/afc7f15b-7354-43fb-abbb-f842db7bbc8c Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00090c588}] Aliases:map[]}"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.503497879Z" level=info msg="Adding pod default_busybox to CNI network \"kindnet\" (type=ptp)"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.513192054Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:fea4576034865f6a51e4a6b07358cdbe08181727c3d6c8404c90c6776728a6e6 UID:239d109d-62b1-4acc-82d0-9e4940ee5d0a NetNS:/var/run/netns/afc7f15b-7354-43fb-abbb-f842db7bbc8c Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00090c588}] Aliases:map[]}"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.513302009Z" level=info msg="Checking pod default_busybox for CNI network kindnet (type=ptp)"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.514244128Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.515016389Z" level=info msg="Ran pod sandbox fea4576034865f6a51e4a6b07358cdbe08181727c3d6c8404c90c6776728a6e6 with infra container: default/busybox/POD" id=0750c91e-ad40-4571-8f71-e4b6610f777d name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.516012881Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=4a32a75e-cef6-4a20-b01c-82746482df34 name=/runtime.v1.ImageService/ImageStatus
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.516111491Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=4a32a75e-cef6-4a20-b01c-82746482df34 name=/runtime.v1.ImageService/ImageStatus
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.516139981Z" level=info msg="Neither image nor artfiact gcr.io/k8s-minikube/busybox:1.28.4-glibc found" id=4a32a75e-cef6-4a20-b01c-82746482df34 name=/runtime.v1.ImageService/ImageStatus
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.516604391Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=5167711f-4c7e-4d58-8f8d-a666d2e59e68 name=/runtime.v1.ImageService/PullImage
Nov 22 01:58:06 addons-416530 crio[779]: time="2025-11-22T01:58:06.517865735Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28.4-glibc\""
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.115867027Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998" id=5167711f-4c7e-4d58-8f8d-a666d2e59e68 name=/runtime.v1.ImageService/PullImage
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.116410231Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=cf40dc19-2d43-4524-96b8-df338a7cb329 name=/runtime.v1.ImageService/ImageStatus
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.117558825Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=4e2e2e95-854a-4a0c-9cad-3dec6194dc65 name=/runtime.v1.ImageService/ImageStatus
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.121032812Z" level=info msg="Creating container: default/busybox/busybox" id=bf5cdd4f-e297-4ca0-b352-05800c417ac9 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.121143127Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.127068155Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.127447323Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.15548118Z" level=info msg="Created container e96572ccdce05dec5a0e2c28ad6150e0ef2c8d8c2f3df1fcc2bd5663dd630b77: default/busybox/busybox" id=bf5cdd4f-e297-4ca0-b352-05800c417ac9 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.155997162Z" level=info msg="Starting container: e96572ccdce05dec5a0e2c28ad6150e0ef2c8d8c2f3df1fcc2bd5663dd630b77" id=53d2fbee-4d15-421f-aff2-c3c92a7eebe2 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 01:58:07 addons-416530 crio[779]: time="2025-11-22T01:58:07.157884264Z" level=info msg="Started container" PID=6251 containerID=e96572ccdce05dec5a0e2c28ad6150e0ef2c8d8c2f3df1fcc2bd5663dd630b77 description=default/busybox/busybox id=53d2fbee-4d15-421f-aff2-c3c92a7eebe2 name=/runtime.v1.RuntimeService/StartContainer sandboxID=fea4576034865f6a51e4a6b07358cdbe08181727c3d6c8404c90c6776728a6e6
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
e96572ccdce05 gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 8 seconds ago Running busybox 0 fea4576034865 busybox default
2185b680b44ce registry.k8s.io/sig-storage/csi-snapshotter@sha256:d844cb1faeb4ecf44bae6aea370c9c6128a87e665e40370021427d79a8819ee5 12 seconds ago Running csi-snapshotter 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
988778748b220 registry.k8s.io/sig-storage/csi-provisioner@sha256:1bc653d13b27b8eefbba0799bdb5711819f8b987eaa6eb6750e8ef001958d5a7 13 seconds ago Running csi-provisioner 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
b5ed1d6e75f9e gcr.io/k8s-minikube/gcp-auth-webhook@sha256:441f351b4520c228d29ba8c02a438d9ba971dafbbba5c91eaf882b1528797fb8 14 seconds ago Running gcp-auth 0 d1b048c07b5c5 gcp-auth-78565c9fb4-fxl9z gcp-auth
ead8f9b1ffe4f registry.k8s.io/sig-storage/livenessprobe@sha256:42bc492c3c65078b1ccda5dbc416abf0cefdba3e6317416cbc43344cf0ed09b6 15 seconds ago Running liveness-probe 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
978142aac9bab 884bd0ac01c8f31e881485be470970faa6043bd20f3c592f832e6e0233b4cf45 16 seconds ago Exited patch 2 a3eea13e15881 gcp-auth-certs-patch-pz872 gcp-auth
1a692754170e4 registry.k8s.io/sig-storage/hostpathplugin@sha256:6fdad87766e53edf987545067e69a0dffb8485cccc546be4efbaa14c9b22ea11 16 seconds ago Running hostpath 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
830e2a94a330f ghcr.io/inspektor-gadget/inspektor-gadget@sha256:9a12b3c1d155bb081ff408a9b6c1cec18573c967e0c3917225b81ffe11c0b7f2 17 seconds ago Running gadget 0 57bf7e3b8b785 gadget-trt2m gadget
df5d237ed72bd registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:7caa903cf3f8d1d70c3b7bb3e23223685b05e4f342665877eabe84ae38b92ecc 19 seconds ago Running node-driver-registrar 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
ced9cb41df05f registry.k8s.io/ingress-nginx/controller@sha256:7f2b00bd369a972bfb09acfe8c2525b99caeeeb54ab71d2822343e8fd4222e27 20 seconds ago Running controller 0 f7acbc48b8eb8 ingress-nginx-controller-6c8bf45fb-fndkb ingress-nginx
a0d6ea009d86b gcr.io/k8s-minikube/kube-registry-proxy@sha256:8f72a79b63ca56074435e82b87fca2642a8117e60be313d3586dbe2bfff11cac 23 seconds ago Running registry-proxy 0 b4eb79560826b registry-proxy-l6ggw kube-system
b29121801b415 docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f 25 seconds ago Running amd-gpu-device-plugin 0 6f30c290666a8 amd-gpu-device-plugin-qthwc kube-system
792f724873ba1 registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:317f43813e4e2c3e81823ff16041c8e0714fb80e6d040c6e6c799967ba27d864 26 seconds ago Running csi-external-health-monitor-controller 0 04a38cdc2cf54 csi-hostpathplugin-mw4bs kube-system
485648275f35d nvcr.io/nvidia/k8s-device-plugin@sha256:20db699f1480b6f37423cab909e9c6df5a4fdbd981b405e0d72f00a86fee5100 26 seconds ago Running nvidia-device-plugin-ctr 0 95174f7f8f5e5 nvidia-device-plugin-daemonset-98gcz kube-system
ceaab2e692628 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:f016159150cb72d879e0d3b6852afbed68fe21d86be1e92c62ab7f56515287f5 29 seconds ago Exited create 0 429e6b80f9524 gcp-auth-certs-create-bclsv gcp-auth
59cb705b74eea registry.k8s.io/sig-storage/csi-attacher@sha256:66e4ecfa0ec50a88f9cd145e006805816f57040f40662d4cb9e31d10519d9bf0 29 seconds ago Running csi-attacher 0 94aad0857aa63 csi-hostpath-attacher-0 kube-system
3a15e6024a813 registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922 30 seconds ago Running volume-snapshot-controller 0 b091e2adb0237 snapshot-controller-7d9fbc56b8-t8dwd kube-system
14cb3762f40a1 registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922 31 seconds ago Running volume-snapshot-controller 0 5614c28995cf9 snapshot-controller-7d9fbc56b8-cj59x kube-system
b9593030d4f2b registry.k8s.io/sig-storage/csi-resizer@sha256:0629447f7946e53df3ad775c5595888de1dae5a23bcaae8f68fdab0395af61a8 31 seconds ago Running csi-resizer 0 aab8d2e87c1be csi-hostpath-resizer-0 kube-system
a4e934f78ef46 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:f016159150cb72d879e0d3b6852afbed68fe21d86be1e92c62ab7f56515287f5 32 seconds ago Exited patch 0 e9ed01b5555cb ingress-nginx-admission-patch-48xbq ingress-nginx
87f8e5d2d9806 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:f016159150cb72d879e0d3b6852afbed68fe21d86be1e92c62ab7f56515287f5 33 seconds ago Exited create 0 5070df88dd69b ingress-nginx-admission-create-54nh4 ingress-nginx
38f92a0675988 docker.io/kicbase/minikube-ingress-dns@sha256:a0cc6cd76812357245a51bb05fabcd346a616c880e40ca4e0c8c8253912eaae7 33 seconds ago Running minikube-ingress-dns 0 b0a582d851be2 kube-ingress-dns-minikube kube-system
ddc3efb90a97c docker.io/marcnuri/yakd@sha256:8ebd1692ed5271719f13b728d9af7acb839aa04821e931c8993d908ad68b69fd 39 seconds ago Running yakd 0 cf583a682bc00 yakd-dashboard-5ff678cb9-jmp4w yakd-dashboard
0dad432ce915b docker.io/library/registry@sha256:f57ffd2bb01704b6082396158e77ca6d1112bc6fe32315c322864de804750d8a 41 seconds ago Running registry 0 723d574131ee7 registry-6b586f9694-cc4db kube-system
aad91611499fe docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef 43 seconds ago Running local-path-provisioner 0 a3ba8ae5d03f2 local-path-provisioner-648f6765c9-nzslx local-path-storage
982107589ed55 gcr.io/cloud-spanner-emulator/emulator@sha256:7360f5c5ff4b89d75592d9585fc2d59d207b08ccf262a84edfe79ee0613a7099 44 seconds ago Running cloud-spanner-emulator 0 2d97ffccdc604 cloud-spanner-emulator-6f9fcf858b-njfhw default
04799747c7ece registry.k8s.io/metrics-server/metrics-server@sha256:5dd31abb8093690d9624a53277a00d2257e7e57e6766be3f9f54cf9f54cddbc1 46 seconds ago Running metrics-server 0 146202e5dbb40 metrics-server-85b7d694d7-ccqr5 kube-system
503ba38162056 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 47 seconds ago Running coredns 0 17b15b208c353 coredns-66bc5c9577-p4spw kube-system
df7b6a61c743a 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 47 seconds ago Running storage-provisioner 0 2ad1d5c11c095 storage-provisioner kube-system
d8ab0cb5f0070 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 About a minute ago Running kube-proxy 0 d51c30d072809 kube-proxy-srcjh kube-system
8948dab032502 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c About a minute ago Running kindnet-cni 0 7935ae92f8d3e kindnet-9xxr6 kube-system
5f0052817eef4 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 About a minute ago Running kube-scheduler 0 61e2fa067f959 kube-scheduler-addons-416530 kube-system
a03417c044e35 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 About a minute ago Running etcd 0 e37847b950a69 etcd-addons-416530 kube-system
add672f356f20 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f About a minute ago Running kube-controller-manager 0 24e50469d5184 kube-controller-manager-addons-416530 kube-system
83bba379fe411 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 About a minute ago Running kube-apiserver 0 b6a7fe476f40d kube-apiserver-addons-416530 kube-system
==> coredns [503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83] <==
[INFO] 10.244.0.19:59613 - 63649 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00013674s
[INFO] 10.244.0.19:52858 - 1570 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000087566s
[INFO] 10.244.0.19:52858 - 1824 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000146497s
[INFO] 10.244.0.19:52900 - 29085 "A IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 94 false 512" NXDOMAIN qr,aa,rd,ra 204 0.000057464s
[INFO] 10.244.0.19:52900 - 29392 "AAAA IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 94 false 512" NXDOMAIN qr,aa,rd,ra 204 0.000090761s
[INFO] 10.244.0.19:35251 - 60627 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,aa,rd,ra 185 0.000057219s
[INFO] 10.244.0.19:35251 - 60357 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,aa,rd,ra 185 0.000081147s
[INFO] 10.244.0.19:46888 - 57160 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000113473s
[INFO] 10.244.0.19:46888 - 57515 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000129234s
[INFO] 10.244.0.19:33600 - 54287 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000093043s
[INFO] 10.244.0.19:33600 - 54083 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000134589s
[INFO] 10.244.0.22:54506 - 56586 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000225939s
[INFO] 10.244.0.22:37499 - 27022 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000297712s
[INFO] 10.244.0.22:53953 - 19508 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000119907s
[INFO] 10.244.0.22:35834 - 37325 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000095366s
[INFO] 10.244.0.22:42420 - 38610 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000148586s
[INFO] 10.244.0.22:43374 - 26747 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000228501s
[INFO] 10.244.0.22:47489 - 32713 "AAAA IN storage.googleapis.com.us-central1-a.c.k8s-minikube.internal. udp 89 false 1232" NXDOMAIN qr,rd,ra 188 0.004532956s
[INFO] 10.244.0.22:49720 - 5913 "A IN storage.googleapis.com.us-central1-a.c.k8s-minikube.internal. udp 89 false 1232" NXDOMAIN qr,rd,ra 188 0.005097202s
[INFO] 10.244.0.22:45994 - 58717 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.005252867s
[INFO] 10.244.0.22:59687 - 33439 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.006160479s
[INFO] 10.244.0.22:36307 - 29824 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004288512s
[INFO] 10.244.0.22:34023 - 2243 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004492758s
[INFO] 10.244.0.22:56981 - 30046 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.000986332s
[INFO] 10.244.0.22:38580 - 58767 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001735796s
==> describe nodes <==
Name: addons-416530
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-416530
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=addons-416530
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T01_56_41_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-416530
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-416530"}
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 01:56:38 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-416530
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 01:58:11 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 01:58:12 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 01:58:12 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 01:58:12 +0000 Sat, 22 Nov 2025 01:56:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 01:58:12 +0000 Sat, 22 Nov 2025 01:57:27 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-416530
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 423f733e-c016-45a4-a157-39c80f7c1866
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 10s
default cloud-spanner-emulator-6f9fcf858b-njfhw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
gadget gadget-trt2m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
gcp-auth gcp-auth-78565c9fb4-fxl9z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 81s
ingress-nginx ingress-nginx-controller-6c8bf45fb-fndkb 100m (1%) 0 (0%) 90Mi (0%) 0 (0%) 88s
kube-system amd-gpu-device-plugin-qthwc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system coredns-66bc5c9577-p4spw 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 90s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 88s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 88s
kube-system csi-hostpathplugin-mw4bs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system etcd-addons-416530 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 97s
kube-system kindnet-9xxr6 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 90s
kube-system kube-apiserver-addons-416530 250m (3%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system kube-controller-manager-addons-416530 200m (2%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system kube-proxy-srcjh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 90s
kube-system kube-scheduler-addons-416530 100m (1%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system metrics-server-85b7d694d7-ccqr5 100m (1%) 0 (0%) 200Mi (0%) 0 (0%) 89s
kube-system nvidia-device-plugin-daemonset-98gcz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system registry-6b586f9694-cc4db 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system registry-creds-764b6fb674-6mwhg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system registry-proxy-l6ggw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system snapshot-controller-7d9fbc56b8-cj59x 0 (0%) 0 (0%) 0 (0%) 0 (0%) 88s
kube-system snapshot-controller-7d9fbc56b8-t8dwd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 88s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
local-path-storage local-path-provisioner-648f6765c9-nzslx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
yakd-dashboard yakd-dashboard-5ff678cb9-jmp4w 0 (0%) 0 (0%) 128Mi (0%) 256Mi (0%) 88s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (13%) 100m (1%)
memory 638Mi (1%) 476Mi (1%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 89s kube-proxy
Normal NodeHasSufficientMemory 100s (x8 over 100s) kubelet Node addons-416530 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 100s (x8 over 100s) kubelet Node addons-416530 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 100s (x8 over 100s) kubelet Node addons-416530 status is now: NodeHasSufficientPID
Normal Starting 96s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 96s kubelet Node addons-416530 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 96s kubelet Node addons-416530 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 96s kubelet Node addons-416530 status is now: NodeHasSufficientPID
Normal RegisteredNode 91s node-controller Node addons-416530 event: Registered Node addons-416530 in Controller
Normal NodeReady 49s kubelet Node addons-416530 status is now: NodeReady
==> dmesg <==
[Nov22 01:17] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[ +0.001882] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details.
[ +0.000999] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details.
[ +0.082010] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ +0.375807] i8042: Warning: Keylock active
[ +0.008756] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.489627] block sda: the capability attribute has been deprecated.
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
==> etcd [a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80] <==
{"level":"warn","ts":"2025-11-22T01:56:37.902605Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60958","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.908361Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60970","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.914339Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60988","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.923076Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32780","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.930165Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32800","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.936901Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32810","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.942884Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32818","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.949293Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32860","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.954668Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32862","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.960443Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32868","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.967005Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32884","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.973219Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32910","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.980710Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32928","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.987363Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32952","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:37.996969Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32958","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.016126Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32988","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.021975Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:32994","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.030040Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:33014","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:38.068562Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:33030","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:48.912022Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56368","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:56:48.918025Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56388","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.466232Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45462","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.472579Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45480","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.482725Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45500","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T01:57:15.488767Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:45520","server-name":"","error":"EOF"}
==> gcp-auth [b5ed1d6e75f9e2034a8bca0aa4a013823a93cf3c28e39dbc065a2403266ab31c] <==
2025/11/22 01:58:01 GCP Auth Webhook started!
2025/11/22 01:58:05 Ready to marshal response ...
2025/11/22 01:58:05 Ready to write response ...
2025/11/22 01:58:06 Ready to marshal response ...
2025/11/22 01:58:06 Ready to write response ...
2025/11/22 01:58:06 Ready to marshal response ...
2025/11/22 01:58:06 Ready to write response ...
==> kernel <==
01:58:16 up 40 min, 0 user, load average: 2.09, 0.90, 0.35
Linux addons-416530 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa] <==
I1122 01:56:46.638215 1 main.go:148] setting mtu 1500 for CNI
I1122 01:56:46.638229 1 main.go:178] kindnetd IP family: "ipv4"
I1122 01:56:46.638247 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T01:56:46Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 01:56:46.939381 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 01:56:46.939473 1 controller.go:381] "Waiting for informer caches to sync"
I1122 01:56:46.939490 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 01:56:46.939941 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
E1122 01:57:16.941320 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Pod: Get \"https://10.96.0.1:443/api/v1/pods?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Pod"
E1122 01:57:16.941325 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Namespace"
E1122 01:57:16.941336 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://10.96.0.1:443/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Node"
E1122 01:57:16.942471 1 reflector.go:200] "Failed to watch" err="failed to list *v1.NetworkPolicy: Get \"https://10.96.0.1:443/apis/networking.k8s.io/v1/networkpolicies?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.NetworkPolicy"
I1122 01:57:18.339797 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 01:57:18.339818 1 metrics.go:72] Registering metrics
I1122 01:57:18.339856 1 controller.go:711] "Syncing nftables rules"
I1122 01:57:26.943756 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:57:26.943795 1 main.go:301] handling current node
I1122 01:57:36.936296 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:57:36.936326 1 main.go:301] handling current node
I1122 01:57:46.936418 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:57:46.936452 1 main.go:301] handling current node
I1122 01:57:56.937086 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:57:56.937128 1 main.go:301] handling current node
I1122 01:58:06.937021 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 01:58:06.937049 1 main.go:301] handling current node
==> kube-apiserver [83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd] <==
E1122 01:57:41.712508 1 remote_available_controller.go:462] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.108.1.156:443: connect: connection refused" logger="UnhandledError"
W1122 01:57:41.712633 1 handler_proxy.go:99] no RequestInfo found in the context
E1122 01:57:41.712707 1 controller.go:146] "Unhandled Error" err=<
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E1122 01:57:41.713021 1 remote_available_controller.go:462] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.108.1.156:443: connect: connection refused" logger="UnhandledError"
W1122 01:57:42.714409 1 handler_proxy.go:99] no RequestInfo found in the context
W1122 01:57:42.714405 1 handler_proxy.go:99] no RequestInfo found in the context
E1122 01:57:42.714466 1 controller.go:113] "Unhandled Error" err="loading OpenAPI spec for \"v1beta1.metrics.k8s.io\" failed with: Error, could not get list of group versions for APIService" logger="UnhandledError"
I1122 01:57:42.714481 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1122 01:57:42.714485 1 controller.go:102] "Unhandled Error" err=<
loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
I1122 01:57:42.715614 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W1122 01:57:46.721591 1 handler_proxy.go:99] no RequestInfo found in the context
E1122 01:57:46.721658 1 controller.go:146] "Unhandled Error" err=<
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E1122 01:57:46.721661 1 remote_available_controller.go:462] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.1.156:443/apis/metrics.k8s.io/v1beta1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" logger="UnhandledError"
I1122 01:57:46.730462 1 handler.go:285] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
E1122 01:58:14.328391 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:47612: use of closed network connection
E1122 01:58:14.472065 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:47630: use of closed network connection
==> kube-controller-manager [add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6] <==
I1122 01:56:45.447693 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 01:56:45.447742 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 01:56:45.447778 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 01:56:45.447799 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 01:56:45.447836 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 01:56:45.448065 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 01:56:45.448204 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 01:56:45.448962 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 01:56:45.450114 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 01:56:45.451233 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:56:45.451351 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 01:56:45.451361 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:56:45.455547 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 01:56:45.459729 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 01:56:45.465968 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
E1122 01:57:15.460717 1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
I1122 01:57:15.460858 1 resource_quota_monitor.go:227] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="volumesnapshots.snapshot.storage.k8s.io"
I1122 01:57:15.460919 1 shared_informer.go:349] "Waiting for caches to sync" controller="resource quota"
I1122 01:57:15.473275 1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
I1122 01:57:15.476382 1 shared_informer.go:349] "Waiting for caches to sync" controller="garbage collector"
I1122 01:57:15.562103 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 01:57:15.577270 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 01:57:30.390280 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
E1122 01:57:45.566945 1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
I1122 01:57:45.585415 1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
==> kube-proxy [d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000] <==
I1122 01:56:46.500230 1 server_linux.go:53] "Using iptables proxy"
I1122 01:56:46.583517 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 01:56:46.684657 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 01:56:46.684696 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
E1122 01:56:46.684812 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 01:56:46.704500 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 01:56:46.704565 1 server_linux.go:132] "Using iptables Proxier"
I1122 01:56:46.712282 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 01:56:46.719777 1 server.go:527] "Version info" version="v1.34.1"
I1122 01:56:46.743050 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 01:56:46.745082 1 config.go:200] "Starting service config controller"
I1122 01:56:46.745094 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 01:56:46.745116 1 config.go:106] "Starting endpoint slice config controller"
I1122 01:56:46.745126 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 01:56:46.745161 1 config.go:403] "Starting serviceCIDR config controller"
I1122 01:56:46.745166 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 01:56:46.746117 1 config.go:309] "Starting node config controller"
I1122 01:56:46.746137 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 01:56:46.746145 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 01:56:46.845900 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 01:56:46.845987 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 01:56:46.846028 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a] <==
E1122 01:56:38.453519 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 01:56:38.454278 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 01:56:38.454331 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 01:56:38.454333 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 01:56:38.454338 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 01:56:38.454340 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 01:56:38.454476 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 01:56:38.454478 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 01:56:38.454501 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 01:56:38.454542 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 01:56:38.454623 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 01:56:38.454659 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 01:56:39.273533 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 01:56:39.343562 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 01:56:39.353511 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 01:56:39.399249 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 01:56:39.404965 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 01:56:39.416862 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 01:56:39.471452 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 01:56:39.542362 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 01:56:39.544175 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 01:56:39.608370 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 01:56:39.629268 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 01:56:39.640097 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
I1122 01:56:39.951225 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 01:57:50 addons-416530 kubelet[1305]: I1122 01:57:50.773969 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-98gcz" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:57:51 addons-416530 kubelet[1305]: I1122 01:57:51.779313 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/amd-gpu-device-plugin-qthwc" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:57:51 addons-416530 kubelet[1305]: I1122 01:57:51.791032 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/amd-gpu-device-plugin-qthwc" podStartSLOduration=1.907985537 podStartE2EDuration="24.791018523s" podCreationTimestamp="2025-11-22 01:57:27 +0000 UTC" firstStartedPulling="2025-11-22 01:57:27.986671525 +0000 UTC m=+47.510585373" lastFinishedPulling="2025-11-22 01:57:50.869704508 +0000 UTC m=+70.393618359" observedRunningTime="2025-11-22 01:57:51.789854644 +0000 UTC m=+71.313768512" watchObservedRunningTime="2025-11-22 01:57:51.791018523 +0000 UTC m=+71.314932379"
Nov 22 01:57:52 addons-416530 kubelet[1305]: I1122 01:57:52.786014 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-l6ggw" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:57:52 addons-416530 kubelet[1305]: I1122 01:57:52.787948 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/amd-gpu-device-plugin-qthwc" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:57:52 addons-416530 kubelet[1305]: I1122 01:57:52.802728 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/registry-proxy-l6ggw" podStartSLOduration=1.799798346 podStartE2EDuration="25.802711937s" podCreationTimestamp="2025-11-22 01:57:27 +0000 UTC" firstStartedPulling="2025-11-22 01:57:28.067243067 +0000 UTC m=+47.591156906" lastFinishedPulling="2025-11-22 01:57:52.070156661 +0000 UTC m=+71.594070497" observedRunningTime="2025-11-22 01:57:52.802599453 +0000 UTC m=+72.326513310" watchObservedRunningTime="2025-11-22 01:57:52.802711937 +0000 UTC m=+72.326625794"
Nov 22 01:57:53 addons-416530 kubelet[1305]: I1122 01:57:53.790868 1305 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-l6ggw" secret="" err="secret \"gcp-auth\" not found"
Nov 22 01:57:55 addons-416530 kubelet[1305]: I1122 01:57:55.810664 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="ingress-nginx/ingress-nginx-controller-6c8bf45fb-fndkb" podStartSLOduration=56.023185159 podStartE2EDuration="1m7.810645527s" podCreationTimestamp="2025-11-22 01:56:48 +0000 UTC" firstStartedPulling="2025-11-22 01:57:43.952772888 +0000 UTC m=+63.476686731" lastFinishedPulling="2025-11-22 01:57:55.740233251 +0000 UTC m=+75.264147099" observedRunningTime="2025-11-22 01:57:55.81021281 +0000 UTC m=+75.334126671" watchObservedRunningTime="2025-11-22 01:57:55.810645527 +0000 UTC m=+75.334559385"
Nov 22 01:57:58 addons-416530 kubelet[1305]: I1122 01:57:58.824732 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="gadget/gadget-trt2m" podStartSLOduration=65.30894927 podStartE2EDuration="1m11.824717376s" podCreationTimestamp="2025-11-22 01:56:47 +0000 UTC" firstStartedPulling="2025-11-22 01:57:52.185662379 +0000 UTC m=+71.709576215" lastFinishedPulling="2025-11-22 01:57:58.701430485 +0000 UTC m=+78.225344321" observedRunningTime="2025-11-22 01:57:58.823953452 +0000 UTC m=+78.347867310" watchObservedRunningTime="2025-11-22 01:57:58.824717376 +0000 UTC m=+78.348631233"
Nov 22 01:57:59 addons-416530 kubelet[1305]: E1122 01:57:59.388974 1305 secret.go:189] Couldn't get secret kube-system/registry-creds-gcr: secret "registry-creds-gcr" not found
Nov 22 01:57:59 addons-416530 kubelet[1305]: E1122 01:57:59.389063 1305 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e86884-4557-4183-86db-e18a395dd7db-gcr-creds podName:f7e86884-4557-4183-86db-e18a395dd7db nodeName:}" failed. No retries permitted until 2025-11-22 01:58:31.389041477 +0000 UTC m=+110.912955330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "gcr-creds" (UniqueName: "kubernetes.io/secret/f7e86884-4557-4183-86db-e18a395dd7db-gcr-creds") pod "registry-creds-764b6fb674-6mwhg" (UID: "f7e86884-4557-4183-86db-e18a395dd7db") : secret "registry-creds-gcr" not found
Nov 22 01:57:59 addons-416530 kubelet[1305]: I1122 01:57:59.558318 1305 scope.go:117] "RemoveContainer" containerID="0eebe48733899dcb008ec435d97d2a7cf605ddc6aa3cdd8c19045c037c79d607"
Nov 22 01:57:59 addons-416530 kubelet[1305]: I1122 01:57:59.816692 1305 scope.go:117] "RemoveContainer" containerID="0eebe48733899dcb008ec435d97d2a7cf605ddc6aa3cdd8c19045c037c79d607"
Nov 22 01:58:00 addons-416530 kubelet[1305]: I1122 01:58:00.607148 1305 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: hostpath.csi.k8s.io endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock versions: 1.0.0
Nov 22 01:58:00 addons-416530 kubelet[1305]: I1122 01:58:00.607189 1305 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: hostpath.csi.k8s.io at endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock
Nov 22 01:58:01 addons-416530 kubelet[1305]: I1122 01:58:01.201758 1305 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8dpg\" (UniqueName: \"kubernetes.io/projected/ae81a390-8474-49e4-a615-7afcee77476d-kube-api-access-w8dpg\") pod \"ae81a390-8474-49e4-a615-7afcee77476d\" (UID: \"ae81a390-8474-49e4-a615-7afcee77476d\") "
Nov 22 01:58:01 addons-416530 kubelet[1305]: I1122 01:58:01.204392 1305 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae81a390-8474-49e4-a615-7afcee77476d-kube-api-access-w8dpg" (OuterVolumeSpecName: "kube-api-access-w8dpg") pod "ae81a390-8474-49e4-a615-7afcee77476d" (UID: "ae81a390-8474-49e4-a615-7afcee77476d"). InnerVolumeSpecName "kube-api-access-w8dpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 22 01:58:01 addons-416530 kubelet[1305]: I1122 01:58:01.302257 1305 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8dpg\" (UniqueName: \"kubernetes.io/projected/ae81a390-8474-49e4-a615-7afcee77476d-kube-api-access-w8dpg\") on node \"addons-416530\" DevicePath \"\""
Nov 22 01:58:01 addons-416530 kubelet[1305]: I1122 01:58:01.836413 1305 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3eea13e158818033addb4c49257b96b6c09f77e9b807a5fd1c4dcc33cfff516"
Nov 22 01:58:01 addons-416530 kubelet[1305]: I1122 01:58:01.851986 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="gcp-auth/gcp-auth-78565c9fb4-fxl9z" podStartSLOduration=65.428808045 podStartE2EDuration="1m6.851968364s" podCreationTimestamp="2025-11-22 01:56:55 +0000 UTC" firstStartedPulling="2025-11-22 01:57:59.72241902 +0000 UTC m=+79.246332874" lastFinishedPulling="2025-11-22 01:58:01.145579345 +0000 UTC m=+80.669493193" observedRunningTime="2025-11-22 01:58:01.851398799 +0000 UTC m=+81.375312656" watchObservedRunningTime="2025-11-22 01:58:01.851968364 +0000 UTC m=+81.375882222"
Nov 22 01:58:03 addons-416530 kubelet[1305]: I1122 01:58:03.866081 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/csi-hostpathplugin-mw4bs" podStartSLOduration=1.444473936 podStartE2EDuration="36.866063855s" podCreationTimestamp="2025-11-22 01:57:27 +0000 UTC" firstStartedPulling="2025-11-22 01:57:27.986212033 +0000 UTC m=+47.510125873" lastFinishedPulling="2025-11-22 01:58:03.407801943 +0000 UTC m=+82.931715792" observedRunningTime="2025-11-22 01:58:03.865892143 +0000 UTC m=+83.389806000" watchObservedRunningTime="2025-11-22 01:58:03.866063855 +0000 UTC m=+83.389977712"
Nov 22 01:58:06 addons-416530 kubelet[1305]: I1122 01:58:06.238508 1305 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/239d109d-62b1-4acc-82d0-9e4940ee5d0a-gcp-creds\") pod \"busybox\" (UID: \"239d109d-62b1-4acc-82d0-9e4940ee5d0a\") " pod="default/busybox"
Nov 22 01:58:06 addons-416530 kubelet[1305]: I1122 01:58:06.238549 1305 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp2kh\" (UniqueName: \"kubernetes.io/projected/239d109d-62b1-4acc-82d0-9e4940ee5d0a-kube-api-access-cp2kh\") pod \"busybox\" (UID: \"239d109d-62b1-4acc-82d0-9e4940ee5d0a\") " pod="default/busybox"
Nov 22 01:58:07 addons-416530 kubelet[1305]: I1122 01:58:07.881540 1305 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/busybox" podStartSLOduration=1.2807952980000001 podStartE2EDuration="1.88152288s" podCreationTimestamp="2025-11-22 01:58:06 +0000 UTC" firstStartedPulling="2025-11-22 01:58:06.516356171 +0000 UTC m=+86.040270011" lastFinishedPulling="2025-11-22 01:58:07.117083744 +0000 UTC m=+86.640997593" observedRunningTime="2025-11-22 01:58:07.880809207 +0000 UTC m=+87.404723064" watchObservedRunningTime="2025-11-22 01:58:07.88152288 +0000 UTC m=+87.405436737"
Nov 22 01:58:14 addons-416530 kubelet[1305]: E1122 01:58:14.328331 1305 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51184->127.0.0.1:40887: write tcp 127.0.0.1:51184->127.0.0.1:40887: write: broken pipe
==> storage-provisioner [df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db] <==
W1122 01:57:50.238366 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:52.241396 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:52.244450 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:54.247475 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:54.251375 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:56.254597 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:56.258711 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:58.261848 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:57:58.265961 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:00.268697 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:00.271926 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:02.289470 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:02.309013 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:04.311067 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:04.314063 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:06.316635 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:06.320040 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:08.322751 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:08.327466 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:10.330255 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:10.333185 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:12.335498 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:12.339371 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:14.342025 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 01:58:14.346613 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-416530 -n addons-416530
helpers_test.go:269: (dbg) Run: kubectl --context addons-416530 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: gcp-auth-certs-create-bclsv gcp-auth-certs-patch-pz872 ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq registry-creds-764b6fb674-6mwhg
helpers_test.go:282: ======> post-mortem[TestAddons/parallel/Headlamp]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context addons-416530 describe pod gcp-auth-certs-create-bclsv gcp-auth-certs-patch-pz872 ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq registry-creds-764b6fb674-6mwhg
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context addons-416530 describe pod gcp-auth-certs-create-bclsv gcp-auth-certs-patch-pz872 ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq registry-creds-764b6fb674-6mwhg: exit status 1 (57.414434ms)
** stderr **
Error from server (NotFound): pods "gcp-auth-certs-create-bclsv" not found
Error from server (NotFound): pods "gcp-auth-certs-patch-pz872" not found
Error from server (NotFound): pods "ingress-nginx-admission-create-54nh4" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-48xbq" not found
Error from server (NotFound): pods "registry-creds-764b6fb674-6mwhg" not found
** /stderr **
helpers_test.go:287: kubectl --context addons-416530 describe pod gcp-auth-certs-create-bclsv gcp-auth-certs-patch-pz872 ingress-nginx-admission-create-54nh4 ingress-nginx-admission-patch-48xbq registry-creds-764b6fb674-6mwhg: exit status 1
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable headlamp --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable headlamp --alsologtostderr -v=1: exit status 11 (228.651148ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:16.868847 25433 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:16.869134 25433 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:16.869143 25433 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:16.869147 25433 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:16.869338 25433 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:16.869558 25433 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:16.869876 25433 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:16.869890 25433 addons.go:622] checking whether the cluster is paused
I1122 01:58:16.869985 25433 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:16.870002 25433 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:16.870344 25433 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:16.887393 25433 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:16.887439 25433 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:16.903274 25433 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:16.994709 25433 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:16.994778 25433 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:17.022178 25433 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:17.022197 25433 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:17.022202 25433 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:17.022205 25433 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:17.022208 25433 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:17.022212 25433 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:17.022217 25433 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:17.022222 25433 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:17.022227 25433 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:17.022239 25433 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:17.022246 25433 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:17.022251 25433 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:17.022255 25433 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:17.022262 25433 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:17.022266 25433 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:17.022280 25433 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:17.022286 25433 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:17.022290 25433 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:17.022293 25433 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:17.022295 25433 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:17.022298 25433 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:17.022302 25433 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:17.022306 25433 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:17.022310 25433 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:17.022325 25433 cri.go:89] found id: ""
I1122 01:58:17.022367 25433 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:17.035300 25433 out.go:203]
W1122 01:58:17.036340 25433 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:17Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:17Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:17.036354 25433 out.go:285] *
*
W1122 01:58:17.039405 25433 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_efe3f0a65eabdab15324ffdebd5a66da17706a9c_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_efe3f0a65eabdab15324ffdebd5a66da17706a9c_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:17.040539 25433 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable headlamp addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable headlamp --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/Headlamp (2.34s)
=== RUN TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner
=== CONT TestAddons/parallel/CloudSpanner
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:352: "cloud-spanner-emulator-6f9fcf858b-njfhw" [f6c4debf-ad3b-4196-bc04-fd1c62e86c47] Running
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.002496904s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable cloud-spanner --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable cloud-spanner --alsologtostderr -v=1: exit status 11 (229.773185ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:33.451651 27670 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:33.451966 27670 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:33.451977 27670 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:33.451982 27670 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:33.452147 27670 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:33.452389 27670 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:33.452694 27670 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:33.452709 27670 addons.go:622] checking whether the cluster is paused
I1122 01:58:33.452790 27670 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:33.452804 27670 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:33.453153 27670 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:33.469998 27670 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:33.470037 27670 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:33.485733 27670 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:33.577985 27670 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:33.578058 27670 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:33.607436 27670 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:33.607463 27670 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:33.607467 27670 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:33.607470 27670 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:33.607473 27670 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:33.607476 27670 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:33.607478 27670 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:33.607480 27670 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:33.607483 27670 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:33.607487 27670 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:33.607490 27670 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:33.607493 27670 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:33.607495 27670 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:33.607497 27670 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:33.607500 27670 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:33.607506 27670 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:33.607512 27670 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:33.607516 27670 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:33.607518 27670 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:33.607521 27670 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:33.607523 27670 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:33.607525 27670 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:33.607528 27670 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:33.607530 27670 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:33.607533 27670 cri.go:89] found id: ""
I1122 01:58:33.607580 27670 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:33.621199 27670 out.go:203]
W1122 01:58:33.622417 27670 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:33Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:33Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:33.622436 27670 out.go:285] *
*
W1122 01:58:33.625376 27670 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_e93ff976b7e98e1dc466aded9385c0856b6d1b41_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_e93ff976b7e98e1dc466aded9385c0856b6d1b41_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:33.626582 27670 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable cloud-spanner addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable cloud-spanner --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/CloudSpanner (5.24s)
=== RUN TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath
=== CONT TestAddons/parallel/LocalPath
addons_test.go:949: (dbg) Run: kubectl --context addons-416530 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:955: (dbg) Run: kubectl --context addons-416530 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:959: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:352: "test-local-path" [c5e26ebc-0211-455d-b44e-f36f5a75ae12] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "test-local-path" [c5e26ebc-0211-455d-b44e-f36f5a75ae12] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "test-local-path" [c5e26ebc-0211-455d-b44e-f36f5a75ae12] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.002559018s
addons_test.go:967: (dbg) Run: kubectl --context addons-416530 get pvc test-pvc -o=json
addons_test.go:976: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 ssh "cat /opt/local-path-provisioner/pvc-de3d74e0-2542-4162-9a8a-737fae1d53f9_default_test-pvc/file1"
addons_test.go:988: (dbg) Run: kubectl --context addons-416530 delete pod test-local-path
addons_test.go:992: (dbg) Run: kubectl --context addons-416530 delete pvc test-pvc
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable storage-provisioner-rancher --alsologtostderr -v=1: exit status 11 (232.110686ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:29.813941 27213 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:29.814197 27213 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:29.814206 27213 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:29.814210 27213 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:29.814386 27213 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:29.814590 27213 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:29.814925 27213 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:29.814940 27213 addons.go:622] checking whether the cluster is paused
I1122 01:58:29.815021 27213 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:29.815037 27213 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:29.815391 27213 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:29.832414 27213 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:29.832457 27213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:29.848946 27213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:29.940992 27213 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:29.941056 27213 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:29.967888 27213 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:29.967941 27213 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:29.967946 27213 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:29.967950 27213 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:29.967954 27213 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:29.967958 27213 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:29.967960 27213 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:29.967964 27213 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:29.967969 27213 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:29.967978 27213 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:29.967983 27213 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:29.967986 27213 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:29.967989 27213 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:29.967991 27213 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:29.967994 27213 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:29.968005 27213 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:29.968012 27213 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:29.968020 27213 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:29.968023 27213 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:29.968025 27213 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:29.968028 27213 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:29.968030 27213 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:29.968033 27213 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:29.968039 27213 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:29.968041 27213 cri.go:89] found id: ""
I1122 01:58:29.968081 27213 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:29.982848 27213 out.go:203]
W1122 01:58:29.983982 27213 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:29Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:29Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:29.984010 27213 out.go:285] *
*
W1122 01:58:29.987011 27213 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_e8b2053d4ef30ba659303f708d034237180eb1ed_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_e8b2053d4ef30ba659303f708d034237180eb1ed_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:29.988022 27213 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable storage-provisioner-rancher addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable storage-provisioner-rancher --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/LocalPath (9.05s)
=== RUN TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin
=== CONT TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:352: "nvidia-device-plugin-daemonset-98gcz" [50eca506-eb1a-4371-9745-b3d4db5b78b8] Running
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.003731342s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable nvidia-device-plugin --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable nvidia-device-plugin --alsologtostderr -v=1: exit status 11 (229.443406ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:20.759832 25601 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:20.759983 25601 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:20.759992 25601 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:20.760004 25601 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:20.760178 25601 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:20.760403 25601 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:20.760686 25601 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:20.760700 25601 addons.go:622] checking whether the cluster is paused
I1122 01:58:20.760778 25601 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:20.760793 25601 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:20.761229 25601 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:20.777819 25601 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:20.777866 25601 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:20.794808 25601 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:20.886700 25601 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:20.886769 25601 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:20.914238 25601 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:20.914257 25601 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:20.914263 25601 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:20.914267 25601 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:20.914272 25601 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:20.914277 25601 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:20.914281 25601 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:20.914285 25601 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:20.914290 25601 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:20.914300 25601 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:20.914303 25601 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:20.914328 25601 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:20.914338 25601 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:20.914342 25601 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:20.914349 25601 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:20.914357 25601 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:20.914365 25601 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:20.914371 25601 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:20.914375 25601 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:20.914379 25601 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:20.914388 25601 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:20.914395 25601 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:20.914400 25601 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:20.914407 25601 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:20.914411 25601 cri.go:89] found id: ""
I1122 01:58:20.914450 25601 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:20.928629 25601 out.go:203]
W1122 01:58:20.929736 25601 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:20Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:20Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:20.929751 25601 out.go:285] *
*
W1122 01:58:20.932677 25601 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_47e1a72799625313bd916979b0f8aa84efd54736_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_47e1a72799625313bd916979b0f8aa84efd54736_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:20.933762 25601 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable nvidia-device-plugin addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable nvidia-device-plugin --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/NvidiaDevicePlugin (6.23s)
=== RUN TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd
=== CONT TestAddons/parallel/Yakd
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:352: "yakd-dashboard-5ff678cb9-jmp4w" [b2df151e-a652-446b-9e0e-c15ae7951a96] Running
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.002493162s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable yakd --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable yakd --alsologtostderr -v=1: exit status 11 (249.803069ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:26.056501 26472 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:26.056723 26472 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:26.056732 26472 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:26.056736 26472 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:26.056955 26472 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:26.057189 26472 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:26.057474 26472 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:26.057489 26472 addons.go:622] checking whether the cluster is paused
I1122 01:58:26.057564 26472 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:26.057579 26472 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:26.057947 26472 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:26.076729 26472 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:26.076781 26472 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:26.097778 26472 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:26.195273 26472 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:26.195357 26472 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:26.223519 26472 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:26.223539 26472 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:26.223544 26472 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:26.223549 26472 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:26.223553 26472 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:26.223559 26472 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:26.223562 26472 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:26.223566 26472 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:26.223570 26472 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:26.223583 26472 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:26.223587 26472 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:26.223591 26472 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:26.223596 26472 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:26.223601 26472 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:26.223607 26472 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:26.223614 26472 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:26.223622 26472 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:26.223627 26472 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:26.223632 26472 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:26.223635 26472 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:26.223639 26472 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:26.223642 26472 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:26.223646 26472 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:26.223656 26472 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:26.223661 26472 cri.go:89] found id: ""
I1122 01:58:26.223706 26472 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:26.237884 26472 out.go:203]
W1122 01:58:26.239000 26472 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:26Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:26Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:26.239018 26472 out.go:285] *
*
W1122 01:58:26.241987 26472 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_82e5d844def28f20a5cac88dc27578ab5d1e7e1a_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_82e5d844def28f20a5cac88dc27578ab5d1e7e1a_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:26.243177 26472 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable yakd addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable yakd --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/Yakd (6.25s)
=== RUN TestAddons/parallel/AmdGpuDevicePlugin
=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin
=== CONT TestAddons/parallel/AmdGpuDevicePlugin
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: waiting 6m0s for pods matching "name=amd-gpu-device-plugin" in namespace "kube-system" ...
helpers_test.go:352: "amd-gpu-device-plugin-qthwc" [95ea371f-b2c3-4af3-9975-176e2522dacc] Running
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: name=amd-gpu-device-plugin healthy within 6.002821608s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-416530 addons disable amd-gpu-device-plugin --alsologtostderr -v=1
addons_test.go:1053: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-416530 addons disable amd-gpu-device-plugin --alsologtostderr -v=1: exit status 11 (231.394991ms)
-- stdout --
-- /stdout --
** stderr **
I1122 01:58:23.101457 25797 out.go:360] Setting OutFile to fd 1 ...
I1122 01:58:23.101728 25797 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:23.101737 25797 out.go:374] Setting ErrFile to fd 2...
I1122 01:58:23.101740 25797 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:58:23.101951 25797 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:58:23.102183 25797 mustload.go:66] Loading cluster: addons-416530
I1122 01:58:23.102497 25797 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:23.102512 25797 addons.go:622] checking whether the cluster is paused
I1122 01:58:23.102592 25797 config.go:182] Loaded profile config "addons-416530": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 01:58:23.102606 25797 host.go:66] Checking if "addons-416530" exists ...
I1122 01:58:23.102985 25797 cli_runner.go:164] Run: docker container inspect addons-416530 --format={{.State.Status}}
I1122 01:58:23.119990 25797 ssh_runner.go:195] Run: systemctl --version
I1122 01:58:23.120033 25797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-416530
I1122 01:58:23.137004 25797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/addons-416530/id_rsa Username:docker}
I1122 01:58:23.230094 25797 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 01:58:23.230173 25797 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 01:58:23.257639 25797 cri.go:89] found id: "2185b680b44ce0c3de9d2484981c0fce6ae65d95292150fd47f76d07b96ef4d0"
I1122 01:58:23.257660 25797 cri.go:89] found id: "988778748b220916f97ea65f30e064db73ac8ca51d2aed8f2b1f8b7c36be4657"
I1122 01:58:23.257664 25797 cri.go:89] found id: "ead8f9b1ffe4fd8d8e7616f83243bd3d381348e58bf7fee9c7fe96d5728d7ce2"
I1122 01:58:23.257670 25797 cri.go:89] found id: "1a692754170e4b2ec63eff5e354179dd95e67617e9a9339913a2dd8c9b1fd141"
I1122 01:58:23.257674 25797 cri.go:89] found id: "df5d237ed72bdc418879d29dc4023611146c84ca059c4fc2b38a526be82831ac"
I1122 01:58:23.257679 25797 cri.go:89] found id: "a0d6ea009d86bfddda80900c9ce8ea9cf9dfd7f1583a7f91dd4b13dc589a72e5"
I1122 01:58:23.257683 25797 cri.go:89] found id: "b29121801b41571fef203b8d0ae2600aed51cf54d8b3b8e154ef1782ebf645ec"
I1122 01:58:23.257687 25797 cri.go:89] found id: "792f724873ba1511f88aeb83f77e7fca88d0221f78f7ca2c9472952c162f3665"
I1122 01:58:23.257691 25797 cri.go:89] found id: "485648275f35dfcf351cf05eb153826616b350f26fd0beceb8b92fdf641af91f"
I1122 01:58:23.257698 25797 cri.go:89] found id: "59cb705b74eeaab36361e7ef4f7a7caa736fe1a56f1b186aadc49370396c4298"
I1122 01:58:23.257703 25797 cri.go:89] found id: "3a15e6024a813036bd2211d27f8ed77d541edad411a74e7d247934e034a93701"
I1122 01:58:23.257714 25797 cri.go:89] found id: "14cb3762f40a165f35cf08b6f493d7fedf103797ae3b8d568c51b8ddacebf346"
I1122 01:58:23.257721 25797 cri.go:89] found id: "b9593030d4f2bef0ed10dff2a8012ddbd798d3cf9767368dca9307359083b961"
I1122 01:58:23.257723 25797 cri.go:89] found id: "38f92a06759888177ec505f25a39aca0a54c37de06e2357f04fbb7dc931c164a"
I1122 01:58:23.257726 25797 cri.go:89] found id: "0dad432ce915b54f7b7597efea54173d74e204241c88fb36ea852ea3e55e4612"
I1122 01:58:23.257731 25797 cri.go:89] found id: "04799747c7ece2c58cc4763a88167191b745bae7fcc4a2d6f074425af77ea9c1"
I1122 01:58:23.257736 25797 cri.go:89] found id: "503ba38162056df1230afb98a11900163e7598a9717a56d5fc6317dbf29abb83"
I1122 01:58:23.257739 25797 cri.go:89] found id: "df7b6a61c743a5d8cce0259559dcdeb3db9793e44c817999df77d89dd4d114db"
I1122 01:58:23.257742 25797 cri.go:89] found id: "d8ab0cb5f00701294cf16ac52c52aad667605ed001cae20fb8c6189e5e78c000"
I1122 01:58:23.257744 25797 cri.go:89] found id: "8948dab03250239cbfd143e6ae7d73d618b6d3544fb0a4dada960b1c04576baa"
I1122 01:58:23.257747 25797 cri.go:89] found id: "5f0052817eef4285bc645709ee05ba292c4928f0772633c9ca43c60dfea94a5a"
I1122 01:58:23.257749 25797 cri.go:89] found id: "a03417c044e350c690feb76872423f388f6174dc7d2b5212079af749afcfaf80"
I1122 01:58:23.257752 25797 cri.go:89] found id: "add672f356f20a932e7c83dc10a8eaba87bb0aeff213a00686fb07e73a6c57c6"
I1122 01:58:23.257754 25797 cri.go:89] found id: "83bba379fe411d91585842977fcf21e3a82313900d417acedd3485923301aefd"
I1122 01:58:23.257757 25797 cri.go:89] found id: ""
I1122 01:58:23.257801 25797 ssh_runner.go:195] Run: sudo runc list -f json
I1122 01:58:23.271214 25797 out.go:203]
W1122 01:58:23.272477 25797 out.go:285] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:23Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T01:58:23Z" level=error msg="open /run/runc: no such file or directory"
W1122 01:58:23.272499 25797 out.go:285] *
*
W1122 01:58:23.275451 25797 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_d91df5e23a6c7812cf3b3b0d72c142ff742a541e_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_d91df5e23a6c7812cf3b3b0d72c142ff742a541e_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 01:58:23.276591 25797 out.go:203]
** /stderr **
addons_test.go:1055: failed to disable amd-gpu-device-plugin addon: args "out/minikube-linux-amd64 -p addons-416530 addons disable amd-gpu-device-plugin --alsologtostderr -v=1": exit status 11
--- FAIL: TestAddons/parallel/AmdGpuDevicePlugin (6.24s)
=== RUN TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1636: (dbg) Run: kubectl --context functional-593219 create deployment hello-node-connect --image kicbase/echo-server
functional_test.go:1640: (dbg) Run: kubectl --context functional-593219 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1645: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:352: "hello-node-connect-7d85dfc575-hf6q5" [6578e4f4-bcc1-4eee-aadc-d57190cfe987] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
functional_test.go:1645: ***** TestFunctional/parallel/ServiceCmdConnect: pod "app=hello-node-connect" failed to start within 10m0s: context deadline exceeded ****
functional_test.go:1645: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-593219 -n functional-593219
functional_test.go:1645: TestFunctional/parallel/ServiceCmdConnect: showing logs for failed pods as of 2025-11-22 02:13:33.530969963 +0000 UTC m=+1061.206473493
functional_test.go:1645: (dbg) Run: kubectl --context functional-593219 describe po hello-node-connect-7d85dfc575-hf6q5 -n default
functional_test.go:1645: (dbg) kubectl --context functional-593219 describe po hello-node-connect-7d85dfc575-hf6q5 -n default:
Name: hello-node-connect-7d85dfc575-hf6q5
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:33 +0000
Labels: app=hello-node-connect
pod-template-hash=7d85dfc575
Annotations: <none>
Status: Pending
IP: 10.244.0.4
IPs:
IP: 10.244.0.4
Controlled By: ReplicaSet/hello-node-connect-7d85dfc575
Containers:
echo-server:
Container ID:
Image: kicbase/echo-server
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wcb6c (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-wcb6c:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned default/hello-node-connect-7d85dfc575-hf6q5 to functional-593219
Normal Pulling 7m11s (x5 over 10m) kubelet Pulling image "kicbase/echo-server"
Warning Failed 7m11s (x5 over 10m) kubelet Failed to pull image "kicbase/echo-server": short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list
Warning Failed 7m11s (x5 over 10m) kubelet Error: ErrImagePull
Normal BackOff 4m52s (x21 over 9m59s) kubelet Back-off pulling image "kicbase/echo-server"
Warning Failed 4m52s (x21 over 9m59s) kubelet Error: ImagePullBackOff
functional_test.go:1645: (dbg) Run: kubectl --context functional-593219 logs hello-node-connect-7d85dfc575-hf6q5 -n default
functional_test.go:1645: (dbg) Non-zero exit: kubectl --context functional-593219 logs hello-node-connect-7d85dfc575-hf6q5 -n default: exit status 1 (64.337913ms)
** stderr **
Error from server (BadRequest): container "echo-server" in pod "hello-node-connect-7d85dfc575-hf6q5" is waiting to start: trying and failing to pull image
** /stderr **
functional_test.go:1645: kubectl --context functional-593219 logs hello-node-connect-7d85dfc575-hf6q5 -n default: exit status 1
functional_test.go:1646: failed waiting for hello-node pod: app=hello-node-connect within 10m0s: context deadline exceeded
functional_test.go:1608: service test failed - dumping debug information
functional_test.go:1609: -----------------------service failure post-mortem--------------------------------
functional_test.go:1612: (dbg) Run: kubectl --context functional-593219 describe po hello-node-connect
functional_test.go:1616: hello-node pod describe:
Name: hello-node-connect-7d85dfc575-hf6q5
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:33 +0000
Labels: app=hello-node-connect
pod-template-hash=7d85dfc575
Annotations: <none>
Status: Pending
IP: 10.244.0.4
IPs:
IP: 10.244.0.4
Controlled By: ReplicaSet/hello-node-connect-7d85dfc575
Containers:
echo-server:
Container ID:
Image: kicbase/echo-server
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wcb6c (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-wcb6c:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned default/hello-node-connect-7d85dfc575-hf6q5 to functional-593219
Normal Pulling 7m11s (x5 over 10m) kubelet Pulling image "kicbase/echo-server"
Warning Failed 7m11s (x5 over 10m) kubelet Failed to pull image "kicbase/echo-server": short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list
Warning Failed 7m11s (x5 over 10m) kubelet Error: ErrImagePull
Normal BackOff 4m52s (x21 over 9m59s) kubelet Back-off pulling image "kicbase/echo-server"
Warning Failed 4m52s (x21 over 9m59s) kubelet Error: ImagePullBackOff
functional_test.go:1618: (dbg) Run: kubectl --context functional-593219 logs -l app=hello-node-connect
functional_test.go:1618: (dbg) Non-zero exit: kubectl --context functional-593219 logs -l app=hello-node-connect: exit status 1 (56.1294ms)
** stderr **
Error from server (BadRequest): container "echo-server" in pod "hello-node-connect-7d85dfc575-hf6q5" is waiting to start: trying and failing to pull image
** /stderr **
functional_test.go:1620: "kubectl --context functional-593219 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1622: hello-node logs:
functional_test.go:1624: (dbg) Run: kubectl --context functional-593219 describe svc hello-node-connect
functional_test.go:1628: hello-node svc describe:
Name: hello-node-connect
Namespace: default
Labels: app=hello-node-connect
Annotations: <none>
Selector: app=hello-node-connect
Type: NodePort
IP Family Policy: SingleStack
IP Families: IPv4
IP: 10.110.53.17
IPs: 10.110.53.17
Port: <unset> 8080/TCP
TargetPort: 8080/TCP
NodePort: <unset> 31946/TCP
Endpoints:
Session Affinity: None
External Traffic Policy: Cluster
Internal Traffic Policy: Cluster
Events: <none>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect functional-593219
helpers_test.go:243: (dbg) docker inspect functional-593219:
-- stdout --
[
{
"Id": "3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b",
"Created": "2025-11-22T02:02:00.446713742Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 38481,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:02:00.476042152Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b/hostname",
"HostsPath": "/var/lib/docker/containers/3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b/hosts",
"LogPath": "/var/lib/docker/containers/3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b/3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b-json.log",
"Name": "/functional-593219",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"functional-593219:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "functional-593219",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8441/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4294967296,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8589934592,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "3c223ee3a82f716cd536c93a6a21b98c811e84ed578729cb147692f77be43d7b",
"LowerDir": "/var/lib/docker/overlay2/5ad4827e0757137c5146fe1bdea160e7faca1d74c27fe0015785153819bd0aa0-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/5ad4827e0757137c5146fe1bdea160e7faca1d74c27fe0015785153819bd0aa0/merged",
"UpperDir": "/var/lib/docker/overlay2/5ad4827e0757137c5146fe1bdea160e7faca1d74c27fe0015785153819bd0aa0/diff",
"WorkDir": "/var/lib/docker/overlay2/5ad4827e0757137c5146fe1bdea160e7faca1d74c27fe0015785153819bd0aa0/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "functional-593219",
"Source": "/var/lib/docker/volumes/functional-593219/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "functional-593219",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8441/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "functional-593219",
"name.minikube.sigs.k8s.io": "functional-593219",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "702a065e167718845f0145800d4d00f3e0ad07ea1ebce26d624cce7622039696",
"SandboxKey": "/var/run/docker/netns/702a065e1677",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32778"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32779"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32782"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32780"
}
],
"8441/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32781"
}
]
},
"Networks": {
"functional-593219": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "6f95ec91bc1880db202a95f93dd03ac7382e866e9bf76cab2e05bc9bcafb94b8",
"EndpointID": "3371ede42740ae9171c692f51960a54f86bed952c10be2f954dc4a200513eeaf",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"MacAddress": "f6:da:25:03:30:d4",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"functional-593219",
"3c223ee3a82f"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p functional-593219 -n functional-593219
helpers_test.go:252: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 logs -n 25: (1.148679621s)
helpers_test.go:260: TestFunctional/parallel/ServiceCmdConnect logs:
-- stdout --
==> Audit <==
┌────────────────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ functional-593219 ssh -- ls -la /mount-9p │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ 22 Nov 25 02:03 UTC │
│ ssh │ functional-593219 ssh sudo umount -f /mount-9p │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ mount │ -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount3 --alsologtostderr -v=1 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ ssh │ functional-593219 ssh findmnt -T /mount1 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ mount │ -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount1 --alsologtostderr -v=1 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ mount │ -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount2 --alsologtostderr -v=1 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ ssh │ functional-593219 ssh findmnt -T /mount1 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ 22 Nov 25 02:03 UTC │
│ ssh │ functional-593219 ssh findmnt -T /mount2 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ 22 Nov 25 02:03 UTC │
│ ssh │ functional-593219 ssh findmnt -T /mount3 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ 22 Nov 25 02:03 UTC │
│ mount │ -p functional-593219 --kill=true │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ tunnel │ functional-593219 tunnel --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ tunnel │ functional-593219 tunnel --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ tunnel │ functional-593219 tunnel --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:03 UTC │ │
│ addons │ functional-593219 addons list │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ addons │ functional-593219 addons list -o json │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ image │ functional-593219 image ls --format short --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ ssh │ functional-593219 ssh pgrep buildkitd │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ │
│ image │ functional-593219 image build -t localhost/my-image:functional-593219 testdata/build --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ image │ functional-593219 image ls │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ image │ functional-593219 image ls --format yaml --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ image │ functional-593219 image ls --format json --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ image │ functional-593219 image ls --format table --alsologtostderr │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ update-context │ functional-593219 update-context --alsologtostderr -v=2 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ update-context │ functional-593219 update-context --alsologtostderr -v=2 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
│ update-context │ functional-593219 update-context --alsologtostderr -v=2 │ functional-593219 │ jenkins │ v1.37.0 │ 22 Nov 25 02:04 UTC │ 22 Nov 25 02:04 UTC │
└────────────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:03:49
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:03:49.599236 51244 out.go:360] Setting OutFile to fd 1 ...
I1122 02:03:49.599334 51244 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.599342 51244 out.go:374] Setting ErrFile to fd 2...
I1122 02:03:49.599346 51244 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.599601 51244 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:03:49.600042 51244 out.go:368] Setting JSON to false
I1122 02:03:49.601206 51244 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2773,"bootTime":1763774257,"procs":221,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:03:49.601320 51244 start.go:143] virtualization: kvm guest
I1122 02:03:49.604020 51244 out.go:179] * [functional-593219] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
I1122 02:03:49.605271 51244 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:03:49.605287 51244 notify.go:221] Checking for updates...
I1122 02:03:49.607362 51244 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:03:49.608543 51244 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:03:49.609501 51244 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:03:49.610472 51244 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:03:49.611507 51244 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:03:49.613205 51244 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:03:49.613862 51244 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:03:49.638463 51244 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:03:49.638559 51244 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:03:49.692188 51244 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-11-22 02:03:49.683000737 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:03:49.692292 51244 docker.go:319] overlay module found
I1122 02:03:49.693840 51244 out.go:179] * Utilisation du pilote docker basé sur le profil existant
I1122 02:03:49.694861 51244 start.go:309] selected driver: docker
I1122 02:03:49.694876 51244 start.go:927] validating driver "docker" against &{Name:functional-593219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:functional-593219 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:03:49.694996 51244 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:03:49.696554 51244 out.go:203]
W1122 02:03:49.697529 51244 out.go:285] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
I1122 02:03:49.698704 51244 out.go:203]
==> CRI-O <==
Nov 22 02:04:10 functional-593219 crio[3587]: time="2025-11-22T02:04:10.578828837Z" level=info msg="Pulling image: docker.io/nginx:latest" id=50007480-ee27-4ebb-a6b3-84d13b35edad name=/runtime.v1.ImageService/PullImage
Nov 22 02:04:10 functional-593219 crio[3587]: time="2025-11-22T02:04:10.580394026Z" level=info msg="Trying to access \"docker.io/library/nginx:latest\""
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.190269823Z" level=info msg="Pulled image: docker.io/library/nginx@sha256:5c733364e9a8f7e6d7289ceaad623c6600479fe95c3ab5534f07bfd7416d9541" id=50007480-ee27-4ebb-a6b3-84d13b35edad name=/runtime.v1.ImageService/PullImage
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.19083705Z" level=info msg="Checking image status: docker.io/nginx:latest" id=80244522-d842-4954-bece-d2438695b52a name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.191873259Z" level=info msg="Checking image status: docker.io/nginx" id=b34b4035-3c13-485d-9d59-0ab8d43fb5e6 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.195485377Z" level=info msg="Creating container: default/sp-pod/myfrontend" id=0492f5eb-22db-4856-bf45-637d8bfd3e6b name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.195600623Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.199294103Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.19979385Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.23228614Z" level=info msg="Created container 56d518cee46c33b01cef79f43454e537559b69f27820e78cd1fbdc2baa1c72ce: default/sp-pod/myfrontend" id=0492f5eb-22db-4856-bf45-637d8bfd3e6b name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.233051108Z" level=info msg="Starting container: 56d518cee46c33b01cef79f43454e537559b69f27820e78cd1fbdc2baa1c72ce" id=7903c5e6-9c18-455a-87f8-9802fb51a526 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:04:11 functional-593219 crio[3587]: time="2025-11-22T02:04:11.23532089Z" level=info msg="Started container" PID=8016 containerID=56d518cee46c33b01cef79f43454e537559b69f27820e78cd1fbdc2baa1c72ce description=default/sp-pod/myfrontend id=7903c5e6-9c18-455a-87f8-9802fb51a526 name=/runtime.v1.RuntimeService/StartContainer sandboxID=5c4fd51598c5b489c00bd6f8778ebc8e2a619c378692b5a89b7a4b9f6fd69307
Nov 22 02:04:13 functional-593219 crio[3587]: time="2025-11-22T02:04:13.919471749Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=f4944ad0-f28b-4d9c-9b92-9aa2bc75ff00 name=/runtime.v1.ImageService/PullImage
Nov 22 02:04:21 functional-593219 crio[3587]: time="2025-11-22T02:04:21.919899192Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=cdc72535-4eb9-49bc-8517-e8e12bcefa6a name=/runtime.v1.ImageService/PullImage
Nov 22 02:05:01 functional-593219 crio[3587]: time="2025-11-22T02:05:01.919458858Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=2cff71e0-497f-44bb-a571-99ab23147295 name=/runtime.v1.ImageService/PullImage
Nov 22 02:05:06 functional-593219 crio[3587]: time="2025-11-22T02:05:06.920527278Z" level=info msg="Stopping pod sandbox: 57610f61179d45b861eb4976d191e0e6548cf02d61b598cb4e52fd62acf48407" id=78780eff-bdb9-492b-9631-cec98b96e049 name=/runtime.v1.RuntimeService/StopPodSandbox
Nov 22 02:05:06 functional-593219 crio[3587]: time="2025-11-22T02:05:06.920590993Z" level=info msg="Stopped pod sandbox (already stopped): 57610f61179d45b861eb4976d191e0e6548cf02d61b598cb4e52fd62acf48407" id=78780eff-bdb9-492b-9631-cec98b96e049 name=/runtime.v1.RuntimeService/StopPodSandbox
Nov 22 02:05:06 functional-593219 crio[3587]: time="2025-11-22T02:05:06.920900183Z" level=info msg="Removing pod sandbox: 57610f61179d45b861eb4976d191e0e6548cf02d61b598cb4e52fd62acf48407" id=56099ee8-75ef-4b2d-b2e8-5d69f7c24d46 name=/runtime.v1.RuntimeService/RemovePodSandbox
Nov 22 02:05:06 functional-593219 crio[3587]: time="2025-11-22T02:05:06.923718468Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:05:06 functional-593219 crio[3587]: time="2025-11-22T02:05:06.923778093Z" level=info msg="Removed pod sandbox: 57610f61179d45b861eb4976d191e0e6548cf02d61b598cb4e52fd62acf48407" id=56099ee8-75ef-4b2d-b2e8-5d69f7c24d46 name=/runtime.v1.RuntimeService/RemovePodSandbox
Nov 22 02:05:10 functional-593219 crio[3587]: time="2025-11-22T02:05:10.919425469Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=45a33ed4-75ca-4086-9fbe-84a9ac7a783e name=/runtime.v1.ImageService/PullImage
Nov 22 02:06:22 functional-593219 crio[3587]: time="2025-11-22T02:06:22.91983089Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=4c0328b7-c1f8-4c0f-950b-0c501e2300c6 name=/runtime.v1.ImageService/PullImage
Nov 22 02:06:43 functional-593219 crio[3587]: time="2025-11-22T02:06:43.919852089Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=3d5f6c72-3365-4f45-8678-a2f4a388d5e1 name=/runtime.v1.ImageService/PullImage
Nov 22 02:09:06 functional-593219 crio[3587]: time="2025-11-22T02:09:06.919833001Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=9ee11d00-b806-442a-8d65-eea57beef127 name=/runtime.v1.ImageService/PullImage
Nov 22 02:09:33 functional-593219 crio[3587]: time="2025-11-22T02:09:33.919364837Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=b1bb6ff4-ab1c-43a2-8a44-1e720a8713ea name=/runtime.v1.ImageService/PullImage
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
56d518cee46c3 docker.io/library/nginx@sha256:5c733364e9a8f7e6d7289ceaad623c6600479fe95c3ab5534f07bfd7416d9541 9 minutes ago Running myfrontend 0 5c4fd51598c5b sp-pod default
82f766bb11860 docker.io/library/nginx@sha256:667473807103639a0aca5b49534a216d2b64f0fb868aaa801f023da0cdd781c7 9 minutes ago Running nginx 0 06f31609690de nginx-svc default
a100de298092b docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a 9 minutes ago Running dashboard-metrics-scraper 0 dac3682637793 dashboard-metrics-scraper-77bf4d6c4c-v44hz kubernetes-dashboard
cb20e4af81dd3 docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 9 minutes ago Running kubernetes-dashboard 0 e9a3dc1d83895 kubernetes-dashboard-855c9754f9-fpvk2 kubernetes-dashboard
42f69748a1a00 gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 9 minutes ago Exited mount-munger 0 96c5a840c3dc4 busybox-mount default
3269a438a4cf5 docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da 9 minutes ago Running mysql 0 6b6c87e109666 mysql-5bb876957f-hqzm8 default
2c72051da70e0 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 10 minutes ago Running kube-apiserver 0 c639d66eb8797 kube-apiserver-functional-593219 kube-system
f97cdf62bf620 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 10 minutes ago Running kube-controller-manager 1 2df360c6e012a kube-controller-manager-functional-593219 kube-system
2e3ac3e1ab92f 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 10 minutes ago Running etcd 1 387897b12c01c etcd-functional-593219 kube-system
412ada5b632e0 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 10 minutes ago Running kube-proxy 1 77e8c137f5a90 kube-proxy-h2clf kube-system
be40cd734ce2c 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 10 minutes ago Running kindnet-cni 1 eab25768c2d75 kindnet-xlgmv kube-system
06a8a1aebc3bc 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 10 minutes ago Running kube-scheduler 1 1d5c35ab72f30 kube-scheduler-functional-593219 kube-system
367af1468ca39 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 10 minutes ago Running storage-provisioner 1 b9d190a367f9a storage-provisioner kube-system
9a719235c64c9 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 10 minutes ago Running coredns 1 3ad18a3d663ae coredns-66bc5c9577-9vngr kube-system
87e60a188c0de 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 11 minutes ago Exited coredns 0 3ad18a3d663ae coredns-66bc5c9577-9vngr kube-system
e9dd49b5bda1d 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 11 minutes ago Exited storage-provisioner 0 b9d190a367f9a storage-provisioner kube-system
85dfc032d649b 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 11 minutes ago Exited kindnet-cni 0 eab25768c2d75 kindnet-xlgmv kube-system
d934143a00aa4 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 11 minutes ago Exited kube-proxy 0 77e8c137f5a90 kube-proxy-h2clf kube-system
ab395079d5f9c 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 11 minutes ago Exited kube-scheduler 0 1d5c35ab72f30 kube-scheduler-functional-593219 kube-system
1253082c08313 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 11 minutes ago Exited kube-controller-manager 0 2df360c6e012a kube-controller-manager-functional-593219 kube-system
f40b79cd9d618 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 11 minutes ago Exited etcd 0 387897b12c01c etcd-functional-593219 kube-system
==> coredns [87e60a188c0de6c871ceeeee482e76154962bc736ded24fb576658514bcdc25c] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:46202 - 35790 "HINFO IN 4830866974542367423.433910181437315083. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.16981641s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [9a719235c64c912b75cef5cdd77ccf4f7cf8a50f9cde8f34772b9f756e3b30e9] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:36708 - 31487 "HINFO IN 4719916192037853555.1666028175951605118. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.490211283s
==> describe nodes <==
Name: functional-593219
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=functional-593219
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=functional-593219
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_02_13_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:02:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: functional-593219
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:13:32 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:13:31 +0000 Sat, 22 Nov 2025 02:02:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:13:31 +0000 Sat, 22 Nov 2025 02:02:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:13:31 +0000 Sat, 22 Nov 2025 02:02:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:13:31 +0000 Sat, 22 Nov 2025 02:02:29 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: functional-593219
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 407bb2ea-fd5c-4731-8146-c927742780d0
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (15 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default hello-node-75c85bcc94-s52cn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m57s
default hello-node-connect-7d85dfc575-hf6q5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 10m
default mysql-5bb876957f-hqzm8 600m (7%) 700m (8%) 512Mi (1%) 700Mi (2%) 10m
default nginx-svc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m36s
default sp-pod 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m24s
kube-system coredns-66bc5c9577-9vngr 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 11m
kube-system etcd-functional-593219 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 11m
kube-system kindnet-xlgmv 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 11m
kube-system kube-apiserver-functional-593219 250m (3%) 0 (0%) 0 (0%) 0 (0%) 10m
kube-system kube-controller-manager-functional-593219 200m (2%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-proxy-h2clf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-scheduler-functional-593219 100m (1%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kubernetes-dashboard dashboard-metrics-scraper-77bf4d6c4c-v44hz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m44s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-fpvk2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m44s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1450m (18%) 800m (10%)
memory 732Mi (2%) 920Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 11m kube-proxy
Normal Starting 10m kube-proxy
Normal Starting 11m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 11m kubelet Node functional-593219 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 11m kubelet Node functional-593219 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 11m kubelet Node functional-593219 status is now: NodeHasSufficientPID
Normal RegisteredNode 11m node-controller Node functional-593219 event: Registered Node functional-593219 in Controller
Normal NodeReady 11m kubelet Node functional-593219 status is now: NodeReady
Normal Starting 10m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 10m (x8 over 10m) kubelet Node functional-593219 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 10m (x8 over 10m) kubelet Node functional-593219 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 10m (x8 over 10m) kubelet Node functional-593219 status is now: NodeHasSufficientPID
Normal RegisteredNode 10m node-controller Node functional-593219 event: Registered Node functional-593219 in Controller
==> dmesg <==
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
[Nov22 01:58] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.019095] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000021] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023876] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023874] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023866] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023868] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000009] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +2.047813] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +4.031574] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +8.127154] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 01:59] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
==> etcd [2e3ac3e1ab92f23d2cafe1a337b12f112fbcb18b41ed41175e3a94c7ca47a3ee] <==
{"level":"warn","ts":"2025-11-22T02:03:08.187181Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55524","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.193762Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55546","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.199667Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55564","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.206337Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55582","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.212069Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55590","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.219044Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55604","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.225080Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55612","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.231511Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55622","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.237316Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55640","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.243349Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55668","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.261074Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55690","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.264325Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55698","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.270015Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55714","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.275787Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55740","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:08.325400Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55762","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:03:41.267457Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"174.83502ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128041479428967385 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/endpointslices/default/mysql-7zwv7\" mod_revision:611 > success:<request_put:<key:\"/registry/endpointslices/default/mysql-7zwv7\" value_size:968 >> failure:<request_range:<key:\"/registry/endpointslices/default/mysql-7zwv7\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:03:41.267620Z","caller":"traceutil/trace.go:172","msg":"trace[561073373] transaction","detail":"{read_only:false; response_revision:666; number_of_response:1; }","duration":"223.863419ms","start":"2025-11-22T02:03:41.043724Z","end":"2025-11-22T02:03:41.267587Z","steps":["trace[561073373] 'process raft request' (duration: 48.445651ms)","trace[561073373] 'compare' (duration: 174.754952ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:03:41.267722Z","caller":"traceutil/trace.go:172","msg":"trace[43303143] transaction","detail":"{read_only:false; response_revision:669; number_of_response:1; }","duration":"221.058551ms","start":"2025-11-22T02:03:41.046653Z","end":"2025-11-22T02:03:41.267711Z","steps":["trace[43303143] 'process raft request' (duration: 221.019026ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:03:41.267883Z","caller":"traceutil/trace.go:172","msg":"trace[1026919577] transaction","detail":"{read_only:false; response_revision:668; number_of_response:1; }","duration":"223.533837ms","start":"2025-11-22T02:03:41.044341Z","end":"2025-11-22T02:03:41.267875Z","steps":["trace[1026919577] 'process raft request' (duration: 223.295193ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:03:41.268070Z","caller":"traceutil/trace.go:172","msg":"trace[2011096221] transaction","detail":"{read_only:false; response_revision:667; number_of_response:1; }","duration":"224.16973ms","start":"2025-11-22T02:03:41.043886Z","end":"2025-11-22T02:03:41.268056Z","steps":["trace[2011096221] 'process raft request' (duration: 223.686443ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:03:56.217264Z","caller":"traceutil/trace.go:172","msg":"trace[446037357] transaction","detail":"{read_only:false; response_revision:777; number_of_response:1; }","duration":"112.136168ms","start":"2025-11-22T02:03:56.105114Z","end":"2025-11-22T02:03:56.217250Z","steps":["trace[446037357] 'process raft request' (duration: 112.036833ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:03:56.217256Z","caller":"traceutil/trace.go:172","msg":"trace[1910204503] transaction","detail":"{read_only:false; response_revision:776; number_of_response:1; }","duration":"112.945932ms","start":"2025-11-22T02:03:56.104293Z","end":"2025-11-22T02:03:56.217239Z","steps":["trace[1910204503] 'process raft request' (duration: 112.768495ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:13:07.864978Z","caller":"mvcc/index.go:194","msg":"compact tree index","revision":1129}
{"level":"info","ts":"2025-11-22T02:13:07.883726Z","caller":"mvcc/kvstore_compaction.go:70","msg":"finished scheduled compaction","compact-revision":1129,"took":"18.407715ms","hash":681011944,"current-db-size-bytes":3465216,"current-db-size":"3.5 MB","current-db-size-in-use-bytes":1564672,"current-db-size-in-use":"1.6 MB"}
{"level":"info","ts":"2025-11-22T02:13:07.883767Z","caller":"mvcc/hash.go:157","msg":"storing new hash","hash":681011944,"revision":1129,"compact-revision":-1}
==> etcd [f40b79cd9d61873df95ce409c133ea2b90f3db1101da05886f1c59a0bf511f2b] <==
{"level":"warn","ts":"2025-11-22T02:02:10.170915Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54448","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.176874Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54464","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.182666Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54482","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.197683Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54496","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.205371Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54524","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.212079Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54542","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:02:10.259152Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54564","server-name":"","error":"EOF"}
{"level":"info","ts":"2025-11-22T02:03:04.940875Z","caller":"osutil/interrupt_unix.go:65","msg":"received signal; shutting down","signal":"terminated"}
{"level":"info","ts":"2025-11-22T02:03:04.940968Z","caller":"embed/etcd.go:426","msg":"closing etcd server","name":"functional-593219","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}
{"level":"error","ts":"2025-11-22T02:03:04.941060Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"http: Server closed","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*serveCtx).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/serve.go:90"}
{"level":"error","ts":"2025-11-22T02:03:04.942511Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"http: Server closed","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*serveCtx).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/serve.go:90"}
{"level":"error","ts":"2025-11-22T02:03:04.942585Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:2381: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
{"level":"info","ts":"2025-11-22T02:03:04.942593Z","caller":"etcdserver/server.go:1281","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}
{"level":"info","ts":"2025-11-22T02:03:04.942652Z","caller":"etcdserver/server.go:2342","msg":"server has stopped; stopping storage version's monitor"}
{"level":"info","ts":"2025-11-22T02:03:04.942670Z","caller":"etcdserver/server.go:2319","msg":"server has stopped; stopping cluster version's monitor"}
{"level":"warn","ts":"2025-11-22T02:03:04.942664Z","caller":"embed/serve.go:245","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"warn","ts":"2025-11-22T02:03:04.942699Z","caller":"embed/serve.go:245","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}
{"level":"warn","ts":"2025-11-22T02:03:04.942710Z","caller":"embed/serve.go:247","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"warn","ts":"2025-11-22T02:03:04.942717Z","caller":"embed/serve.go:247","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}
{"level":"error","ts":"2025-11-22T02:03:04.942720Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:2379: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
{"level":"error","ts":"2025-11-22T02:03:04.942729Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 192.168.49.2:2379: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
{"level":"info","ts":"2025-11-22T02:03:04.944656Z","caller":"embed/etcd.go:621","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}
{"level":"error","ts":"2025-11-22T02:03:04.944715Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 192.168.49.2:2380: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
{"level":"info","ts":"2025-11-22T02:03:04.944746Z","caller":"embed/etcd.go:626","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2025-11-22T02:03:04.944760Z","caller":"embed/etcd.go:428","msg":"closed etcd server","name":"functional-593219","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}
==> kernel <==
02:13:34 up 55 min, 0 user, load average: 0.13, 0.18, 0.30
Linux functional-593219 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [85dfc032d649b48b9e7b36a3078be235c08ece08eb862280de45e024bb47cccd] <==
I1122 02:02:19.020217 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:02:19.020514 1 main.go:139] hostIP = 192.168.49.2
podIP = 192.168.49.2
I1122 02:02:19.020676 1 main.go:148] setting mtu 1500 for CNI
I1122 02:02:19.020696 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:02:19.020723 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:02:19Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:02:19.296023 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:02:19.296072 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:02:19.296231 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:02:19.296431 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:02:19.496521 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:02:19.496545 1 metrics.go:72] Registering metrics
I1122 02:02:19.496614 1 controller.go:711] "Syncing nftables rules"
I1122 02:02:29.203842 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:02:29.203950 1 main.go:301] handling current node
I1122 02:02:39.209973 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:02:39.210001 1 main.go:301] handling current node
I1122 02:02:49.207963 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:02:49.207993 1 main.go:301] handling current node
==> kindnet [be40cd734ce2ce4efbd1c06d42fae374307498e2f584d12fd5a158f497e9833a] <==
I1122 02:11:25.519444 1 main.go:301] handling current node
I1122 02:11:35.524539 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:11:35.524572 1 main.go:301] handling current node
I1122 02:11:45.518967 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:11:45.519003 1 main.go:301] handling current node
I1122 02:11:55.518601 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:11:55.518625 1 main.go:301] handling current node
I1122 02:12:05.526186 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:05.526214 1 main.go:301] handling current node
I1122 02:12:15.519075 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:15.519116 1 main.go:301] handling current node
I1122 02:12:25.518467 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:25.518497 1 main.go:301] handling current node
I1122 02:12:35.521404 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:35.521442 1 main.go:301] handling current node
I1122 02:12:45.519212 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:45.519253 1 main.go:301] handling current node
I1122 02:12:55.527358 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:12:55.527388 1 main.go:301] handling current node
I1122 02:13:05.521414 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:13:05.521443 1 main.go:301] handling current node
I1122 02:13:15.519421 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:13:15.519455 1 main.go:301] handling current node
I1122 02:13:25.518868 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1122 02:13:25.518940 1 main.go:301] handling current node
==> kube-apiserver [2c72051da70e04b1bd66fbfca8fde68618b532beea67428cab4fd513ce2a3020] <==
I1122 02:03:08.807059 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:03:08.912451 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:03:08.912451 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:03:09.665135 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
W1122 02:03:09.870227 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
I1122 02:03:09.871317 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:03:09.875191 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:03:10.256498 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:03:10.342799 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:03:10.382986 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:03:10.387290 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:03:12.019238 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:03:29.339039 1 alloc.go:328] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.103.227.230"}
I1122 02:03:33.212000 1 alloc.go:328] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.110.53.17"}
I1122 02:03:33.779519 1 alloc.go:328] "allocated clusterIPs" service="default/mysql" clusterIPs={"IPv4":"10.110.243.171"}
I1122 02:03:37.893651 1 alloc.go:328] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.96.221.121"}
E1122 02:03:47.906313 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:36246: use of closed network connection
E1122 02:03:49.163663 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:36258: use of closed network connection
I1122 02:03:50.626566 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:03:50.743159 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.102.168.133"}
I1122 02:03:50.752192 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.110.16.53"}
I1122 02:03:58.410852 1 alloc.go:328] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.98.244.227"}
E1122 02:04:09.371443 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:51574: use of closed network connection
E1122 02:04:18.337265 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:38892: use of closed network connection
I1122 02:13:08.696772 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
==> kube-controller-manager [1253082c083137a752b0249a1bfd93e4e6c4db3d2097d8524272afc2852f88b5] <==
I1122 02:02:17.629672 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:02:17.630695 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:02:17.630719 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:02:17.630779 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:02:17.630731 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:02:17.630742 1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
I1122 02:02:17.630769 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:02:17.630753 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:02:17.631146 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:02:17.631259 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:02:17.631269 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:02:17.631319 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:02:17.631416 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:02:17.633092 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:02:17.633263 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:02:17.633375 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:02:17.633509 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:02:17.633549 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:02:17.633558 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:02:17.633565 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:02:17.638468 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:02:17.640274 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="functional-593219" podCIDRs=["10.244.0.0/24"]
I1122 02:02:17.644018 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:02:17.646254 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:02:32.632288 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-controller-manager [f97cdf62bf620948c216ac1138b2d3800df7af9384c4a9fff1be1273a186ffb8] <==
I1122 02:03:11.615849 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:03:11.616168 1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
I1122 02:03:11.616507 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:03:11.616515 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:03:11.616797 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:03:11.617393 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:03:11.619108 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:03:11.620250 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 02:03:11.620983 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:03:11.623462 1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
I1122 02:03:11.624571 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:03:11.625769 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:03:11.626937 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:03:11.628053 1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
I1122 02:03:11.630323 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:03:11.633588 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:03:11.634702 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:03:11.637954 1 shared_informer.go:356] "Caches are synced" controller="disruption"
I1122 02:03:11.639169 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
I1122 02:03:11.643388 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
E1122 02:03:50.681336 1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
E1122 02:03:50.690198 1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
E1122 02:03:50.700357 1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
E1122 02:03:50.703178 1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-855c9754f9\" failed with pods \"kubernetes-dashboard-855c9754f9-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
E1122 02:03:50.704305 1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
==> kube-proxy [412ada5b632e0509b154edb0b9108fb1ddd55f973f3ed199f6a98e6d22608f80] <==
I1122 02:02:55.244502 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
E1122 02:02:55.245414 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-593219&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:02:56.736294 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-593219&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:02:59.501427 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-593219&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:03:04.831184 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-593219&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
I1122 02:03:13.245384 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:03:13.245425 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
E1122 02:03:13.245519 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:03:13.263657 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:03:13.263704 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:03:13.268954 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:03:13.269274 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:03:13.269308 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:03:13.270411 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:03:13.270449 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:03:13.270457 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:03:13.270460 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:03:13.270509 1 config.go:309] "Starting node config controller"
I1122 02:03:13.270523 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:03:13.270529 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:03:13.270552 1 config.go:200] "Starting service config controller"
I1122 02:03:13.270557 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:03:13.371097 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:03:13.371097 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:03:13.371131 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-proxy [d934143a00aa4a6bbaef4ed1d299853027afe1e5f9a1ec43385b23cb8b51df07] <==
I1122 02:02:18.859810 1 server_linux.go:53] "Using iptables proxy"
I1122 02:02:18.931485 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:02:19.031645 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:02:19.031674 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
E1122 02:02:19.031787 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:02:19.052062 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:02:19.052130 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:02:19.057944 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:02:19.058338 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:02:19.058378 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:02:19.061247 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:02:19.061269 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:02:19.061291 1 config.go:309] "Starting node config controller"
I1122 02:02:19.061304 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:02:19.061343 1 config.go:200] "Starting service config controller"
I1122 02:02:19.061359 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:02:19.061372 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:02:19.061379 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:02:19.161963 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:02:19.161976 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:02:19.162001 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:02:19.162019 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [06a8a1aebc3bcd64136ff6350806bf49183d466013f7dbd10423b07d7daeb4a1] <==
E1122 02:03:00.328486 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/resourceslices?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:03:00.386017 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: Get \"https://192.168.49.2:8441/apis/apps/v1/statefulsets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:03:00.430614 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/volumeattachments?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:03:00.511013 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: Get \"https://192.168.49.2:8441/apis/apps/v1/replicasets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:03:00.636977 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: Get \"https://192.168.49.2:8441/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:03:03.015151 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://192.168.49.2:8441/api/v1/services?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:03:03.020550 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: Get \"https://192.168.49.2:8441/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:03:03.207608 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: Get \"https://192.168.49.2:8441/api/v1/persistentvolumes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:03:03.865573 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: Get \"https://192.168.49.2:8441/apis/apps/v1/statefulsets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:03:03.996250 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://192.168.49.2:8441/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:03:04.006679 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:03:04.140677 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:03:04.245548 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: Get \"https://192.168.49.2:8441/apis/apps/v1/replicasets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:03:04.247088 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/deviceclasses?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:03:04.572361 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/volumeattachments?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:03:05.074365 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: Get \"https://192.168.49.2:8441/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:03:05.244742 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:03:05.572170 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: Get \"https://192.168.49.2:8441/api/v1/pods?fieldSelector=status.phase%21%3DSucceeded%2Cstatus.phase%21%3DFailed&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:03:05.659732 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/resourceclaims?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:03:05.688095 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: Get \"https://192.168.49.2:8441/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:03:05.812988 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: Get \"https://192.168.49.2:8441/api/v1/replicationcontrollers?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:03:06.074143 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://192.168.49.2:8441/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:03:06.348993 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:03:06.356319 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/resourceslices?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
I1122 02:03:17.622023 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kube-scheduler [ab395079d5f9c992c32d1a26a6fb93bc4c123f04d9ec129920864c6446627f27] <==
E1122 02:02:10.644671 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:02:10.644735 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:02:10.644756 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:02:10.644784 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:02:10.644815 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:02:10.644888 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:02:10.644921 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:02:10.644923 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:02:10.644930 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:02:10.645012 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:02:10.645012 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:02:10.645084 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:02:10.645132 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:02:11.706569 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:02:11.833773 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:02:11.841746 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:02:11.847619 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:02:11.917334 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
I1122 02:02:13.842365 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:02:54.210243 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:02:54.210489 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"
I1122 02:02:54.210545 1 secure_serving.go:259] Stopped listening on 127.0.0.1:10259
I1122 02:02:54.210571 1 server.go:263] "[graceful-termination] secure server has stopped listening"
I1122 02:02:54.210597 1 server.go:265] "[graceful-termination] secure server is exiting"
E1122 02:02:54.210632 1 run.go:72] "command failed" err="finished without leader elect"
==> kubelet <==
Nov 22 02:10:46 functional-593219 kubelet[4140]: E1122 02:10:46.919211 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:10:55 functional-593219 kubelet[4140]: E1122 02:10:55.919576 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:10:58 functional-593219 kubelet[4140]: E1122 02:10:58.919406 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:11:09 functional-593219 kubelet[4140]: E1122 02:11:09.918658 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:11:09 functional-593219 kubelet[4140]: E1122 02:11:09.918742 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:11:21 functional-593219 kubelet[4140]: E1122 02:11:21.919068 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:11:23 functional-593219 kubelet[4140]: E1122 02:11:23.919215 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:11:34 functional-593219 kubelet[4140]: E1122 02:11:34.919207 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:11:35 functional-593219 kubelet[4140]: E1122 02:11:35.919045 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:11:49 functional-593219 kubelet[4140]: E1122 02:11:49.919544 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:11:49 functional-593219 kubelet[4140]: E1122 02:11:49.919666 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:12:02 functional-593219 kubelet[4140]: E1122 02:12:02.918729 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:12:04 functional-593219 kubelet[4140]: E1122 02:12:04.918809 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:12:16 functional-593219 kubelet[4140]: E1122 02:12:16.919523 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:12:17 functional-593219 kubelet[4140]: E1122 02:12:17.919077 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:12:31 functional-593219 kubelet[4140]: E1122 02:12:31.919071 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:12:32 functional-593219 kubelet[4140]: E1122 02:12:32.919132 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:12:45 functional-593219 kubelet[4140]: E1122 02:12:45.919738 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:12:45 functional-593219 kubelet[4140]: E1122 02:12:45.919778 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:12:57 functional-593219 kubelet[4140]: E1122 02:12:57.919076 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:12:57 functional-593219 kubelet[4140]: E1122 02:12:57.919079 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:13:10 functional-593219 kubelet[4140]: E1122 02:13:10.919523 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
Nov 22 02:13:10 functional-593219 kubelet[4140]: E1122 02:13:10.919616 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:13:23 functional-593219 kubelet[4140]: E1122 02:13:23.919621 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-75c85bcc94-s52cn" podUID="27638406-9d26-46b7-aa98-c03d9fd51f08"
Nov 22 02:13:25 functional-593219 kubelet[4140]: E1122 02:13:25.918798 4140 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list\"" pod="default/hello-node-connect-7d85dfc575-hf6q5" podUID="6578e4f4-bcc1-4eee-aadc-d57190cfe987"
==> kubernetes-dashboard [cb20e4af81dd3e4264474402fa625e0fbe02de3795b4fcaf756e9b4f46e7708d] <==
2025/11/22 02:03:54 Using namespace: kubernetes-dashboard
2025/11/22 02:03:54 Using in-cluster config to connect to apiserver
2025/11/22 02:03:54 Using secret token for csrf signing
2025/11/22 02:03:54 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:03:54 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:03:54 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:03:54 Generating JWE encryption key
2025/11/22 02:03:54 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:03:54 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:03:54 Initializing JWE encryption key from synchronized object
2025/11/22 02:03:54 Creating in-cluster Sidecar client
2025/11/22 02:03:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:03:54 Serving insecurely on HTTP port: 9090
2025/11/22 02:04:24 Successful request to sidecar
2025/11/22 02:03:54 Starting overwatch
==> storage-provisioner [367af1468ca39d9a6ae87bb78c53c8a09df7356030977e12b71ad119207c147f] <==
W1122 02:13:09.753597 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:11.755637 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:11.758978 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:13.761442 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:13.765961 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:15.769054 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:15.772664 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:17.775379 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:17.779022 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:19.781563 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:19.784815 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:21.787264 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:21.791237 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:23.793845 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:23.797390 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:25.799517 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:25.803058 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:27.805489 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:27.810174 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:29.813071 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:29.816718 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:31.819386 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:31.822775 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:33.826053 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:13:33.830060 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
==> storage-provisioner [e9dd49b5bda1dcb795dc9d9eece78c3c0c58ee073163ee8503c0a0adec4abd9e] <==
W1122 02:02:30.048198 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:30.051463 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:02:30.146962 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-593219_f0d8a0e1-e08e-4125-bfc6-213362a30a17!
W1122 02:02:32.054358 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:32.058019 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:34.061168 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:34.065726 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:36.068389 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:36.072397 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:38.075188 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:38.079017 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:40.082190 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:40.087500 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:42.090274 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:42.094111 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:44.096799 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:44.101091 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:46.104201 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:46.108705 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:48.111972 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:48.115611 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:50.118421 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:50.122268 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:52.124507 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:02:52.127570 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-593219 -n functional-593219
helpers_test.go:269: (dbg) Run: kubectl --context functional-593219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: busybox-mount hello-node-75c85bcc94-s52cn hello-node-connect-7d85dfc575-hf6q5
helpers_test.go:282: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context functional-593219 describe pod busybox-mount hello-node-75c85bcc94-s52cn hello-node-connect-7d85dfc575-hf6q5
helpers_test.go:290: (dbg) kubectl --context functional-593219 describe pod busybox-mount hello-node-75c85bcc94-s52cn hello-node-connect-7d85dfc575-hf6q5:
-- stdout --
Name: busybox-mount
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:46 +0000
Labels: integration-test=busybox-mount
Annotations: <none>
Status: Succeeded
IP: 10.244.0.7
IPs:
IP: 10.244.0.7
Containers:
mount-munger:
Container ID: cri-o://42f69748a1a00b247cea5a6c6b221dbcaf10d700a7fdf34f02776afa820c54b7
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID: gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
Port: <none>
Host Port: <none>
Command:
/bin/sh
-c
--
Args:
cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates
State: Terminated
Reason: Completed
Exit Code: 0
Started: Sat, 22 Nov 2025 02:03:47 +0000
Finished: Sat, 22 Nov 2025 02:03:47 +0000
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/mount-9p from test-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-zrdss (ro)
Conditions:
Type Status
PodReadyToStartContainers False
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
test-volume:
Type: HostPath (bare host directory volume)
Path: /mount-9p
HostPathType:
kube-api-access-zrdss:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m49s default-scheduler Successfully assigned default/busybox-mount to functional-593219
Normal Pulling 9m49s kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Normal Pulled 9m48s kubelet Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 649ms (649ms including waiting). Image size: 4631262 bytes.
Normal Created 9m48s kubelet Created container: mount-munger
Normal Started 9m48s kubelet Started container mount-munger
Name: hello-node-75c85bcc94-s52cn
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:37 +0000
Labels: app=hello-node
pod-template-hash=75c85bcc94
Annotations: <none>
Status: Pending
IP: 10.244.0.6
IPs:
IP: 10.244.0.6
Controlled By: ReplicaSet/hello-node-75c85bcc94
Containers:
echo-server:
Container ID:
Image: kicbase/echo-server
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tbfpw (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-tbfpw:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m58s default-scheduler Successfully assigned default/hello-node-75c85bcc94-s52cn to functional-593219
Normal Pulling 6m52s (x5 over 9m55s) kubelet Pulling image "kicbase/echo-server"
Warning Failed 6m52s (x5 over 9m55s) kubelet Failed to pull image "kicbase/echo-server": short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list
Warning Failed 6m52s (x5 over 9m55s) kubelet Error: ErrImagePull
Normal BackOff 4m44s (x21 over 9m54s) kubelet Back-off pulling image "kicbase/echo-server"
Warning Failed 4m44s (x21 over 9m54s) kubelet Error: ImagePullBackOff
Name: hello-node-connect-7d85dfc575-hf6q5
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:33 +0000
Labels: app=hello-node-connect
pod-template-hash=7d85dfc575
Annotations: <none>
Status: Pending
IP: 10.244.0.4
IPs:
IP: 10.244.0.4
Controlled By: ReplicaSet/hello-node-connect-7d85dfc575
Containers:
echo-server:
Container ID:
Image: kicbase/echo-server
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wcb6c (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-wcb6c:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned default/hello-node-connect-7d85dfc575-hf6q5 to functional-593219
Normal Pulling 7m13s (x5 over 10m) kubelet Pulling image "kicbase/echo-server"
Warning Failed 7m13s (x5 over 10m) kubelet Failed to pull image "kicbase/echo-server": short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list
Warning Failed 7m13s (x5 over 10m) kubelet Error: ErrImagePull
Normal BackOff 4m54s (x21 over 10m) kubelet Back-off pulling image "kicbase/echo-server"
Warning Failed 4m54s (x21 over 10m) kubelet Error: ImagePullBackOff
-- /stdout --
helpers_test.go:293: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (602.74s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:370: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image load --daemon kicbase/echo-server:functional-593219 --alsologtostderr
functional_test.go:370: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 image load --daemon kicbase/echo-server:functional-593219 --alsologtostderr: (1.954433119s)
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls
functional_test.go:466: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 image ls: (2.312937842s)
functional_test.go:461: expected "kicbase/echo-server:functional-593219" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.27s)
=== RUN TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1451: (dbg) Run: kubectl --context functional-593219 create deployment hello-node --image kicbase/echo-server
functional_test.go:1455: (dbg) Run: kubectl --context functional-593219 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1460: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:352: "hello-node-75c85bcc94-s52cn" [27638406-9d26-46b7-aa98-c03d9fd51f08] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
functional_test.go:1460: ***** TestFunctional/parallel/ServiceCmd/DeployApp: pod "app=hello-node" failed to start within 10m0s: context deadline exceeded ****
functional_test.go:1460: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-593219 -n functional-593219
functional_test.go:1460: TestFunctional/parallel/ServiceCmd/DeployApp: showing logs for failed pods as of 2025-11-22 02:13:38.201124084 +0000 UTC m=+1065.876627618
functional_test.go:1460: (dbg) Run: kubectl --context functional-593219 describe po hello-node-75c85bcc94-s52cn -n default
functional_test.go:1460: (dbg) kubectl --context functional-593219 describe po hello-node-75c85bcc94-s52cn -n default:
Name: hello-node-75c85bcc94-s52cn
Namespace: default
Priority: 0
Service Account: default
Node: functional-593219/192.168.49.2
Start Time: Sat, 22 Nov 2025 02:03:37 +0000
Labels: app=hello-node
pod-template-hash=75c85bcc94
Annotations: <none>
Status: Pending
IP: 10.244.0.6
IPs:
IP: 10.244.0.6
Controlled By: ReplicaSet/hello-node-75c85bcc94
Containers:
echo-server:
Container ID:
Image: kicbase/echo-server
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tbfpw (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-tbfpw:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned default/hello-node-75c85bcc94-s52cn to functional-593219
Normal Pulling 6m55s (x5 over 9m58s) kubelet Pulling image "kicbase/echo-server"
Warning Failed 6m55s (x5 over 9m58s) kubelet Failed to pull image "kicbase/echo-server": short name mode is enforcing, but image name kicbase/echo-server:latest returns ambiguous list
Warning Failed 6m55s (x5 over 9m58s) kubelet Error: ErrImagePull
Normal BackOff 4m47s (x21 over 9m57s) kubelet Back-off pulling image "kicbase/echo-server"
Warning Failed 4m47s (x21 over 9m57s) kubelet Error: ImagePullBackOff
functional_test.go:1460: (dbg) Run: kubectl --context functional-593219 logs hello-node-75c85bcc94-s52cn -n default
functional_test.go:1460: (dbg) Non-zero exit: kubectl --context functional-593219 logs hello-node-75c85bcc94-s52cn -n default: exit status 1 (58.209488ms)
** stderr **
Error from server (BadRequest): container "echo-server" in pod "hello-node-75c85bcc94-s52cn" is waiting to start: trying and failing to pull image
** /stderr **
functional_test.go:1460: kubectl --context functional-593219 logs hello-node-75c85bcc94-s52cn -n default: exit status 1
functional_test.go:1461: failed waiting for hello-node pod: app=hello-node within 10m0s: context deadline exceeded
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (600.58s)
=== RUN TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:380: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image load --daemon kicbase/echo-server:functional-593219 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls
functional_test.go:461: expected "kicbase/echo-server:functional-593219" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.87s)
=== RUN TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:250: (dbg) Run: docker pull kicbase/echo-server:latest
functional_test.go:255: (dbg) Run: docker tag kicbase/echo-server:latest kicbase/echo-server:functional-593219
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image load --daemon kicbase/echo-server:functional-593219 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls
functional_test.go:461: expected "kicbase/echo-server:functional-593219" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.23s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:395: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image save kicbase/echo-server:functional-593219 /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar --alsologtostderr
functional_test.go:401: expected "/home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.27s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:424: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image load /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar --alsologtostderr
functional_test.go:426: loading image into minikube from file: <nil>
** stderr **
I1122 02:03:42.979093 49659 out.go:360] Setting OutFile to fd 1 ...
I1122 02:03:42.979380 49659 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:42.979390 49659 out.go:374] Setting ErrFile to fd 2...
I1122 02:03:42.979394 49659 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:42.979587 49659 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:03:42.980146 49659 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:03:42.980235 49659 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:03:42.980591 49659 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:03:42.998307 49659 ssh_runner.go:195] Run: systemctl --version
I1122 02:03:42.998350 49659 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:03:43.016086 49659 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:03:43.107763 49659 cache_images.go:291] Loading image from: /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar
W1122 02:03:43.107822 49659 cache_images.go:255] Failed to load cached images for "functional-593219": loading images: stat /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar: no such file or directory
I1122 02:03:43.107844 49659 cache_images.go:267] failed pushing to: functional-593219
** /stderr **
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.19s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:434: (dbg) Run: docker rmi kicbase/echo-server:functional-593219
functional_test.go:439: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image save --daemon kicbase/echo-server:functional-593219 --alsologtostderr
functional_test.go:447: (dbg) Run: docker image inspect localhost/kicbase/echo-server:functional-593219
functional_test.go:447: (dbg) Non-zero exit: docker image inspect localhost/kicbase/echo-server:functional-593219: exit status 1 (15.2778ms)
-- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: No such image: localhost/kicbase/echo-server:functional-593219
** /stderr **
functional_test.go:449: expected image to be loaded into Docker, but image was not found: exit status 1
-- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: No such image: localhost/kicbase/echo-server:functional-593219
** /stderr **
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.33s)
=== RUN TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1519: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 service --namespace=default --https --url hello-node
functional_test.go:1519: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 service --namespace=default --https --url hello-node: exit status 115 (518.874238ms)
-- stdout --
https://192.168.49.2:30315
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_3af0dd3f106bd0c134df3d834cbdbb288a06d35d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:1521: failed to get service url. args "out/minikube-linux-amd64 -p functional-593219 service --namespace=default --https --url hello-node" : exit status 115
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.52s)
=== RUN TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1550: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 service hello-node --url --format={{.IP}}
functional_test.go:1550: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 service hello-node --url --format={{.IP}}: exit status 115 (514.546357ms)
-- stdout --
192.168.49.2
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_7cc4328ee572bf2be3730700e5bda4ff5ee9066f_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:1552: failed to get service url with custom format. args "out/minikube-linux-amd64 -p functional-593219 service hello-node --url --format={{.IP}}": exit status 115
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.51s)
=== RUN TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1569: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 service hello-node --url
functional_test.go:1569: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 service hello-node --url: exit status 115 (528.195542ms)
-- stdout --
http://192.168.49.2:30315
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_7cc4328ee572bf2be3730700e5bda4ff5ee9066f_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:1571: failed to get service url. args: "out/minikube-linux-amd64 -p functional-593219 service hello-node --url": exit status 115
functional_test.go:1575: found endpoint for hello-node: http://192.168.49.2:30315
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.53s)
=== RUN TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 pause -p json-output-681136 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p json-output-681136 --output=json --user=testUser: exit status 80 (1.90132939s)
-- stdout --
{"specversion":"1.0","id":"d4f479b9-3f86-4bbf-8940-896b2fcadfc6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"Pausing node json-output-681136 ...","name":"Pausing","totalsteps":"1"}}
{"specversion":"1.0","id":"ba66a55d-f111-4d09-87ba-8ae2e111081c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"Pause: list running: runc: sudo runc list -f json: Process exited with status 1\nstdout:\n\nstderr:\ntime=\"2025-11-22T02:24:26Z\" level=error msg=\"open /run/runc: no such file or directory\"","name":"GUEST_PAUSE","url":""}}
{"specversion":"1.0","id":"e8336d99-58a3-461d-b7ea-6f78b9acda3f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│ │\n│ If the above advice does not help, please let us know: │\n│ https://github.com/kubernetes/minikube/issues/new/choose │\n│ │\n│ Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │\n│ Please also attach the following f
ile to the GitHub issue: │\n│ - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │\n│ │\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-linux-amd64 pause -p json-output-681136 --output=json --user=testUser": exit status 80
--- FAIL: TestJSONOutput/pause/Command (1.90s)
=== RUN TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 unpause -p json-output-681136 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-linux-amd64 unpause -p json-output-681136 --output=json --user=testUser: exit status 80 (1.801854372s)
-- stdout --
{"specversion":"1.0","id":"11fde5d4-6100-405c-a60d-df842c9472b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"Unpausing node json-output-681136 ...","name":"Unpausing","totalsteps":"1"}}
{"specversion":"1.0","id":"e1d71d73-03cf-443b-b6e4-5aa2b0109957","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"Pause: list paused: runc: sudo runc list -f json: Process exited with status 1\nstdout:\n\nstderr:\ntime=\"2025-11-22T02:24:28Z\" level=error msg=\"open /run/runc: no such file or directory\"","name":"GUEST_UNPAUSE","url":""}}
{"specversion":"1.0","id":"54cdf4e9-db76-4df3-b401-71aefb2eb77a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│ │\n│ If the above advice does not help, please let us know: │\n│ https://github.com/kubernetes/minikube/issues/new/choose │\n│ │\n│ Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │\n│ Please also attach the following f
ile to the GitHub issue: │\n│ - /tmp/minikube_unpause_85c908ac827001a7ced33feb0caf7da086d17584_0.log │\n│ │\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-linux-amd64 unpause -p json-output-681136 --output=json --user=testUser": exit status 80
--- FAIL: TestJSONOutput/unpause/Command (1.80s)
=== RUN TestPreload
preload_test.go:43: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-564056 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.32.0
preload_test.go:43: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-564056 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.32.0: (49.142484396s)
preload_test.go:51: (dbg) Run: out/minikube-linux-amd64 -p test-preload-564056 image pull gcr.io/k8s-minikube/busybox
preload_test.go:57: (dbg) Run: out/minikube-linux-amd64 stop -p test-preload-564056
preload_test.go:57: (dbg) Done: out/minikube-linux-amd64 stop -p test-preload-564056: (5.809858132s)
preload_test.go:65: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio
E1122 02:34:56.282723 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:36:09.320369 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:38:06.245594 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:38:33.219443 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
preload_test.go:65: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio: exit status 80 (6m9.473874799s)
-- stdout --
* [test-preload-564056] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.34.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.34.1
* Using the docker driver based on existing profile
* Starting "test-preload-564056" primary control-plane node in "test-preload-564056" cluster
* Pulling base image v0.0.48-1763507788-21924 ...
* Downloading Kubernetes v1.32.0 preload ...
* Preparing Kubernetes v1.32.0 on CRI-O 1.34.2 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons:
-- /stdout --
** stderr **
I1122 02:34:46.597456 176089 out.go:360] Setting OutFile to fd 1 ...
I1122 02:34:46.597563 176089 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:34:46.597577 176089 out.go:374] Setting ErrFile to fd 2...
I1122 02:34:46.597583 176089 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:34:46.597797 176089 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:34:46.598302 176089 out.go:368] Setting JSON to false
I1122 02:34:46.599256 176089 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":4630,"bootTime":1763774257,"procs":202,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:34:46.599335 176089 start.go:143] virtualization: kvm guest
I1122 02:34:46.601053 176089 out.go:179] * [test-preload-564056] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:34:46.602128 176089 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:34:46.602126 176089 notify.go:221] Checking for updates...
I1122 02:34:46.604127 176089 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:34:46.605150 176089 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:46.606211 176089 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:34:46.607171 176089 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:34:46.608188 176089 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:34:46.609417 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:46.610962 176089 out.go:179] * Kubernetes 1.34.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.34.1
I1122 02:34:46.611819 176089 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:34:46.634831 176089 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:34:46.634895 176089 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:34:46.690530 176089 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-11-22 02:34:46.68076684 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:34:46.690645 176089 docker.go:319] overlay module found
I1122 02:34:46.692047 176089 out.go:179] * Using the docker driver based on existing profile
I1122 02:34:46.692945 176089 start.go:309] selected driver: docker
I1122 02:34:46.692963 176089 start.go:927] validating driver "docker" against &{Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServ
erName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fal
se DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:46.693062 176089 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:34:46.693603 176089 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:34:46.746361 176089 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-11-22 02:34:46.736743894 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:34:46.746652 176089 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:34:46.746697 176089 cni.go:84] Creating CNI manager for ""
I1122 02:34:46.746754 176089 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:34:46.746808 176089 start.go:353] cluster config:
{Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont
ainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVM
netClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:46.748233 176089 out.go:179] * Starting "test-preload-564056" primary control-plane node in "test-preload-564056" cluster
I1122 02:34:46.749233 176089 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:34:46.750167 176089 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:34:46.751031 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:46.751113 176089 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:34:46.770015 176089 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:34:46.770038 176089 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:34:46.775669 176089 preload.go:148] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.0/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4
I1122 02:34:46.775686 176089 cache.go:65] Caching tarball of preloaded images
I1122 02:34:46.775837 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:46.777044 176089 out.go:179] * Downloading Kubernetes v1.32.0 preload ...
I1122 02:34:46.777852 176089 preload.go:318] getting checksum for preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4 from gcs api...
I1122 02:34:46.806377 176089 preload.go:295] Got checksum from GCS API "2acdb4dde52794f2167c79dcee7507ae"
I1122 02:34:46.806406 176089 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.0/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4?checksum=md5:2acdb4dde52794f2167c79dcee7507ae -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4
I1122 02:34:49.270801 176089 cache.go:68] Finished verifying existence of preloaded tar for v1.32.0 on crio
I1122 02:34:49.270963 176089 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/config.json ...
I1122 02:34:49.271169 176089 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:34:49.271205 176089 start.go:360] acquireMachinesLock for test-preload-564056: {Name:mkacb9e8b79a32ce084952488aa19f5b1b58b04a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:34:49.271295 176089 start.go:364] duration metric: took 52.463µs to acquireMachinesLock for "test-preload-564056"
I1122 02:34:49.271319 176089 start.go:96] Skipping create...Using existing machine configuration
I1122 02:34:49.271327 176089 fix.go:54] fixHost starting:
I1122 02:34:49.271539 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:49.288382 176089 fix.go:112] recreateIfNeeded on test-preload-564056: state=Stopped err=<nil>
W1122 02:34:49.288407 176089 fix.go:138] unexpected machine state, will restart: <nil>
I1122 02:34:49.289938 176089 out.go:252] * Restarting existing docker container for "test-preload-564056" ...
I1122 02:34:49.290006 176089 cli_runner.go:164] Run: docker start test-preload-564056
I1122 02:34:49.534537 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:49.551573 176089 kic.go:430] container "test-preload-564056" state is running.
I1122 02:34:49.552045 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:49.568529 176089 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/config.json ...
I1122 02:34:49.568755 176089 machine.go:94] provisionDockerMachine start ...
I1122 02:34:49.568831 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:49.586089 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:49.586362 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:49.586374 176089 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:34:49.587017 176089 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34924->127.0.0.1:32958: read: connection reset by peer
I1122 02:34:52.714126 176089 main.go:143] libmachine: SSH cmd err, output: <nil>: test-preload-564056
I1122 02:34:52.714153 176089 ubuntu.go:182] provisioning hostname "test-preload-564056"
I1122 02:34:52.714215 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:52.731155 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:52.731410 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:52.731425 176089 main.go:143] libmachine: About to run SSH command:
sudo hostname test-preload-564056 && echo "test-preload-564056" | sudo tee /etc/hostname
I1122 02:34:52.864701 176089 main.go:143] libmachine: SSH cmd err, output: <nil>: test-preload-564056
I1122 02:34:52.864771 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:52.881304 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:52.881536 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:52.881558 176089 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\stest-preload-564056' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 test-preload-564056/g' /etc/hosts;
else
echo '127.0.1.1 test-preload-564056' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:34:53.006634 176089 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:34:53.006665 176089 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:34:53.006722 176089 ubuntu.go:190] setting up certificates
I1122 02:34:53.006733 176089 provision.go:84] configureAuth start
I1122 02:34:53.006780 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:53.023382 176089 provision.go:143] copyHostCerts
I1122 02:34:53.023437 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:34:53.023452 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:34:53.023515 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:34:53.023599 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:34:53.023607 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:34:53.023633 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:34:53.023688 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:34:53.023700 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:34:53.023725 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:34:53.023777 176089 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.test-preload-564056 san=[127.0.0.1 192.168.76.2 localhost minikube test-preload-564056]
I1122 02:34:53.262436 176089 provision.go:177] copyRemoteCerts
I1122 02:34:53.262487 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:34:53.262527 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.279389 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.372023 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:34:53.387889 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I1122 02:34:53.403410 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 02:34:53.418829 176089 provision.go:87] duration metric: took 412.082125ms to configureAuth
I1122 02:34:53.418855 176089 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:34:53.419039 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:53.419133 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.435790 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:53.436026 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:53.436044 176089 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:34:53.716711 176089 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:34:53.716741 176089 machine.go:97] duration metric: took 4.147969244s to provisionDockerMachine
I1122 02:34:53.716754 176089 start.go:293] postStartSetup for "test-preload-564056" (driver="docker")
I1122 02:34:53.716765 176089 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:34:53.716832 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:34:53.716882 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.734519 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.827284 176089 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:34:53.830538 176089 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:34:53.830569 176089 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:34:53.830578 176089 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:34:53.830623 176089 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:34:53.830700 176089 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:34:53.830797 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:34:53.837820 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:34:53.853573 176089 start.go:296] duration metric: took 136.805885ms for postStartSetup
I1122 02:34:53.853655 176089 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:34:53.853701 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.870829 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.960060 176089 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:34:53.964240 176089 fix.go:56] duration metric: took 4.692908428s for fixHost
I1122 02:34:53.964264 176089 start.go:83] releasing machines lock for "test-preload-564056", held for 4.692954024s
I1122 02:34:53.964312 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:53.980453 176089 ssh_runner.go:195] Run: cat /version.json
I1122 02:34:53.980491 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.980507 176089 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:34:53.980573 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.998098 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.998440 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:54.087200 176089 ssh_runner.go:195] Run: systemctl --version
I1122 02:34:54.135756 176089 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:34:54.167590 176089 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:34:54.171599 176089 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:34:54.171659 176089 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:34:54.178826 176089 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:34:54.178845 176089 start.go:496] detecting cgroup driver to use...
I1122 02:34:54.178873 176089 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:34:54.178925 176089 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:34:54.191562 176089 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:34:54.202504 176089 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:34:54.202559 176089 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:34:54.215381 176089 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:34:54.226238 176089 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:34:54.300275 176089 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:34:54.376067 176089 docker.go:234] disabling docker service ...
I1122 02:34:54.376116 176089 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:34:54.388640 176089 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:34:54.399336 176089 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:34:54.473085 176089 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:34:54.548420 176089 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:34:54.560004 176089 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:34:54.572366 176089 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I1122 02:34:54.572419 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.580321 176089 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:34:54.580364 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.588073 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.595682 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.603337 176089 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:34:54.610392 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.618128 176089 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.625515 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.633076 176089 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:34:54.639695 176089 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:34:54.646154 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:54.719586 176089 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:34:54.842051 176089 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:34:54.842104 176089 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:34:54.845729 176089 start.go:564] Will wait 60s for crictl version
I1122 02:34:54.845780 176089 ssh_runner.go:195] Run: which crictl
I1122 02:34:54.849138 176089 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:34:54.872015 176089 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:34:54.872069 176089 ssh_runner.go:195] Run: crio --version
I1122 02:34:54.896846 176089 ssh_runner.go:195] Run: crio --version
I1122 02:34:54.923126 176089 out.go:179] * Preparing Kubernetes v1.32.0 on CRI-O 1.34.2 ...
I1122 02:34:54.924110 176089 cli_runner.go:164] Run: docker network inspect test-preload-564056 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:34:54.940925 176089 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:34:54.944652 176089 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:34:54.954438 176089 kubeadm.go:884] updating cluster {Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics
:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:34:54.954534 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:54.954588 176089 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:34:54.983244 176089 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:34:54.983262 176089 crio.go:433] Images already preloaded, skipping extraction
I1122 02:34:54.983300 176089 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:34:55.006331 176089 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:34:55.006347 176089 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:34:55.006354 176089 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.32.0 crio true true} ...
I1122 02:34:55.006440 176089 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=test-preload-564056 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:34:55.006494 176089 ssh_runner.go:195] Run: crio config
I1122 02:34:55.049807 176089 cni.go:84] Creating CNI manager for ""
I1122 02:34:55.049826 176089 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:34:55.049843 176089 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:34:55.049866 176089 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.32.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:test-preload-564056 NodeName:test-preload-564056 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:34:55.049995 176089 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "test-preload-564056"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.32.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:34:55.050087 176089 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.0
I1122 02:34:55.057382 176089 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:34:55.057427 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:34:55.064315 176089 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (369 bytes)
I1122 02:34:55.075356 176089 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:34:55.086646 176089 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2215 bytes)
I1122 02:34:55.098037 176089 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:34:55.101175 176089 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:34:55.109995 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:55.187501 176089 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:34:55.210858 176089 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056 for IP: 192.168.76.2
I1122 02:34:55.210880 176089 certs.go:195] generating shared ca certs ...
I1122 02:34:55.210899 176089 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.211075 176089 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:34:55.211133 176089 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:34:55.211146 176089 certs.go:257] generating profile certs ...
I1122 02:34:55.211260 176089 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key
I1122 02:34:55.211339 176089 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.key.e7b6396e
I1122 02:34:55.211396 176089 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.key
I1122 02:34:55.211540 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:34:55.211579 176089 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:34:55.211591 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:34:55.211621 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:34:55.211662 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:34:55.211691 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:34:55.211743 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:34:55.212454 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:34:55.228802 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:34:55.246095 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:34:55.263258 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:34:55.283543 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I1122 02:34:55.300445 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:34:55.316017 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:34:55.331268 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:34:55.346637 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:34:55.362329 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:34:55.377583 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:34:55.393456 176089 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:34:55.404501 176089 ssh_runner.go:195] Run: openssl version
I1122 02:34:55.409960 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:34:55.417427 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:34:55.420666 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:34:55.420717 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:34:55.453656 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:34:55.460419 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:34:55.467889 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:34:55.471219 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:34:55.471264 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:34:55.504716 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:34:55.511673 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:34:55.519036 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.522338 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.522379 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.555033 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:34:55.561995 176089 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:34:55.565250 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:34:55.599074 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:34:55.631585 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:34:55.663553 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:34:55.698043 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:34:55.742857 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:34:55.791783 176089 kubeadm.go:401] StartCluster: {Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:55.791894 176089 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:34:55.791990 176089 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:34:55.823206 176089 cri.go:89] found id: "01e0886cdbb428f71a49326600b391666d1b25e6a767d34e0380df687e216233"
I1122 02:34:55.823226 176089 cri.go:89] found id: "8e91c7314bcfdaec8a28a22440133e59f537690afa3056c0b355f044ba092e27"
I1122 02:34:55.823231 176089 cri.go:89] found id: "464836e8ab1ec081ce2a085c4aaf84ea0ec0aa0b56571880bc5a277ed33a262e"
I1122 02:34:55.823235 176089 cri.go:89] found id: ""
I1122 02:34:55.823281 176089 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:34:55.835980 176089 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:34:55Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:34:55.836063 176089 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:34:55.844408 176089 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:34:55.844427 176089 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:34:55.844472 176089 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:34:55.852757 176089 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:34:55.853289 176089 kubeconfig.go:47] verify endpoint returned: get endpoint: "test-preload-564056" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:55.853449 176089 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "test-preload-564056" cluster setting kubeconfig missing "test-preload-564056" context setting]
I1122 02:34:55.853813 176089 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.854544 176089 kapi.go:59] client config for test-preload-564056: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(ni
l), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:34:55.855085 176089 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1122 02:34:55.855108 176089 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1122 02:34:55.855116 176089 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1122 02:34:55.855122 176089 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1122 02:34:55.855127 176089 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1122 02:34:55.855544 176089 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:34:55.863170 176089 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.76.2
I1122 02:34:55.863202 176089 kubeadm.go:602] duration metric: took 18.767949ms to restartPrimaryControlPlane
I1122 02:34:55.863213 176089 kubeadm.go:403] duration metric: took 71.442941ms to StartCluster
I1122 02:34:55.863233 176089 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.863297 176089 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:55.863919 176089 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.864162 176089 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:34:55.864215 176089 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:34:55.864292 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:55.864316 176089 addons.go:70] Setting storage-provisioner=true in profile "test-preload-564056"
I1122 02:34:55.864323 176089 addons.go:70] Setting default-storageclass=true in profile "test-preload-564056"
I1122 02:34:55.864336 176089 addons.go:239] Setting addon storage-provisioner=true in "test-preload-564056"
W1122 02:34:55.864346 176089 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:34:55.864368 176089 host.go:66] Checking if "test-preload-564056" exists ...
I1122 02:34:55.864337 176089 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "test-preload-564056"
I1122 02:34:55.864687 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.864868 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.869389 176089 out.go:179] * Verifying Kubernetes components...
I1122 02:34:55.870527 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:55.885174 176089 kapi.go:59] client config for test-preload-564056: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(ni
l), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:34:55.885507 176089 addons.go:239] Setting addon default-storageclass=true in "test-preload-564056"
W1122 02:34:55.885522 176089 addons.go:248] addon default-storageclass should already be in state true
I1122 02:34:55.885549 176089 host.go:66] Checking if "test-preload-564056" exists ...
I1122 02:34:55.886033 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.888086 176089 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:34:55.891622 176089 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:34:55.891637 176089 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:34:55.891675 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:55.912927 176089 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:34:55.912951 176089 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:34:55.913013 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:55.918841 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:55.933472 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:55.993211 176089 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:34:56.006037 176089 node_ready.go:35] waiting up to 6m0s for node "test-preload-564056" to be "Ready" ...
I1122 02:34:56.026707 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:34:56.040980 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:06.007209 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:35:16.008339 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:35:16.093120 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.06637841s)
W1122 02:35:16.093161 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.093188 176089 retry.go:31] will retry after 180.284244ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.100060 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (20.059042827s)
W1122 02:35:16.100092 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.100105 176089 retry.go:31] will retry after 277.070661ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.274404 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:16.329021 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.329049 176089 retry.go:31] will retry after 552.394374ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.378216 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:35:16.882616 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:27.291178 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout - error from a previous attempt: read tcp 192.168.76.1:44800->192.168.76.2:8443: read: connection reset by peer
I1122 02:35:36.440015 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (20.061756313s)
W1122 02:35:36.440063 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:36.440082 176089 retry.go:31] will retry after 192.739682ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:36.633585 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:37.759043 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.76.1:53098->192.168.76.2:8443: read: connection reset by peer
I1122 02:35:37.762796 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.880139215s)
W1122 02:35:37.762832 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:33914->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.762859 176089 retry.go:31] will retry after 490.096074ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:33914->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.764828 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (1.13121088s)
W1122 02:35:37.764855 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.764867 176089 retry.go:31] will retry after 324.356447ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.089738 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:38.141343 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.141373 176089 retry.go:31] will retry after 960.744855ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.253682 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:38.306635 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.306672 176089 retry.go:31] will retry after 838.201565ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.102584 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:35:39.146053 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:39.155012 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.155052 176089 retry.go:31] will retry after 1.004550865s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:39.198487 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.198526 176089 retry.go:31] will retry after 1.799487982s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:40.007271 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:40.160528 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:40.211930 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:40.211970 176089 retry.go:31] will retry after 1.294785328s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:40.998218 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:41.050101 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.050135 176089 retry.go:31] will retry after 1.070316914s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.506963 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:41.557890 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.557937 176089 retry.go:31] will retry after 2.843239427s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:42.121050 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:42.172639 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:42.172670 176089 retry.go:31] will retry after 3.456134853s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:42.507419 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:44.401859 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:44.454733 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:44.454762 176089 retry.go:31] will retry after 3.624090623s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:45.007198 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:45.629355 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:45.680912 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:45.680951 176089 retry.go:31] will retry after 4.083852834s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:47.506613 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:48.079751 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:48.132165 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:48.132204 176089 retry.go:31] will retry after 4.629916752s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:49.507324 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:49.765659 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:49.818338 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:49.818368 176089 retry.go:31] will retry after 5.892596891s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:52.006661 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:52.762887 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:52.815468 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:52.815495 176089 retry.go:31] will retry after 6.02750395s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:54.007297 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:55.711780 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:35:58.844601 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:05.510866 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:36:15.514697 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:15.767441 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.05562355s)
W1122 02:36:15.767476 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:15.767494 176089 retry.go:31] will retry after 14.190403635s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:16.802445 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (17.957814025s)
W1122 02:36:16.802488 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:58158->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:16.802508 176089 retry.go:31] will retry after 11.572186771s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:58158->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:18.007471 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:20.507437 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:23.007473 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:25.507489 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:28.007499 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:36:28.374901 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:28.428023 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:28.428053 176089 retry.go:31] will retry after 26.884268502s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:29.958966 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:36:30.010000 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:30.010027 176089 retry.go:31] will retry after 15.736220975s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:30.506856 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:32.507323 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:34.507466 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:36.507506 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:36:45.750305 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:36:47.507794 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:55.312550 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:57.508340 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:59.080606 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (13.330245503s)
W1122 02:36:59.080651 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:37114->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:59.080778 176089 out.go:285] ! Enabling 'storage-provisioner' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:37114->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
]
! Enabling 'storage-provisioner' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:37114->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
]
I1122 02:36:59.081314 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (3.768712115s)
W1122 02:36:59.081345 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:59.081438 176089 out.go:285] ! Enabling 'default-storageclass' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
]
! Enabling 'default-storageclass' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
]
I1122 02:36:59.083890 176089 out.go:179] * Enabled addons:
I1122 02:36:59.084943 176089 addons.go:530] duration metric: took 2m3.220728595s for enable addons: enabled=[]
W1122 02:37:00.007113 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:02.507390 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:05.006720 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:07.007517 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:09.506968 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:11.507433 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:14.007128 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:16.506512 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:18.507468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:20.507540 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:23.006605 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:25.007501 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:27.507504 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:30.007458 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:32.507504 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:35.007498 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:37.507484 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:40.007441 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:42.507454 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:45.007468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:56.508746 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:38:06.509550 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:38:09.007014 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:11.007294 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:13.007477 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:15.506455 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:17.507521 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:20.006508 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:22.007515 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:24.507498 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:27.007465 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:29.506479 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:31.507491 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:34.007513 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:36.507468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:39.007427 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:41.007477 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:43.507487 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:46.006527 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:48.007479 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:50.507456 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:53.007372 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:55.507407 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:58.007177 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:00.507489 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:03.007078 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:05.007215 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:07.506966 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:09.507200 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:12.006495 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:14.007140 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:16.506641 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:18.507255 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:21.006631 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:23.007343 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:25.506739 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:27.507461 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:30.006787 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:32.007379 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:43.508665 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:39:53.510341 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:39:56.006720 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:58.506560 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:00.507545 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:03.006473 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:05.007549 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:07.507495 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:10.007493 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:12.007552 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:14.506482 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:16.507412 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:19.007400 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:21.007528 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:23.507539 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:26.007485 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:28.507447 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:31.007392 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:33.007496 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:35.506472 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:37.507452 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:40.007540 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:42.507469 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:45.007533 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:47.507501 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:50.007547 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:52.507118 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:54.507458 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:40:56.007066 176089 node_ready.go:38] duration metric: took 6m0.00098961s for node "test-preload-564056" to be "Ready" ...
I1122 02:40:56.008989 176089 out.go:203]
W1122 02:40:56.010028 176089 out.go:285] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: WaitNodeCondition: context deadline exceeded
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: WaitNodeCondition: context deadline exceeded
W1122 02:40:56.010042 176089 out.go:285] *
*
W1122 02:40:56.011671 176089 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:40:56.012621 176089 out.go:203]
** /stderr **
preload_test.go:67: out/minikube-linux-amd64 start -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio failed: exit status 80
panic.go:636: *** TestPreload FAILED at 2025-11-22 02:40:56.044760413 +0000 UTC m=+2703.720263947
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestPreload]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestPreload]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect test-preload-564056
helpers_test.go:243: (dbg) docker inspect test-preload-564056:
-- stdout --
[
{
"Id": "87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c",
"Created": "2025-11-22T02:33:51.563782918Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 176295,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:34:49.312211117Z",
"FinishedAt": "2025-11-22T02:34:46.201373742Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c/hostname",
"HostsPath": "/var/lib/docker/containers/87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c/hosts",
"LogPath": "/var/lib/docker/containers/87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c/87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c-json.log",
"Name": "/test-preload-564056",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"test-preload-564056:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "test-preload-564056",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "87dcdf7d74b7828ad2eced6d209687b246d3043df3cff849bf6bf20c9883aa6c",
"LowerDir": "/var/lib/docker/overlay2/2c7215041ba4bac6c320a893563b0882ac1c396afb219b0440045be24871fa9a-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/2c7215041ba4bac6c320a893563b0882ac1c396afb219b0440045be24871fa9a/merged",
"UpperDir": "/var/lib/docker/overlay2/2c7215041ba4bac6c320a893563b0882ac1c396afb219b0440045be24871fa9a/diff",
"WorkDir": "/var/lib/docker/overlay2/2c7215041ba4bac6c320a893563b0882ac1c396afb219b0440045be24871fa9a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "test-preload-564056",
"Source": "/var/lib/docker/volumes/test-preload-564056/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "test-preload-564056",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "test-preload-564056",
"name.minikube.sigs.k8s.io": "test-preload-564056",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "2cf5ef25b7ab9d5a0f9d54e1c4692e08ca842142d5d4fcf77e09011171aa95ad",
"SandboxKey": "/var/run/docker/netns/2cf5ef25b7ab",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32958"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32959"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32962"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32960"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32961"
}
]
},
"Networks": {
"test-preload-564056": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "e293d618174f0c07d57fb865d745ac192fa08ad92ec8f74c101ab91ca3bb9ae3",
"EndpointID": "a07dbe3f963012f32306cae5b66f62a63955274286b8465f501fc0b4cf13883a",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"MacAddress": "de:88:ef:f0:d9:98",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"test-preload-564056",
"87dcdf7d74b7"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p test-preload-564056 -n test-preload-564056
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p test-preload-564056 -n test-preload-564056: exit status 2 (293.972785ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestPreload FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestPreload]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p test-preload-564056 logs -n 25
helpers_test.go:260: TestPreload logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ cp │ multinode-001269 cp multinode-001269-m03:/home/docker/cp-test.txt multinode-001269:/home/docker/cp-test_multinode-001269-m03_multinode-001269.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ ssh │ multinode-001269 ssh -n multinode-001269-m03 sudo cat /home/docker/cp-test.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ ssh │ multinode-001269 ssh -n multinode-001269 sudo cat /home/docker/cp-test_multinode-001269-m03_multinode-001269.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ cp │ multinode-001269 cp multinode-001269-m03:/home/docker/cp-test.txt multinode-001269-m02:/home/docker/cp-test_multinode-001269-m03_multinode-001269-m02.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ ssh │ multinode-001269 ssh -n multinode-001269-m03 sudo cat /home/docker/cp-test.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ ssh │ multinode-001269 ssh -n multinode-001269-m02 sudo cat /home/docker/cp-test_multinode-001269-m03_multinode-001269-m02.txt │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ node │ multinode-001269 node stop m03 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:30 UTC │ 22 Nov 25 02:30 UTC │
│ node │ multinode-001269 node start m03 -v=5 --alsologtostderr │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:31 UTC │ 22 Nov 25 02:31 UTC │
│ node │ list -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:31 UTC │ │
│ stop │ -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:31 UTC │ 22 Nov 25 02:31 UTC │
│ start │ -p multinode-001269 --wait=true -v=5 --alsologtostderr │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:31 UTC │ 22 Nov 25 02:32 UTC │
│ node │ list -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:32 UTC │ │
│ node │ multinode-001269 node delete m03 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:32 UTC │ 22 Nov 25 02:32 UTC │
│ stop │ multinode-001269 stop │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:32 UTC │ 22 Nov 25 02:33 UTC │
│ start │ -p multinode-001269 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=crio │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ 22 Nov 25 02:33 UTC │
│ node │ list -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ │
│ start │ -p multinode-001269-m02 --driver=docker --container-runtime=crio │ multinode-001269-m02 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ │
│ start │ -p multinode-001269-m03 --driver=docker --container-runtime=crio │ multinode-001269-m03 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ 22 Nov 25 02:33 UTC │
│ node │ add -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ │
│ delete │ -p multinode-001269-m03 │ multinode-001269-m03 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ 22 Nov 25 02:33 UTC │
│ delete │ -p multinode-001269 │ multinode-001269 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ 22 Nov 25 02:33 UTC │
│ start │ -p test-preload-564056 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.32.0 │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:33 UTC │ 22 Nov 25 02:34 UTC │
│ image │ test-preload-564056 image pull gcr.io/k8s-minikube/busybox │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ 22 Nov 25 02:34 UTC │
│ stop │ -p test-preload-564056 │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ 22 Nov 25 02:34 UTC │
│ start │ -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:34:46
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:34:46.597456 176089 out.go:360] Setting OutFile to fd 1 ...
I1122 02:34:46.597563 176089 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:34:46.597577 176089 out.go:374] Setting ErrFile to fd 2...
I1122 02:34:46.597583 176089 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:34:46.597797 176089 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:34:46.598302 176089 out.go:368] Setting JSON to false
I1122 02:34:46.599256 176089 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":4630,"bootTime":1763774257,"procs":202,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:34:46.599335 176089 start.go:143] virtualization: kvm guest
I1122 02:34:46.601053 176089 out.go:179] * [test-preload-564056] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:34:46.602128 176089 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:34:46.602126 176089 notify.go:221] Checking for updates...
I1122 02:34:46.604127 176089 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:34:46.605150 176089 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:46.606211 176089 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:34:46.607171 176089 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:34:46.608188 176089 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:34:46.609417 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:46.610962 176089 out.go:179] * Kubernetes 1.34.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.34.1
I1122 02:34:46.611819 176089 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:34:46.634831 176089 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:34:46.634895 176089 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:34:46.690530 176089 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-11-22 02:34:46.68076684 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:34:46.690645 176089 docker.go:319] overlay module found
I1122 02:34:46.692047 176089 out.go:179] * Using the docker driver based on existing profile
I1122 02:34:46.692945 176089 start.go:309] selected driver: docker
I1122 02:34:46.692963 176089 start.go:927] validating driver "docker" against &{Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServ
erName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fal
se DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:46.693062 176089 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:34:46.693603 176089 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:34:46.746361 176089 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-11-22 02:34:46.736743894 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:34:46.746652 176089 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:34:46.746697 176089 cni.go:84] Creating CNI manager for ""
I1122 02:34:46.746754 176089 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:34:46.746808 176089 start.go:353] cluster config:
{Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont
ainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVM
netClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:46.748233 176089 out.go:179] * Starting "test-preload-564056" primary control-plane node in "test-preload-564056" cluster
I1122 02:34:46.749233 176089 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:34:46.750167 176089 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:34:46.751031 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:46.751113 176089 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:34:46.770015 176089 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:34:46.770038 176089 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:34:46.775669 176089 preload.go:148] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.0/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4
I1122 02:34:46.775686 176089 cache.go:65] Caching tarball of preloaded images
I1122 02:34:46.775837 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:46.777044 176089 out.go:179] * Downloading Kubernetes v1.32.0 preload ...
I1122 02:34:46.777852 176089 preload.go:318] getting checksum for preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4 from gcs api...
I1122 02:34:46.806377 176089 preload.go:295] Got checksum from GCS API "2acdb4dde52794f2167c79dcee7507ae"
I1122 02:34:46.806406 176089 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.0/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4?checksum=md5:2acdb4dde52794f2167c79dcee7507ae -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.0-cri-o-overlay-amd64.tar.lz4
I1122 02:34:49.270801 176089 cache.go:68] Finished verifying existence of preloaded tar for v1.32.0 on crio
I1122 02:34:49.270963 176089 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/config.json ...
I1122 02:34:49.271169 176089 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:34:49.271205 176089 start.go:360] acquireMachinesLock for test-preload-564056: {Name:mkacb9e8b79a32ce084952488aa19f5b1b58b04a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:34:49.271295 176089 start.go:364] duration metric: took 52.463µs to acquireMachinesLock for "test-preload-564056"
I1122 02:34:49.271319 176089 start.go:96] Skipping create...Using existing machine configuration
I1122 02:34:49.271327 176089 fix.go:54] fixHost starting:
I1122 02:34:49.271539 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:49.288382 176089 fix.go:112] recreateIfNeeded on test-preload-564056: state=Stopped err=<nil>
W1122 02:34:49.288407 176089 fix.go:138] unexpected machine state, will restart: <nil>
I1122 02:34:49.289938 176089 out.go:252] * Restarting existing docker container for "test-preload-564056" ...
I1122 02:34:49.290006 176089 cli_runner.go:164] Run: docker start test-preload-564056
I1122 02:34:49.534537 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:49.551573 176089 kic.go:430] container "test-preload-564056" state is running.
I1122 02:34:49.552045 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:49.568529 176089 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/config.json ...
I1122 02:34:49.568755 176089 machine.go:94] provisionDockerMachine start ...
I1122 02:34:49.568831 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:49.586089 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:49.586362 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:49.586374 176089 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:34:49.587017 176089 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34924->127.0.0.1:32958: read: connection reset by peer
I1122 02:34:52.714126 176089 main.go:143] libmachine: SSH cmd err, output: <nil>: test-preload-564056
I1122 02:34:52.714153 176089 ubuntu.go:182] provisioning hostname "test-preload-564056"
I1122 02:34:52.714215 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:52.731155 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:52.731410 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:52.731425 176089 main.go:143] libmachine: About to run SSH command:
sudo hostname test-preload-564056 && echo "test-preload-564056" | sudo tee /etc/hostname
I1122 02:34:52.864701 176089 main.go:143] libmachine: SSH cmd err, output: <nil>: test-preload-564056
I1122 02:34:52.864771 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:52.881304 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:52.881536 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:52.881558 176089 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\stest-preload-564056' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 test-preload-564056/g' /etc/hosts;
else
echo '127.0.1.1 test-preload-564056' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:34:53.006634 176089 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:34:53.006665 176089 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:34:53.006722 176089 ubuntu.go:190] setting up certificates
I1122 02:34:53.006733 176089 provision.go:84] configureAuth start
I1122 02:34:53.006780 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:53.023382 176089 provision.go:143] copyHostCerts
I1122 02:34:53.023437 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:34:53.023452 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:34:53.023515 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:34:53.023599 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:34:53.023607 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:34:53.023633 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:34:53.023688 176089 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:34:53.023700 176089 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:34:53.023725 176089 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:34:53.023777 176089 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.test-preload-564056 san=[127.0.0.1 192.168.76.2 localhost minikube test-preload-564056]
I1122 02:34:53.262436 176089 provision.go:177] copyRemoteCerts
I1122 02:34:53.262487 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:34:53.262527 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.279389 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.372023 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:34:53.387889 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I1122 02:34:53.403410 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 02:34:53.418829 176089 provision.go:87] duration metric: took 412.082125ms to configureAuth
I1122 02:34:53.418855 176089 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:34:53.419039 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:53.419133 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.435790 176089 main.go:143] libmachine: Using SSH client type: native
I1122 02:34:53.436026 176089 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32958 <nil> <nil>}
I1122 02:34:53.436044 176089 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:34:53.716711 176089 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:34:53.716741 176089 machine.go:97] duration metric: took 4.147969244s to provisionDockerMachine
I1122 02:34:53.716754 176089 start.go:293] postStartSetup for "test-preload-564056" (driver="docker")
I1122 02:34:53.716765 176089 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:34:53.716832 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:34:53.716882 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.734519 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.827284 176089 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:34:53.830538 176089 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:34:53.830569 176089 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:34:53.830578 176089 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:34:53.830623 176089 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:34:53.830700 176089 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:34:53.830797 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:34:53.837820 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:34:53.853573 176089 start.go:296] duration metric: took 136.805885ms for postStartSetup
I1122 02:34:53.853655 176089 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:34:53.853701 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.870829 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.960060 176089 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:34:53.964240 176089 fix.go:56] duration metric: took 4.692908428s for fixHost
I1122 02:34:53.964264 176089 start.go:83] releasing machines lock for "test-preload-564056", held for 4.692954024s
I1122 02:34:53.964312 176089 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" test-preload-564056
I1122 02:34:53.980453 176089 ssh_runner.go:195] Run: cat /version.json
I1122 02:34:53.980491 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.980507 176089 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:34:53.980573 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:53.998098 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:53.998440 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:54.087200 176089 ssh_runner.go:195] Run: systemctl --version
I1122 02:34:54.135756 176089 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:34:54.167590 176089 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:34:54.171599 176089 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:34:54.171659 176089 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:34:54.178826 176089 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:34:54.178845 176089 start.go:496] detecting cgroup driver to use...
I1122 02:34:54.178873 176089 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:34:54.178925 176089 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:34:54.191562 176089 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:34:54.202504 176089 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:34:54.202559 176089 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:34:54.215381 176089 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:34:54.226238 176089 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:34:54.300275 176089 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:34:54.376067 176089 docker.go:234] disabling docker service ...
I1122 02:34:54.376116 176089 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:34:54.388640 176089 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:34:54.399336 176089 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:34:54.473085 176089 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:34:54.548420 176089 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:34:54.560004 176089 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:34:54.572366 176089 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I1122 02:34:54.572419 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.580321 176089 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:34:54.580364 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.588073 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.595682 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.603337 176089 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:34:54.610392 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.618128 176089 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.625515 176089 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:34:54.633076 176089 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:34:54.639695 176089 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:34:54.646154 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:54.719586 176089 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:34:54.842051 176089 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:34:54.842104 176089 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:34:54.845729 176089 start.go:564] Will wait 60s for crictl version
I1122 02:34:54.845780 176089 ssh_runner.go:195] Run: which crictl
I1122 02:34:54.849138 176089 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:34:54.872015 176089 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:34:54.872069 176089 ssh_runner.go:195] Run: crio --version
I1122 02:34:54.896846 176089 ssh_runner.go:195] Run: crio --version
I1122 02:34:54.923126 176089 out.go:179] * Preparing Kubernetes v1.32.0 on CRI-O 1.34.2 ...
I1122 02:34:54.924110 176089 cli_runner.go:164] Run: docker network inspect test-preload-564056 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:34:54.940925 176089 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:34:54.944652 176089 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:34:54.954438 176089 kubeadm.go:884] updating cluster {Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics
:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:34:54.954534 176089 preload.go:188] Checking if preload exists for k8s version v1.32.0 and runtime crio
I1122 02:34:54.954588 176089 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:34:54.983244 176089 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:34:54.983262 176089 crio.go:433] Images already preloaded, skipping extraction
I1122 02:34:54.983300 176089 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:34:55.006331 176089 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:34:55.006347 176089 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:34:55.006354 176089 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.32.0 crio true true} ...
I1122 02:34:55.006440 176089 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=test-preload-564056 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:34:55.006494 176089 ssh_runner.go:195] Run: crio config
I1122 02:34:55.049807 176089 cni.go:84] Creating CNI manager for ""
I1122 02:34:55.049826 176089 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:34:55.049843 176089 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:34:55.049866 176089 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.32.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:test-preload-564056 NodeName:test-preload-564056 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:34:55.049995 176089 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "test-preload-564056"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.32.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:34:55.050087 176089 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.0
I1122 02:34:55.057382 176089 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:34:55.057427 176089 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:34:55.064315 176089 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (369 bytes)
I1122 02:34:55.075356 176089 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:34:55.086646 176089 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2215 bytes)
I1122 02:34:55.098037 176089 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:34:55.101175 176089 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:34:55.109995 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:55.187501 176089 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:34:55.210858 176089 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056 for IP: 192.168.76.2
I1122 02:34:55.210880 176089 certs.go:195] generating shared ca certs ...
I1122 02:34:55.210899 176089 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.211075 176089 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:34:55.211133 176089 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:34:55.211146 176089 certs.go:257] generating profile certs ...
I1122 02:34:55.211260 176089 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key
I1122 02:34:55.211339 176089 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.key.e7b6396e
I1122 02:34:55.211396 176089 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.key
I1122 02:34:55.211540 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:34:55.211579 176089 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:34:55.211591 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:34:55.211621 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:34:55.211662 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:34:55.211691 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:34:55.211743 176089 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:34:55.212454 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:34:55.228802 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:34:55.246095 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:34:55.263258 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:34:55.283543 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I1122 02:34:55.300445 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:34:55.316017 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:34:55.331268 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:34:55.346637 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:34:55.362329 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:34:55.377583 176089 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:34:55.393456 176089 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:34:55.404501 176089 ssh_runner.go:195] Run: openssl version
I1122 02:34:55.409960 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:34:55.417427 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:34:55.420666 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:34:55.420717 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:34:55.453656 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:34:55.460419 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:34:55.467889 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:34:55.471219 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:34:55.471264 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:34:55.504716 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:34:55.511673 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:34:55.519036 176089 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.522338 176089 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.522379 176089 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:34:55.555033 176089 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:34:55.561995 176089 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:34:55.565250 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:34:55.599074 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:34:55.631585 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:34:55.663553 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:34:55.698043 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:34:55.742857 176089 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:34:55.791783 176089 kubeadm.go:401] StartCluster: {Name:test-preload-564056 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.0 ClusterName:test-preload-564056 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:34:55.791894 176089 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:34:55.791990 176089 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:34:55.823206 176089 cri.go:89] found id: "01e0886cdbb428f71a49326600b391666d1b25e6a767d34e0380df687e216233"
I1122 02:34:55.823226 176089 cri.go:89] found id: "8e91c7314bcfdaec8a28a22440133e59f537690afa3056c0b355f044ba092e27"
I1122 02:34:55.823231 176089 cri.go:89] found id: "464836e8ab1ec081ce2a085c4aaf84ea0ec0aa0b56571880bc5a277ed33a262e"
I1122 02:34:55.823235 176089 cri.go:89] found id: ""
I1122 02:34:55.823281 176089 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:34:55.835980 176089 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:34:55Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:34:55.836063 176089 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:34:55.844408 176089 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:34:55.844427 176089 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:34:55.844472 176089 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:34:55.852757 176089 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:34:55.853289 176089 kubeconfig.go:47] verify endpoint returned: get endpoint: "test-preload-564056" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:55.853449 176089 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "test-preload-564056" cluster setting kubeconfig missing "test-preload-564056" context setting]
I1122 02:34:55.853813 176089 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.854544 176089 kapi.go:59] client config for test-preload-564056: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(ni
l), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:34:55.855085 176089 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1122 02:34:55.855108 176089 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1122 02:34:55.855116 176089 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1122 02:34:55.855122 176089 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1122 02:34:55.855127 176089 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1122 02:34:55.855544 176089 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:34:55.863170 176089 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.76.2
I1122 02:34:55.863202 176089 kubeadm.go:602] duration metric: took 18.767949ms to restartPrimaryControlPlane
I1122 02:34:55.863213 176089 kubeadm.go:403] duration metric: took 71.442941ms to StartCluster
I1122 02:34:55.863233 176089 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.863297 176089 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:34:55.863919 176089 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:34:55.864162 176089 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:34:55.864215 176089 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:34:55.864292 176089 config.go:182] Loaded profile config "test-preload-564056": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1122 02:34:55.864316 176089 addons.go:70] Setting storage-provisioner=true in profile "test-preload-564056"
I1122 02:34:55.864323 176089 addons.go:70] Setting default-storageclass=true in profile "test-preload-564056"
I1122 02:34:55.864336 176089 addons.go:239] Setting addon storage-provisioner=true in "test-preload-564056"
W1122 02:34:55.864346 176089 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:34:55.864368 176089 host.go:66] Checking if "test-preload-564056" exists ...
I1122 02:34:55.864337 176089 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "test-preload-564056"
I1122 02:34:55.864687 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.864868 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.869389 176089 out.go:179] * Verifying Kubernetes components...
I1122 02:34:55.870527 176089 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:34:55.885174 176089 kapi.go:59] client config for test-preload-564056: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/test-preload-564056/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(ni
l), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:34:55.885507 176089 addons.go:239] Setting addon default-storageclass=true in "test-preload-564056"
W1122 02:34:55.885522 176089 addons.go:248] addon default-storageclass should already be in state true
I1122 02:34:55.885549 176089 host.go:66] Checking if "test-preload-564056" exists ...
I1122 02:34:55.886033 176089 cli_runner.go:164] Run: docker container inspect test-preload-564056 --format={{.State.Status}}
I1122 02:34:55.888086 176089 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:34:55.891622 176089 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:34:55.891637 176089 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:34:55.891675 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:55.912927 176089 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:34:55.912951 176089 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:34:55.913013 176089 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" test-preload-564056
I1122 02:34:55.918841 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:55.933472 176089 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32958 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/test-preload-564056/id_rsa Username:docker}
I1122 02:34:55.993211 176089 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:34:56.006037 176089 node_ready.go:35] waiting up to 6m0s for node "test-preload-564056" to be "Ready" ...
I1122 02:34:56.026707 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:34:56.040980 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:06.007209 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:35:16.008339 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:35:16.093120 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.06637841s)
W1122 02:35:16.093161 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.093188 176089 retry.go:31] will retry after 180.284244ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.100060 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (20.059042827s)
W1122 02:35:16.100092 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.100105 176089 retry.go:31] will retry after 277.070661ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.274404 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:16.329021 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.329049 176089 retry.go:31] will retry after 552.394374ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:16.378216 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:35:16.882616 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:27.291178 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout - error from a previous attempt: read tcp 192.168.76.1:44800->192.168.76.2:8443: read: connection reset by peer
I1122 02:35:36.440015 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (20.061756313s)
W1122 02:35:36.440063 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:36.440082 176089 retry.go:31] will retry after 192.739682ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:36.633585 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:37.759043 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.76.1:53098->192.168.76.2:8443: read: connection reset by peer
I1122 02:35:37.762796 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.880139215s)
W1122 02:35:37.762832 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:33914->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.762859 176089 retry.go:31] will retry after 490.096074ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:33914->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.764828 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (1.13121088s)
W1122 02:35:37.764855 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:37.764867 176089 retry.go:31] will retry after 324.356447ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.089738 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:38.141343 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.141373 176089 retry.go:31] will retry after 960.744855ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.253682 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:38.306635 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:38.306672 176089 retry.go:31] will retry after 838.201565ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.102584 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:35:39.146053 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:39.155012 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.155052 176089 retry.go:31] will retry after 1.004550865s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:39.198487 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:39.198526 176089 retry.go:31] will retry after 1.799487982s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:40.007271 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:40.160528 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:40.211930 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:40.211970 176089 retry.go:31] will retry after 1.294785328s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:40.998218 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:41.050101 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.050135 176089 retry.go:31] will retry after 1.070316914s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.506963 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:41.557890 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:41.557937 176089 retry.go:31] will retry after 2.843239427s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:42.121050 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:42.172639 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:42.172670 176089 retry.go:31] will retry after 3.456134853s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:42.507419 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:44.401859 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:44.454733 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:44.454762 176089 retry.go:31] will retry after 3.624090623s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:45.007198 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:45.629355 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:45.680912 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:45.680951 176089 retry.go:31] will retry after 4.083852834s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:47.506613 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:48.079751 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:48.132165 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:48.132204 176089 retry.go:31] will retry after 4.629916752s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:49.507324 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:49.765659 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:35:49.818338 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:49.818368 176089 retry.go:31] will retry after 5.892596891s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:52.006661 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:52.762887 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:35:52.815468 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:35:52.815495 176089 retry.go:31] will retry after 6.02750395s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:35:54.007297 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:35:55.711780 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:35:58.844601 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:05.510866 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:36:15.514697 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:15.767441 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (20.05562355s)
W1122 02:36:15.767476 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:15.767494 176089 retry.go:31] will retry after 14.190403635s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": net/http: TLS handshake timeout; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:16.802445 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (17.957814025s)
W1122 02:36:16.802488 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:58158->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:16.802508 176089 retry.go:31] will retry after 11.572186771s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:58158->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:18.007471 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:20.507437 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:23.007473 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:25.507489 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:28.007499 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:36:28.374901 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:28.428023 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:28.428053 176089 retry.go:31] will retry after 26.884268502s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:29.958966 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:36:30.010000 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1122 02:36:30.010027 176089 retry.go:31] will retry after 15.736220975s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:30.506856 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:32.507323 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:34.507466 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:36:36.507506 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:36:45.750305 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1122 02:36:47.507794 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:55.312550 176089 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1122 02:36:57.508340 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
I1122 02:36:59.080606 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (13.330245503s)
W1122 02:36:59.080651 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:37114->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:59.080778 176089 out.go:285] ! Enabling 'storage-provisioner' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:37114->[::1]:8443: read: connection reset by peer; if you choose to ignore these errors, turn validation off with --validate=false
]
I1122 02:36:59.081314 176089 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (3.768712115s)
W1122 02:36:59.081345 176089 addons.go:477] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1122 02:36:59.081438 176089 out.go:285] ! Enabling 'default-storageclass' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
]
I1122 02:36:59.083890 176089 out.go:179] * Enabled addons:
I1122 02:36:59.084943 176089 addons.go:530] duration metric: took 2m3.220728595s for enable addons: enabled=[]
W1122 02:37:00.007113 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:02.507390 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:05.006720 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:07.007517 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:09.506968 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:11.507433 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:14.007128 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:16.506512 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:18.507468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:20.507540 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:23.006605 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:25.007501 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:27.507504 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:30.007458 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:32.507504 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:35.007498 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:37.507484 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:40.007441 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:42.507454 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:45.007468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:37:56.508746 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:38:06.509550 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:38:09.007014 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:11.007294 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:13.007477 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:15.506455 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:17.507521 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:20.006508 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:22.007515 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:24.507498 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:27.007465 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:29.506479 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:31.507491 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:34.007513 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:36.507468 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:39.007427 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:41.007477 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:43.507487 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:46.006527 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:48.007479 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:50.507456 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:53.007372 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:55.507407 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:38:58.007177 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:00.507489 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:03.007078 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:05.007215 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:07.506966 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:09.507200 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:12.006495 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:14.007140 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:16.506641 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:18.507255 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:21.006631 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:23.007343 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:25.506739 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:27.507461 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:30.006787 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:32.007379 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:43.508665 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:39:53.510341 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": net/http: TLS handshake timeout
W1122 02:39:56.006720 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:39:58.506560 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:00.507545 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:03.006473 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:05.007549 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:07.507495 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:10.007493 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:12.007552 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:14.506482 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:16.507412 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:19.007400 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:21.007528 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:23.507539 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:26.007485 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:28.507447 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:31.007392 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:33.007496 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:35.506472 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:37.507452 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:40.007540 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:42.507469 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:45.007533 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:47.507501 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:50.007547 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:52.507118 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
W1122 02:40:54.507458 176089 node_ready.go:55] error getting node "test-preload-564056" condition "Ready" status (will retry): Get "https://192.168.76.2:8443/api/v1/nodes/test-preload-564056": dial tcp 192.168.76.2:8443: connect: connection refused
I1122 02:40:56.007066 176089 node_ready.go:38] duration metric: took 6m0.00098961s for node "test-preload-564056" to be "Ready" ...
I1122 02:40:56.008989 176089 out.go:203]
W1122 02:40:56.010028 176089 out.go:285] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: WaitNodeCondition: context deadline exceeded
W1122 02:40:56.010042 176089 out.go:285] *
W1122 02:40:56.011671 176089 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:40:56.012621 176089 out.go:203]
==> CRI-O <==
Nov 22 02:38:14 test-preload-564056 crio[554]: time="2025-11-22T02:38:14.66474Z" level=info msg="Removed container db9a62069dec81ab149b926764a2fb7272d36cd055caea54b5867b72c4003919: kube-system/kube-controller-manager-test-preload-564056/kube-controller-manager" id=5564232b-ea90-4ebd-9303-8492117e5601 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.29110016Z" level=info msg="Checking image status: registry.k8s.io/kube-apiserver:v1.32.0" id=bc30e55e-3c86-4ab6-9794-76177dcc7988 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.291946967Z" level=info msg="Checking image status: registry.k8s.io/kube-apiserver:v1.32.0" id=1b1aa0a7-f23a-4e72-91b5-2eaf8ebd4cd5 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.292621912Z" level=info msg="Creating container: kube-system/kube-apiserver-test-preload-564056/kube-apiserver" id=74800d13-9a6f-4993-8d51-9aacb6067fb2 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.29272949Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.296685009Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.297293724Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.324279262Z" level=info msg="Created container b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66: kube-system/kube-apiserver-test-preload-564056/kube-apiserver" id=74800d13-9a6f-4993-8d51-9aacb6067fb2 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.324665539Z" level=info msg="Starting container: b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66" id=00c07350-439e-43ea-9bd3-28eb0fe00439 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:39:33 test-preload-564056 crio[554]: time="2025-11-22T02:39:33.326383382Z" level=info msg="Started container" PID=1449 containerID=b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66 description=kube-system/kube-apiserver-test-preload-564056/kube-apiserver id=00c07350-439e-43ea-9bd3-28eb0fe00439 name=/runtime.v1.RuntimeService/StartContainer sandboxID=d902461b8327a73f2a4fabd0111108b3f5cbb89c6e47e62c71c90eaced20cb9b
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.291519068Z" level=info msg="Checking image status: registry.k8s.io/kube-controller-manager:v1.32.0" id=ffa79e2d-470f-4605-bcc1-b65e88c406c8 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.292269695Z" level=info msg="Checking image status: registry.k8s.io/kube-controller-manager:v1.32.0" id=f21aa9a0-3fa1-428a-9bb5-d679ae181f84 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.293021382Z" level=info msg="Creating container: kube-system/kube-controller-manager-test-preload-564056/kube-controller-manager" id=7c482de6-7518-47a2-a165-b826365beff8 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.29313669Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.296689965Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.297643134Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.327159707Z" level=info msg="Created container ce4da245c965be4662bec3219d2eb3bd29e5fd7a9bdb3514863b1374c098d66b: kube-system/kube-controller-manager-test-preload-564056/kube-controller-manager" id=7c482de6-7518-47a2-a165-b826365beff8 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.327573871Z" level=info msg="Starting container: ce4da245c965be4662bec3219d2eb3bd29e5fd7a9bdb3514863b1374c098d66b" id=1318756b-d550-4a66-bc20-66c24bee18ca name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:39:40 test-preload-564056 crio[554]: time="2025-11-22T02:39:40.329336068Z" level=info msg="Started container" PID=1469 containerID=ce4da245c965be4662bec3219d2eb3bd29e5fd7a9bdb3514863b1374c098d66b description=kube-system/kube-controller-manager-test-preload-564056/kube-controller-manager id=1318756b-d550-4a66-bc20-66c24bee18ca name=/runtime.v1.RuntimeService/StartContainer sandboxID=834741e989c7aafcbf2b21b1dfb0eaefa8cc227b7286527b216b21f60f137d0c
Nov 22 02:39:46 test-preload-564056 crio[554]: time="2025-11-22T02:39:46.737779562Z" level=info msg="createCtr: deleting container 7d117a23e6d1a34f5726dba2450c182ef9af0efd04f663d54dce121dd869c741 from storage" id=aafc7948-2965-4864-b957-d85a033bb5e3 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:46 test-preload-564056 crio[554]: time="2025-11-22T02:39:46.738061774Z" level=error msg="Failed to cleanup (probably retrying): failed to cleanup container storage: replacing mount point \"/var/lib/containers/storage/overlay/611359b8f479e082279b6b2fd86505505c0baa636854b5fb51c780b73cd9d070/merged\": directory not empty" id=aafc7948-2965-4864-b957-d85a033bb5e3 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:39:54 test-preload-564056 crio[554]: time="2025-11-22T02:39:54.822725752Z" level=info msg="Removing container: 4e5d338d40637c061d3de3a620e1a79e5035ba3632667696cbe94ff1dc0ea0e3" id=2b9e9a03-d253-444b-bd2c-e5d33cb30782 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:39:54 test-preload-564056 crio[554]: time="2025-11-22T02:39:54.830500521Z" level=info msg="Removed container 4e5d338d40637c061d3de3a620e1a79e5035ba3632667696cbe94ff1dc0ea0e3: kube-system/kube-apiserver-test-preload-564056/kube-apiserver" id=2b9e9a03-d253-444b-bd2c-e5d33cb30782 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:40:01 test-preload-564056 crio[554]: time="2025-11-22T02:40:01.835631336Z" level=info msg="Removing container: 8684a532c1827a22501b88fa4f27620cec7919cee14f14948bb03cc64c76bd08" id=f7951af1-2802-49e4-9c1f-50a7d1c90491 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:40:01 test-preload-564056 crio[554]: time="2025-11-22T02:40:01.843606521Z" level=info msg="Removed container 8684a532c1827a22501b88fa4f27620cec7919cee14f14948bb03cc64c76bd08: kube-system/kube-controller-manager-test-preload-564056/kube-controller-manager" id=f7951af1-2802-49e4-9c1f-50a7d1c90491 name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
ce4da245c965b 8cab3d2a8bd0fe4127810f35afe0ffd42bfe75b2a4712a84da5595d4bde617d3 About a minute ago Exited kube-controller-manager 6 834741e989c7a kube-controller-manager-test-preload-564056 kube-system
b7e1c12090cf3 c2e17b8d0f4a39ed32f1c1fd4eb408627c94111ae9a46c2034758e4ced4f79c4 About a minute ago Exited kube-apiserver 6 d902461b8327a kube-apiserver-test-preload-564056 kube-system
8e91c7314bcfd a389e107f4ff1130c69849f0af08cbce9a1dfe3b7c39874012587d233807cfc5 6 minutes ago Running kube-scheduler 1 17bc3f2dd3b06 kube-scheduler-test-preload-564056 kube-system
==> describe nodes <==
command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
==> dmesg <==
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
[Nov22 01:58] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.019095] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000021] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023876] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023874] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023866] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023868] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000009] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +2.047813] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +4.031574] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +8.127154] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 01:59] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
==> kernel <==
02:40:56 up 1:23, 0 user, load average: 0.03, 0.29, 0.58
Linux test-preload-564056 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kube-apiserver [b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66] <==
I1122 02:39:33.370534 1 server.go:145] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
W1122 02:39:33.885037 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:33.885102 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
I1122 02:39:33.886719 1 shared_informer.go:313] Waiting for caches to sync for node_authorizer
I1122 02:39:33.894885 1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]
I1122 02:39:33.901388 1 plugins.go:157] Loaded 13 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionPolicy,MutatingAdmissionWebhook.
I1122 02:39:33.901407 1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I1122 02:39:33.901570 1 instance.go:233] Using reconciler: lease
W1122 02:39:33.902289 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:34.886219 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:34.886228 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:34.902946 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:36.278119 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:36.472157 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:36.660319 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:38.595984 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:38.785564 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:38.907492 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:41.963733 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:42.076559 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:43.592265 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:47.738928 1 logging.go:55] [core] [Channel #5 SubChannel #6]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:47.741259 1 logging.go:55] [core] [Channel #2 SubChannel #4]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W1122 02:39:50.070058 1 logging.go:55] [core] [Channel #1 SubChannel #3]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
F1122 02:39:53.903053 1 instance.go:226] Error creating leases: error creating storage factory: context deadline exceeded
==> kube-controller-manager [ce4da245c965be4662bec3219d2eb3bd29e5fd7a9bdb3514863b1374c098d66b] <==
I1122 02:39:40.788754 1 serving.go:386] Generated self-signed cert in-memory
I1122 02:39:41.105735 1 controllermanager.go:185] "Starting" version="v1.32.0"
I1122 02:39:41.105759 1 controllermanager.go:187] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:39:41.107161 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I1122 02:39:41.107165 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I1122 02:39:41.107406 1 secure_serving.go:213] Serving securely on 127.0.0.1:10257
I1122 02:39:41.107492 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E1122 02:40:01.109512 1 controllermanager.go:230] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.76.2:8443/healthz\": dial tcp 192.168.76.2:8443: connect: connection refused"
==> kube-scheduler [8e91c7314bcfdaec8a28a22440133e59f537690afa3056c0b355f044ba092e27] <==
E1122 02:40:29.690224 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get \"https://192.168.76.2:8443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:30.329469 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: Get "https://192.168.76.2:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:30.329533 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get \"https://192.168.76.2:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:35.370113 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.76.2:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:35.370177 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://192.168.76.2:8443/api/v1/services?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:38.976666 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.76.2:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:38.976730 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get \"https://192.168.76.2:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:42.581645 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.76.2:8443/api/v1/pods?fieldSelector=status.phase%21%3DSucceeded%2Cstatus.phase%21%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:42.581717 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get \"https://192.168.76.2:8443/api/v1/pods?fieldSelector=status.phase%21%3DSucceeded%2Cstatus.phase%21%3DFailed&limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:44.556040 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: Get "https://192.168.76.2:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:44.556132 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get \"https://192.168.76.2:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:50.350917 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.76.2:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:50.350980 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get \"https://192.168.76.2:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:51.407311 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: Get "https://192.168.76.2:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:51.407371 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: Get \"https://192.168.76.2:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:51.913005 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.76.2:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:51.913070 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get \"https://192.168.76.2:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:52.255799 1 reflector.go:569] runtime/asm_amd64.s:1700: failed to list *v1.ConfigMap: Get "https://192.168.76.2:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:52.255866 1 reflector.go:166] "Unhandled Error" err="runtime/asm_amd64.s:1700: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get \"https://192.168.76.2:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:53.351258 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.76.2:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:53.351318 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://192.168.76.2:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:53.573082 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: Get "https://192.168.76.2:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:53.573139 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get \"https://192.168.76.2:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
W1122 02:40:54.626755 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.76.2:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
E1122 02:40:54.626822 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get \"https://192.168.76.2:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
==> kubelet <==
Nov 22 02:40:36 test-preload-564056 kubelet[722]: E1122 02:40:36.290737 722 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-controller-manager pod=kube-controller-manager-test-preload-564056_kube-system(109ae28e99d5e53f9471e9276e10c1f5)\"" pod="kube-system/kube-controller-manager-test-preload-564056" podUID="109ae28e99d5e53f9471e9276e10c1f5"
Nov 22 02:40:36 test-preload-564056 kubelet[722]: I1122 02:40:36.865963 722 kubelet_node_status.go:76] "Attempting to register node" node="test-preload-564056"
Nov 22 02:40:36 test-preload-564056 kubelet[722]: E1122 02:40:36.866224 722 kubelet_node_status.go:108] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.76.2:8443: connect: connection refused" node="test-preload-564056"
Nov 22 02:40:37 test-preload-564056 kubelet[722]: E1122 02:40:37.850791 722 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/test-preload-564056?timeout=10s\": dial tcp 192.168.76.2:8443: connect: connection refused" interval="7s"
Nov 22 02:40:38 test-preload-564056 kubelet[722]: E1122 02:40:38.290243 722 kubelet.go:3196] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"test-preload-564056\" not found" node="test-preload-564056"
Nov 22 02:40:38 test-preload-564056 kubelet[722]: I1122 02:40:38.290332 722 scope.go:117] "RemoveContainer" containerID="b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66"
Nov 22 02:40:38 test-preload-564056 kubelet[722]: E1122 02:40:38.290507 722 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-apiserver pod=kube-apiserver-test-preload-564056_kube-system(50b2cadbfca126323739235d58129385)\"" pod="kube-system/kube-apiserver-test-preload-564056" podUID="50b2cadbfca126323739235d58129385"
Nov 22 02:40:39 test-preload-564056 kubelet[722]: W1122 02:40:39.444264 722 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.76.2:8443: connect: connection refused
Nov 22 02:40:39 test-preload-564056 kubelet[722]: E1122 02:40:39.444329 722 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.76.2:8443: connect: connection refused" logger="UnhandledError"
Nov 22 02:40:43 test-preload-564056 kubelet[722]: I1122 02:40:43.867627 722 kubelet_node_status.go:76] "Attempting to register node" node="test-preload-564056"
Nov 22 02:40:43 test-preload-564056 kubelet[722]: E1122 02:40:43.867933 722 kubelet_node_status.go:108] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.76.2:8443: connect: connection refused" node="test-preload-564056"
Nov 22 02:40:44 test-preload-564056 kubelet[722]: E1122 02:40:44.852094 722 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/test-preload-564056?timeout=10s\": dial tcp 192.168.76.2:8443: connect: connection refused" interval="7s"
Nov 22 02:40:45 test-preload-564056 kubelet[722]: E1122 02:40:45.161702 722 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events\": dial tcp 192.168.76.2:8443: connect: connection refused" event="&Event{ObjectMeta:{test-preload-564056.187a338f73bc721f default 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:test-preload-564056,UID:test-preload-564056,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node test-preload-564056 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:test-preload-564056,},FirstTimestamp:2025-11-22 02:34:55.284040223 +0000 UTC m=+0.070485579,LastTimestamp:2025-11-22 02:34:55.284040223 +0000 UTC m=+0.070485579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstan
ce:test-preload-564056,}"
Nov 22 02:40:45 test-preload-564056 kubelet[722]: E1122 02:40:45.309107 722 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"test-preload-564056\" not found"
Nov 22 02:40:47 test-preload-564056 kubelet[722]: E1122 02:40:47.290499 722 kubelet.go:3196] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"test-preload-564056\" not found" node="test-preload-564056"
Nov 22 02:40:47 test-preload-564056 kubelet[722]: I1122 02:40:47.290604 722 scope.go:117] "RemoveContainer" containerID="ce4da245c965be4662bec3219d2eb3bd29e5fd7a9bdb3514863b1374c098d66b"
Nov 22 02:40:47 test-preload-564056 kubelet[722]: E1122 02:40:47.290808 722 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-controller-manager pod=kube-controller-manager-test-preload-564056_kube-system(109ae28e99d5e53f9471e9276e10c1f5)\"" pod="kube-system/kube-controller-manager-test-preload-564056" podUID="109ae28e99d5e53f9471e9276e10c1f5"
Nov 22 02:40:50 test-preload-564056 kubelet[722]: I1122 02:40:50.869106 722 kubelet_node_status.go:76] "Attempting to register node" node="test-preload-564056"
Nov 22 02:40:50 test-preload-564056 kubelet[722]: E1122 02:40:50.869433 722 kubelet_node_status.go:108] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.76.2:8443: connect: connection refused" node="test-preload-564056"
Nov 22 02:40:51 test-preload-564056 kubelet[722]: E1122 02:40:51.853218 722 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/test-preload-564056?timeout=10s\": dial tcp 192.168.76.2:8443: connect: connection refused" interval="7s"
Nov 22 02:40:52 test-preload-564056 kubelet[722]: E1122 02:40:52.290594 722 kubelet.go:3196] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"test-preload-564056\" not found" node="test-preload-564056"
Nov 22 02:40:52 test-preload-564056 kubelet[722]: I1122 02:40:52.290685 722 scope.go:117] "RemoveContainer" containerID="b7e1c12090cf3e918b16d60e8a9eed88e691e73e8456ac442ecfe9e5ad612f66"
Nov 22 02:40:52 test-preload-564056 kubelet[722]: E1122 02:40:52.290851 722 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-apiserver pod=kube-apiserver-test-preload-564056_kube-system(50b2cadbfca126323739235d58129385)\"" pod="kube-system/kube-apiserver-test-preload-564056" podUID="50b2cadbfca126323739235d58129385"
Nov 22 02:40:55 test-preload-564056 kubelet[722]: E1122 02:40:55.162985 722 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events\": dial tcp 192.168.76.2:8443: connect: connection refused" event="&Event{ObjectMeta:{test-preload-564056.187a338f73bc721f default 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:test-preload-564056,UID:test-preload-564056,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node test-preload-564056 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:test-preload-564056,},FirstTimestamp:2025-11-22 02:34:55.284040223 +0000 UTC m=+0.070485579,LastTimestamp:2025-11-22 02:34:55.284040223 +0000 UTC m=+0.070485579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstan
ce:test-preload-564056,}"
Nov 22 02:40:55 test-preload-564056 kubelet[722]: E1122 02:40:55.310126 722 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"test-preload-564056\" not found"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p test-preload-564056 -n test-preload-564056
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p test-preload-564056 -n test-preload-564056: exit status 2 (284.116763ms)
-- stdout --
Stopped
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:264: "test-preload-564056" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-564056" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p test-preload-564056
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-564056: (2.315649203s)
--- FAIL: TestPreload (428.99s)
=== RUN TestPause/serial/Pause
pause_test.go:110: (dbg) Run: out/minikube-linux-amd64 pause -p pause-537523 --alsologtostderr -v=5
pause_test.go:110: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-537523 --alsologtostderr -v=5: exit status 80 (1.992169478s)
-- stdout --
* Pausing node pause-537523 ...
-- /stdout --
** stderr **
I1122 02:43:56.784997 200497 out.go:360] Setting OutFile to fd 1 ...
I1122 02:43:56.785132 200497 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:56.785145 200497 out.go:374] Setting ErrFile to fd 2...
I1122 02:43:56.785151 200497 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:56.785458 200497 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:43:56.785740 200497 out.go:368] Setting JSON to false
I1122 02:43:56.785796 200497 mustload.go:66] Loading cluster: pause-537523
I1122 02:43:56.786869 200497 config.go:182] Loaded profile config "pause-537523": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:43:56.787461 200497 cli_runner.go:164] Run: docker container inspect pause-537523 --format={{.State.Status}}
I1122 02:43:56.812091 200497 host.go:66] Checking if "pause-537523" exists ...
I1122 02:43:56.812477 200497 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:43:56.896896 200497 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:78 OomKillDisable:false NGoroutines:86 SystemTime:2025-11-22 02:43:56.883658165 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:43:56.897761 200497 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-537523 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) want
virtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:43:56.899307 200497 out.go:179] * Pausing node pause-537523 ...
I1122 02:43:56.900946 200497 host.go:66] Checking if "pause-537523" exists ...
I1122 02:43:56.901276 200497 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:56.901318 200497 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:56.925283 200497 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:57.031451 200497 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:57.049120 200497 pause.go:52] kubelet running: true
I1122 02:43:57.049212 200497 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:43:57.223894 200497 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:43:57.224036 200497 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:43:57.297999 200497 cri.go:89] found id: "a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e"
I1122 02:43:57.298028 200497 cri.go:89] found id: "76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83"
I1122 02:43:57.298033 200497 cri.go:89] found id: "8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443"
I1122 02:43:57.298036 200497 cri.go:89] found id: "19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4"
I1122 02:43:57.298038 200497 cri.go:89] found id: "f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522"
I1122 02:43:57.298040 200497 cri.go:89] found id: "954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5"
I1122 02:43:57.298043 200497 cri.go:89] found id: "3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b"
I1122 02:43:57.298045 200497 cri.go:89] found id: ""
I1122 02:43:57.298104 200497 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:43:57.310511 200497 retry.go:31] will retry after 296.483798ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:57Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:43:57.608119 200497 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:57.636821 200497 pause.go:52] kubelet running: false
I1122 02:43:57.636880 200497 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:43:57.820954 200497 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:43:57.821072 200497 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:43:57.923109 200497 cri.go:89] found id: "a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e"
I1122 02:43:57.923171 200497 cri.go:89] found id: "76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83"
I1122 02:43:57.923228 200497 cri.go:89] found id: "8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443"
I1122 02:43:57.923236 200497 cri.go:89] found id: "19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4"
I1122 02:43:57.923240 200497 cri.go:89] found id: "f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522"
I1122 02:43:57.923244 200497 cri.go:89] found id: "954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5"
I1122 02:43:57.923248 200497 cri.go:89] found id: "3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b"
I1122 02:43:57.923252 200497 cri.go:89] found id: ""
I1122 02:43:57.923432 200497 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:43:57.942813 200497 retry.go:31] will retry after 524.953588ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:57Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:43:58.468125 200497 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:58.482938 200497 pause.go:52] kubelet running: false
I1122 02:43:58.483001 200497 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:43:58.603071 200497 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:43:58.603140 200497 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:43:58.674870 200497 cri.go:89] found id: "a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e"
I1122 02:43:58.674892 200497 cri.go:89] found id: "76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83"
I1122 02:43:58.674895 200497 cri.go:89] found id: "8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443"
I1122 02:43:58.674898 200497 cri.go:89] found id: "19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4"
I1122 02:43:58.674901 200497 cri.go:89] found id: "f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522"
I1122 02:43:58.674916 200497 cri.go:89] found id: "954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5"
I1122 02:43:58.674920 200497 cri.go:89] found id: "3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b"
I1122 02:43:58.674924 200497 cri.go:89] found id: ""
I1122 02:43:58.674966 200497 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:43:58.688971 200497 out.go:203]
W1122 02:43:58.690182 200497 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:58Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:58Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:43:58.690205 200497 out.go:285] *
*
W1122 02:43:58.695382 200497 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:43:58.696493 200497 out.go:203]
** /stderr **
pause_test.go:112: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-537523 --alsologtostderr -v=5" : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestPause/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestPause/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect pause-537523
helpers_test.go:243: (dbg) docker inspect pause-537523:
-- stdout --
[
{
"Id": "ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430",
"Created": "2025-11-22T02:42:57.183534681Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 187891,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:42:57.258873196Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/hostname",
"HostsPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/hosts",
"LogPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430-json.log",
"Name": "/pause-537523",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"pause-537523:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "pause-537523",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430",
"LowerDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/merged",
"UpperDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/diff",
"WorkDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "pause-537523",
"Source": "/var/lib/docker/volumes/pause-537523/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "pause-537523",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "pause-537523",
"name.minikube.sigs.k8s.io": "pause-537523",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "6f858a54b892d6e444da003c35ec673311bf9b8eb459c8fb28693b7362a7d585",
"SandboxKey": "/var/run/docker/netns/6f858a54b892",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32978"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32979"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32982"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32980"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32981"
}
]
},
"Networks": {
"pause-537523": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "869a3ed0d6d2f35d03c4475ed49a70b56606d421d3ddf6d31c0fc87bd8d0e4d1",
"EndpointID": "76c06bd5029657097713dde2b687916792b93e8186001f16d62784c2572db2b1",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "32:8a:dc:56:d3:ee",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"pause-537523",
"ef53e1f28f8a"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p pause-537523 -n pause-537523
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-537523 -n pause-537523: exit status 2 (504.995318ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestPause/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p pause-537523 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p pause-537523 logs -n 25: (1.150466929s)
helpers_test.go:260: TestPause/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬─────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼─────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ stop │ -p test-preload-564056 │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ 22 Nov 25 02:34 UTC │
│ start │ -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ │
│ delete │ -p test-preload-564056 │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:40 UTC │ 22 Nov 25 02:40 UTC │
│ start │ -p scheduled-stop-195879 --memory=3072 --driver=docker --container-runtime=crio │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:40 UTC │ 22 Nov 25 02:41 UTC │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --cancel-scheduled │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ 22 Nov 25 02:41 UTC │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ 22 Nov 25 02:42 UTC │
│ delete │ -p scheduled-stop-195879 │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:42 UTC │
│ start │ -p insufficient-storage-280464 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=crio │ insufficient-storage-280464 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ │
│ delete │ -p insufficient-storage-280464 │ insufficient-storage-280464 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:42 UTC │
│ start │ -p offline-crio-452181 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=crio │ offline-crio-452181 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p pause-537523 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=crio │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p missing-upgrade-562593 --memory=3072 --driver=docker --container-runtime=crio │ missing-upgrade-562593 │ jenkins │ v1.32.0 │ 22 Nov 25 02:42 UTC │ │
│ start │ -p stopped-upgrade-549569 --memory=3072 --vm-driver=docker --container-runtime=crio │ stopped-upgrade-549569 │ jenkins │ v1.32.0 │ 22 Nov 25 02:42 UTC │ │
│ start │ -p pause-537523 --alsologtostderr -v=1 --driver=docker --container-runtime=crio │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ 22 Nov 25 02:43 UTC │
│ delete │ -p offline-crio-452181 │ offline-crio-452181 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=crio │ kubernetes-upgrade-019060 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ │
│ pause │ -p pause-537523 --alsologtostderr -v=5 │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴─────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:43:41
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:43:41.506878 194201 out.go:360] Setting OutFile to fd 1 ...
I1122 02:43:41.506995 194201 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:41.507002 194201 out.go:374] Setting ErrFile to fd 2...
I1122 02:43:41.507008 194201 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:41.507291 194201 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:43:41.507832 194201 out.go:368] Setting JSON to false
I1122 02:43:41.508900 194201 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5164,"bootTime":1763774257,"procs":277,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:43:41.509052 194201 start.go:143] virtualization: kvm guest
I1122 02:43:41.513122 194201 out.go:179] * [kubernetes-upgrade-019060] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:43:41.514324 194201 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:43:41.514318 194201 notify.go:221] Checking for updates...
I1122 02:43:41.515649 194201 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:43:41.516732 194201 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:41.517996 194201 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:43:41.519214 194201 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:43:41.520428 194201 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:43:41.522357 194201 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:41.522564 194201 config.go:182] Loaded profile config "pause-537523": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:43:41.522682 194201 config.go:182] Loaded profile config "stopped-upgrade-549569": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:41.522809 194201 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:43:41.552959 194201 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:43:41.553207 194201 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:43:41.628177 194201 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:71 OomKillDisable:false NGoroutines:85 SystemTime:2025-11-22 02:43:41.61622402 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:43:41.628327 194201 docker.go:319] overlay module found
I1122 02:43:41.630169 194201 out.go:179] * Using the docker driver based on user configuration
I1122 02:43:41.631376 194201 start.go:309] selected driver: docker
I1122 02:43:41.631391 194201 start.go:927] validating driver "docker" against <nil>
I1122 02:43:41.631411 194201 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:43:41.632230 194201 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:43:41.708711 194201 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:68 OomKillDisable:false NGoroutines:79 SystemTime:2025-11-22 02:43:41.6961446 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:43:41.708945 194201 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 02:43:41.709262 194201 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
I1122 02:43:41.711150 194201 out.go:179] * Using Docker driver with root privileges
I1122 02:43:41.712529 194201 cni.go:84] Creating CNI manager for ""
I1122 02:43:41.712606 194201 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:41.712621 194201 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 02:43:41.712718 194201 start.go:353] cluster config:
{Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:41.714393 194201 out.go:179] * Starting "kubernetes-upgrade-019060" primary control-plane node in "kubernetes-upgrade-019060" cluster
I1122 02:43:41.716282 194201 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:43:41.717534 194201 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:43:41.718586 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:41.718620 194201 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
I1122 02:43:41.718637 194201 cache.go:65] Caching tarball of preloaded images
I1122 02:43:41.718649 194201 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:43:41.718737 194201 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:43:41.718750 194201 cache.go:68] Finished verifying existence of preloaded tar for v1.28.0 on crio
I1122 02:43:41.718872 194201 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json ...
I1122 02:43:41.718899 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json: {Name:mk0e0be1d4d3830f1ef53ffcbf5d6a40467f3ce3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:41.754272 194201 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:43:41.754303 194201 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:43:41.754317 194201 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:43:41.754349 194201 start.go:360] acquireMachinesLock for kubernetes-upgrade-019060: {Name:mkb63638579b47878f0940e681a90c1443ca2192 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:43:41.754434 194201 start.go:364] duration metric: took 65.59µs to acquireMachinesLock for "kubernetes-upgrade-019060"
I1122 02:43:41.754455 194201 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:41.754553 194201 start.go:125] createHost starting for "" (driver="docker")
I1122 02:43:41.065623 192693 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:41.065651 192693 machine.go:97] duration metric: took 6.476871268s to provisionDockerMachine
I1122 02:43:41.065667 192693 start.go:293] postStartSetup for "pause-537523" (driver="docker")
I1122 02:43:41.065681 192693 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:41.065769 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:41.065820 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.084343 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.176779 192693 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:41.180139 192693 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:41.180166 192693 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:43:41.180176 192693 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:41.180228 192693 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:41.180322 192693 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:41.180454 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:41.187750 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:41.204002 192693 start.go:296] duration metric: took 138.32119ms for postStartSetup
I1122 02:43:41.204071 192693 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:41.204116 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.223016 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.322092 192693 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:41.327155 192693 fix.go:56] duration metric: took 6.76056806s for fixHost
I1122 02:43:41.327186 192693 start.go:83] releasing machines lock for "pause-537523", held for 6.760638727s
I1122 02:43:41.327261 192693 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-537523
I1122 02:43:41.346884 192693 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:41.346965 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.347019 192693 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:41.347089 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.369029 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.371298 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.481011 192693 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:41.551324 192693 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:41.604439 192693 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:43:41.612601 192693 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:43:41.612826 192693 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:41.623441 192693 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:43:41.623470 192693 start.go:496] detecting cgroup driver to use...
I1122 02:43:41.623505 192693 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:43:41.623551 192693 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:41.643501 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:41.662610 192693 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:43:41.662688 192693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:41.685892 192693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:41.707637 192693 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:41.886761 192693 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:42.115483 192693 docker.go:234] disabling docker service ...
I1122 02:43:42.115545 192693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:42.140728 192693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:42.162883 192693 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:42.334337 192693 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:42.483812 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:42.505755 192693 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:42.529776 192693 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:43:42.529876 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.541718 192693 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:42.541779 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.552617 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.563089 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.572531 192693 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:42.580531 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.589460 192693 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.598894 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.610088 192693 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:42.619563 192693 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:42.628235 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:42.760733 192693 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:43.040841 192693 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:43.040920 192693 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:43.045509 192693 start.go:564] Will wait 60s for crictl version
I1122 02:43:43.045564 192693 ssh_runner.go:195] Run: which crictl
I1122 02:43:43.049060 192693 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:43:43.079432 192693 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:43:43.079524 192693 ssh_runner.go:195] Run: crio --version
I1122 02:43:43.110158 192693 ssh_runner.go:195] Run: crio --version
I1122 02:43:43.143058 192693 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:43:43.144240 192693 cli_runner.go:164] Run: docker network inspect pause-537523 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:43.165446 192693 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:43:43.170331 192693 kubeadm.go:884] updating cluster {Name:pause-537523 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false regist
ry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:43:43.170541 192693 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:43:43.170604 192693 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:43.207307 192693 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:43.207330 192693 crio.go:433] Images already preloaded, skipping extraction
I1122 02:43:43.207382 192693 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:43.237145 192693 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:43.237167 192693 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:43:43.237174 192693 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:43:43.237283 192693 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=pause-537523 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:43:43.237350 192693 ssh_runner.go:195] Run: crio config
I1122 02:43:43.285538 192693 cni.go:84] Creating CNI manager for ""
I1122 02:43:43.285562 192693 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:43.285582 192693 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:43:43.285609 192693 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-537523 NodeName:pause-537523 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes
/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:43.285755 192693 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "pause-537523"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:43.285834 192693 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:43:43.294719 192693 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:43:43.294781 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:43.302642 192693 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I1122 02:43:43.316668 192693 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:43.331543 192693 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2208 bytes)
I1122 02:43:43.345667 192693 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:43.350480 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:43.480533 192693 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:43.495376 192693 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523 for IP: 192.168.85.2
I1122 02:43:43.495402 192693 certs.go:195] generating shared ca certs ...
I1122 02:43:43.495421 192693 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:43.495591 192693 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:43.495660 192693 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:43.495681 192693 certs.go:257] generating profile certs ...
I1122 02:43:43.495799 192693 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key
I1122 02:43:43.495871 192693 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.key.b88d4e2f
I1122 02:43:43.495959 192693 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.key
I1122 02:43:43.496107 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:43.496236 192693 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:43.496402 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:43.496453 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:43.496490 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:43.496582 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:43.496646 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.498471 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:43.524633 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:43.545964 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:43.566070 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:43.582815 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I1122 02:43:43.600041 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1122 02:43:43.617827 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:43.635344 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:43:43.653161 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:43.672725 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:43.694951 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:43.714561 192693 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:43.729479 192693 ssh_runner.go:195] Run: openssl version
I1122 02:43:43.735899 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:43.745768 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:43.749477 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:43.749550 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:43.786496 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:43.794552 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:43.802595 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.806145 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.806193 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.840253 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:43.848166 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:43.856251 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:43.860300 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:43.860351 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:43.917666 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:43.928103 192693 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:43:43.932821 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:43:43.981504 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:43:44.016541 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:43:44.060119 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:43:44.107431 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:43:44.155160 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:43:44.198731 192693 kubeadm.go:401] StartCluster: {Name:pause-537523 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-
aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:44.198863 192693 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:44.198982 192693 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:44.249695 192693 cri.go:89] found id: "a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e"
I1122 02:43:44.249721 192693 cri.go:89] found id: "76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83"
I1122 02:43:44.249727 192693 cri.go:89] found id: "8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443"
I1122 02:43:44.249733 192693 cri.go:89] found id: "19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4"
I1122 02:43:44.249738 192693 cri.go:89] found id: "f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522"
I1122 02:43:44.249742 192693 cri.go:89] found id: "954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5"
I1122 02:43:44.249747 192693 cri.go:89] found id: "3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b"
I1122 02:43:44.249751 192693 cri.go:89] found id: ""
I1122 02:43:44.249800 192693 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:43:44.262143 192693 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:44Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:43:44.262235 192693 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:44.270983 192693 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:43:44.271003 192693 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:43:44.271056 192693 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:43:44.280778 192693 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:43:44.281470 192693 kubeconfig.go:125] found "pause-537523" server: "https://192.168.85.2:8443"
I1122 02:43:44.282285 192693 kapi.go:59] client config for pause-537523: &rest.Config{Host:"https://192.168.85.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]stri
ng(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:43:44.282727 192693 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1122 02:43:44.282745 192693 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1122 02:43:44.282750 192693 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1122 02:43:44.282754 192693 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1122 02:43:44.282757 192693 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1122 02:43:44.283172 192693 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:43:44.291001 192693 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:43:44.291030 192693 kubeadm.go:602] duration metric: took 20.020682ms to restartPrimaryControlPlane
I1122 02:43:44.291040 192693 kubeadm.go:403] duration metric: took 92.323119ms to StartCluster
I1122 02:43:44.291058 192693 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:44.291125 192693 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:44.291799 192693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:44.292045 192693 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:44.292123 192693 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:43:44.292346 192693 config.go:182] Loaded profile config "pause-537523": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:43:44.293502 192693 out.go:179] * Verifying Kubernetes components...
I1122 02:43:44.293518 192693 out.go:179] * Enabled addons:
I1122 02:43:40.944455 186979 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-562593:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (6.06560741s)
I1122 02:43:40.944479 186979 kic.go:203] duration metric: took 6.065748 seconds to extract preloaded images to volume
W1122 02:43:40.944573 186979 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:40.944600 186979 oci.go:243] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:40.944633 186979 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:41.013483 186979 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-562593 --name missing-upgrade-562593 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-562593 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-562593 --network missing-upgrade-562593 --ip 192.168.103.2 --volume missing-upgrade-562593:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
I1122 02:43:41.539473 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Running}}
I1122 02:43:41.564019 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:41.590265 186979 cli_runner.go:164] Run: docker exec missing-upgrade-562593 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:41.649551 186979 oci.go:144] the created container "missing-upgrade-562593" has a running status.
I1122 02:43:41.649576 186979 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa...
I1122 02:43:41.862570 186979 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:41.898801 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:41.938943 186979 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:41.938957 186979 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-562593 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:42.032533 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:42.063158 186979 machine.go:88] provisioning docker machine ...
I1122 02:43:42.063195 186979 ubuntu.go:169] provisioning hostname "missing-upgrade-562593"
I1122 02:43:42.063264 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.091747 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.092543 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:42.092584 186979 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-562593 && echo "missing-upgrade-562593" | sudo tee /etc/hostname
I1122 02:43:42.262961 186979 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-562593
I1122 02:43:42.263034 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.288625 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.289165 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:42.289186 186979 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-562593' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-562593/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-562593' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:42.426428 186979 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:42.426453 186979 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:42.426485 186979 ubuntu.go:177] setting up certificates
I1122 02:43:42.426507 186979 provision.go:83] configureAuth start
I1122 02:43:42.426578 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:42.453696 186979 provision.go:138] copyHostCerts
I1122 02:43:42.453782 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:42.453792 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:42.453878 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:42.454038 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:42.454047 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:42.454111 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:42.454213 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:42.454222 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:42.454264 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:42.454343 186979 provision.go:112] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-562593 san=[192.168.103.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-562593]
I1122 02:43:42.863793 186979 provision.go:172] copyRemoteCerts
I1122 02:43:42.863840 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:42.863878 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.884686 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:42.979289 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:43.011052 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:43.037697 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:43.066063 186979 provision.go:86] duration metric: configureAuth took 639.543926ms
I1122 02:43:43.066085 186979 ubuntu.go:193] setting minikube options for container-runtime
I1122 02:43:43.066260 186979 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:43.066369 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.087839 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:43.088201 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:43.088214 186979 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:43.348249 186979 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:43.348269 186979 machine.go:91] provisioned docker machine in 1.285095917s
I1122 02:43:43.348280 186979 client.go:171] LocalClient.Create took 25.278306059s
I1122 02:43:43.348303 186979 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-562593" took 25.278400311s
I1122 02:43:43.348311 186979 start.go:300] post-start starting for "missing-upgrade-562593" (driver="docker")
I1122 02:43:43.348323 186979 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:43.348393 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:43.348437 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.368444 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.470863 186979 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:43.474525 186979 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:43.474557 186979 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1122 02:43:43.474569 186979 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1122 02:43:43.474576 186979 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I1122 02:43:43.474587 186979 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:43.474637 186979 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:43.474740 186979 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:43.474865 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:43.485171 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.518252 186979 start.go:303] post-start completed in 169.923393ms
I1122 02:43:43.518668 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:43.541550 186979 profile.go:148] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/config.json ...
I1122 02:43:43.541876 186979 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:43.541945 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.562632 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.650447 186979 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:43.656257 186979 start.go:128] duration metric: createHost completed in 25.587941752s
I1122 02:43:43.656272 186979 start.go:83] releasing machines lock for "missing-upgrade-562593", held for 25.588056206s
I1122 02:43:43.656328 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:43.678177 186979 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:43.678212 186979 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:43.678223 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.678265 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.700656 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.700732 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.895534 186979 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:43.901317 186979 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:44.052110 186979 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1122 02:43:44.056814 186979 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:44.081388 186979 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I1122 02:43:44.081481 186979 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:44.118579 186979 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I1122 02:43:44.118593 186979 start.go:472] detecting cgroup driver to use...
I1122 02:43:44.118626 186979 detect.go:199] detected "systemd" cgroup driver on host os
I1122 02:43:44.118675 186979 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:44.135557 186979 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:44.147616 186979 docker.go:203] disabling cri-docker service (if available) ...
I1122 02:43:44.147668 186979 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:44.163502 186979 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:44.179709 186979 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:44.266507 186979 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:44.358399 186979 docker.go:219] disabling docker service ...
I1122 02:43:44.358465 186979 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:44.377794 186979 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:44.389472 186979 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:44.476193 186979 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:44.716209 186979 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:44.728395 186979 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:44.745894 186979 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:44.745958 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.855799 186979 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:44.855876 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.927079 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.976536 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.993620 186979 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:45.003350 186979 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:45.011869 186979 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:45.020535 186979 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:45.090137 186979 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:41.242207 186990 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v stopped-upgrade-549569:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (6.342832556s)
I1122 02:43:41.242345 186990 kic.go:203] duration metric: took 6.343109 seconds to extract preloaded images to volume
W1122 02:43:41.242455 186990 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:41.242493 186990 oci.go:243] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:41.242543 186990 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:41.308913 186990 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname stopped-upgrade-549569 --name stopped-upgrade-549569 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=stopped-upgrade-549569 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=stopped-upgrade-549569 --network stopped-upgrade-549569 --ip 192.168.94.2 --volume stopped-upgrade-549569:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
I1122 02:43:41.671585 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Running}}
I1122 02:43:41.698377 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:41.721725 186990 cli_runner.go:164] Run: docker exec stopped-upgrade-549569 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:41.788480 186990 oci.go:144] the created container "stopped-upgrade-549569" has a running status.
I1122 02:43:41.788505 186990 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa...
I1122 02:43:42.085975 186990 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:42.126811 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:42.153790 186990 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:42.153920 186990 kic_runner.go:114] Args: [docker exec --privileged stopped-upgrade-549569 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:42.235331 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:42.262179 186990 machine.go:88] provisioning docker machine ...
I1122 02:43:42.262216 186990 ubuntu.go:169] provisioning hostname "stopped-upgrade-549569"
I1122 02:43:42.262301 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.288483 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.289129 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.289146 186990 main.go:141] libmachine: About to run SSH command:
sudo hostname stopped-upgrade-549569 && echo "stopped-upgrade-549569" | sudo tee /etc/hostname
I1122 02:43:42.442787 186990 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-549569
I1122 02:43:42.442894 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.468534 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.469245 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.469267 186990 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sstopped-upgrade-549569' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-549569/g' /etc/hosts;
else
echo '127.0.1.1 stopped-upgrade-549569' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:42.599578 186990 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:42.599599 186990 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:42.599637 186990 ubuntu.go:177] setting up certificates
I1122 02:43:42.599654 186990 provision.go:83] configureAuth start
I1122 02:43:42.599719 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:42.621177 186990 provision.go:138] copyHostCerts
I1122 02:43:42.621233 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:42.621240 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:42.621308 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:42.621407 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:42.621412 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:42.621450 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:42.621522 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:42.621527 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:42.621562 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:42.621623 186990 provision.go:112] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-549569 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-549569]
I1122 02:43:42.721472 186990 provision.go:172] copyRemoteCerts
I1122 02:43:42.721530 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:42.721574 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.743269 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:42.836445 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:42.866154 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:42.893687 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:42.918672 186990 provision.go:86] duration metric: configureAuth took 319.003441ms
I1122 02:43:42.918693 186990 ubuntu.go:193] setting minikube options for container-runtime
I1122 02:43:42.918894 186990 config.go:182] Loaded profile config "stopped-upgrade-549569": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:42.919074 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.939765 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.940208 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.940230 186990 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:43.180837 186990 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:43.180854 186990 machine.go:91] provisioned docker machine in 918.66032ms
I1122 02:43:43.180865 186990 client.go:171] LocalClient.Create took 25.115137961s
I1122 02:43:43.180887 186990 start.go:167] duration metric: libmachine.API.Create for "stopped-upgrade-549569" took 25.115181688s
I1122 02:43:43.180896 186990 start.go:300] post-start starting for "stopped-upgrade-549569" (driver="docker")
I1122 02:43:43.180934 186990 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:43.180997 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:43.181030 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.200780 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.292036 186990 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:43.296347 186990 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:43.296381 186990 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1122 02:43:43.296393 186990 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1122 02:43:43.296401 186990 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I1122 02:43:43.296413 186990 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:43.296467 186990 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:43.296570 186990 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:43.296684 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:43.306218 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.336257 186990 start.go:303] post-start completed in 155.343861ms
I1122 02:43:43.336668 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:43.358330 186990 profile.go:148] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/config.json ...
I1122 02:43:43.358626 186990 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:43.358674 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.379791 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.470000 186990 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:43.474818 186990 start.go:128] duration metric: createHost completed in 25.410908927s
I1122 02:43:43.474835 186990 start.go:83] releasing machines lock for "stopped-upgrade-549569", held for 25.4110247s
I1122 02:43:43.474928 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:43.498189 186990 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:43.498243 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.498268 186990 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:43.498325 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.520011 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.520637 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.607192 186990 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:43.718205 186990 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:43.861814 186990 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1122 02:43:43.866609 186990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:43.896586 186990 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I1122 02:43:43.896660 186990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:43.932708 186990 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I1122 02:43:43.932725 186990 start.go:472] detecting cgroup driver to use...
I1122 02:43:43.932762 186990 detect.go:199] detected "systemd" cgroup driver on host os
I1122 02:43:43.932812 186990 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:43.950381 186990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:43.964646 186990 docker.go:203] disabling cri-docker service (if available) ...
I1122 02:43:43.964703 186990 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:43.979328 186990 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:43.994738 186990 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:44.072770 186990 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:44.165393 186990 docker.go:219] disabling docker service ...
I1122 02:43:44.165451 186990 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:44.184326 186990 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:44.197186 186990 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:44.294439 186990 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:44.521112 186990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:44.532929 186990 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:44.549091 186990 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:44.549147 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.564139 186990 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:44.564195 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.574521 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.584377 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.594145 186990 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:44.603405 186990 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:44.611845 186990 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:44.620126 186990 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:44.700306 186990 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:41.756442 194201 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1122 02:43:41.756723 194201 start.go:159] libmachine.API.Create for "kubernetes-upgrade-019060" (driver="docker")
I1122 02:43:41.756770 194201 client.go:173] LocalClient.Create starting
I1122 02:43:41.756863 194201 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 02:43:41.756926 194201 main.go:143] libmachine: Decoding PEM data...
I1122 02:43:41.756948 194201 main.go:143] libmachine: Parsing certificate...
I1122 02:43:41.757037 194201 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 02:43:41.757066 194201 main.go:143] libmachine: Decoding PEM data...
I1122 02:43:41.757078 194201 main.go:143] libmachine: Parsing certificate...
I1122 02:43:41.757500 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:43:41.781013 194201 cli_runner.go:211] docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:43:41.781102 194201 network_create.go:284] running [docker network inspect kubernetes-upgrade-019060] to gather additional debugging logs...
I1122 02:43:41.781135 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060
W1122 02:43:41.802604 194201 cli_runner.go:211] docker network inspect kubernetes-upgrade-019060 returned with exit code 1
I1122 02:43:41.802632 194201 network_create.go:287] error running [docker network inspect kubernetes-upgrade-019060]: docker network inspect kubernetes-upgrade-019060: exit status 1
stdout:
[]
stderr:
Error response from daemon: network kubernetes-upgrade-019060 not found
I1122 02:43:41.802648 194201 network_create.go:289] output of [docker network inspect kubernetes-upgrade-019060]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network kubernetes-upgrade-019060 not found
** /stderr **
I1122 02:43:41.802758 194201 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:41.826212 194201 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:43:41.827193 194201 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9423c3ade39b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:8e:36:bc:4b:d9:05} reservation:<nil>}
I1122 02:43:41.828091 194201 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-49270bd849d0 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:2a:04:6a:68:04:12} reservation:<nil>}
I1122 02:43:41.829690 194201 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001e98e10}
I1122 02:43:41.829825 194201 network_create.go:124] attempt to create docker network kubernetes-upgrade-019060 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I1122 02:43:41.830015 194201 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 kubernetes-upgrade-019060
I1122 02:43:41.906257 194201 network_create.go:108] docker network kubernetes-upgrade-019060 192.168.76.0/24 created
I1122 02:43:41.906292 194201 kic.go:121] calculated static IP "192.168.76.2" for the "kubernetes-upgrade-019060" container
I1122 02:43:41.906371 194201 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 02:43:41.966589 194201 cli_runner.go:164] Run: docker volume create kubernetes-upgrade-019060 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --label created_by.minikube.sigs.k8s.io=true
I1122 02:43:41.998308 194201 oci.go:103] Successfully created a docker volume kubernetes-upgrade-019060
I1122 02:43:41.998423 194201 cli_runner.go:164] Run: docker run --rm --name kubernetes-upgrade-019060-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --entrypoint /usr/bin/test -v kubernetes-upgrade-019060:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 02:43:42.548586 194201 oci.go:107] Successfully prepared a docker volume kubernetes-upgrade-019060
I1122 02:43:42.548679 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:42.548695 194201 kic.go:194] Starting extracting preloaded images to volume ...
I1122 02:43:42.548799 194201 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-019060:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 02:43:47.275256 186979 ssh_runner.go:235] Completed: sudo systemctl restart crio: (2.185084945s)
I1122 02:43:47.275281 186979 start.go:519] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:47.275327 186979 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:47.280645 186979 start.go:540] Will wait 60s for crictl version
I1122 02:43:47.280706 186979 ssh_runner.go:195] Run: which crictl
I1122 02:43:47.285237 186979 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1122 02:43:47.328955 186979 start.go:556] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I1122 02:43:47.329034 186979 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.368469 186979 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.273841 186990 ssh_runner.go:235] Completed: sudo systemctl restart crio: (2.573503097s)
I1122 02:43:47.273873 186990 start.go:519] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:47.273943 186990 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:47.280440 186990 start.go:540] Will wait 60s for crictl version
I1122 02:43:47.280514 186990 ssh_runner.go:195] Run: which crictl
I1122 02:43:47.285543 186990 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1122 02:43:47.329856 186990 start.go:556] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I1122 02:43:47.329979 186990 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.370346 186990 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.411060 186979 out.go:177] * Preparing Kubernetes v1.28.3 on CRI-O 1.24.6 ...
I1122 02:43:47.411754 186990 out.go:177] * Preparing Kubernetes v1.28.3 on CRI-O 1.24.6 ...
I1122 02:43:47.412530 186979 cli_runner.go:164] Run: docker network inspect missing-upgrade-562593 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:47.431302 186979 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:43:47.435164 186979 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.446268 186979 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime crio
I1122 02:43:47.446329 186979 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.514526 186979 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.514539 186979 crio.go:415] Images already preloaded, skipping extraction
I1122 02:43:47.514581 186979 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.554847 186979 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.554868 186979 cache_images.go:84] Images are preloaded, skipping loading
I1122 02:43:47.554985 186979 ssh_runner.go:195] Run: crio config
I1122 02:43:47.608651 186979 cni.go:84] Creating CNI manager for ""
I1122 02:43:47.608666 186979 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:47.608686 186979 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1122 02:43:47.608711 186979 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:missing-upgrade-562593 NodeName:missing-upgrade-562593 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt Static
PodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:47.608886 186979 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "missing-upgrade-562593"
kubeletExtraArgs:
node-ip: 192.168.103.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:47.608991 186979 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=missing-upgrade-562593 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-562593 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1122 02:43:47.609066 186979 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
I1122 02:43:47.618708 186979 binaries.go:44] Found k8s binaries, skipping transfer
I1122 02:43:47.618757 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:47.628104 186979 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (433 bytes)
I1122 02:43:47.648913 186979 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:47.674117 186979 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2105 bytes)
I1122 02:43:47.695415 186979 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:47.699461 186979 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.710964 186979 certs.go:56] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593 for IP: 192.168.103.2
I1122 02:43:47.710993 186979 certs.go:190] acquiring lock for shared ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.711150 186979 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:47.711198 186979 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:47.711256 186979 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key
I1122 02:43:47.711268 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt with IP's: []
I1122 02:43:47.801956 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt ...
I1122 02:43:47.801970 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt: {Name:mk71b3d2c793392c758f9424348b4590d3e9a031 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.802110 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key ...
I1122 02:43:47.802119 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key: {Name:mkad275acf23d5d3de6e0f51a62b039d993e2f45 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.802192 186979 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9
I1122 02:43:47.802202 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 with IP's: [192.168.103.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1122 02:43:48.210554 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 ...
I1122 02:43:48.210589 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9: {Name:mk14d297b67a580b4d61694d739e9e7421a3d746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.210780 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9 ...
I1122 02:43:48.210795 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9: {Name:mkfe54f5629efdd19e6e1e1eb1681d92250f357f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.210897 186979 certs.go:337] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt
I1122 02:43:48.211028 186979 certs.go:341] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key
I1122 02:43:48.211105 186979 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key
I1122 02:43:48.211128 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt with IP's: []
I1122 02:43:48.402894 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt ...
I1122 02:43:48.402919 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt: {Name:mk627e568909366e897fce92245611d8497909a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.403065 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key ...
I1122 02:43:48.403073 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key: {Name:mka5ee671291d8129d24ad09326ec8c519197c21 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.403243 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:48.403275 186979 certs.go:433] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:48.403286 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:48.403309 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:48.403332 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:48.403350 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:48.403383 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:48.404113 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1122 02:43:48.429806 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:48.453498 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:48.477406 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:43:48.500412 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:48.525139 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:48.549374 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:48.572880 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:48.596543 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:48.623071 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:48.647309 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:48.671289 186979 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:48.689111 186979 ssh_runner.go:195] Run: openssl version
I1122 02:43:48.694289 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:48.704734 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.708279 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.708327 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.715219 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:48.724804 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:48.734748 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:48.738666 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:48.738711 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:48.745680 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:48.755513 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:48.766814 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:48.771054 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:48.771100 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:48.778287 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:48.788651 186979 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I1122 02:43:48.792049 186979 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I1122 02:43:48.792093 186979 kubeadm.go:404] StartCluster: {Name:missing-upgrade-562593 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-562593 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1122 02:43:48.792167 186979 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:48.792212 186979 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:48.831455 186979 cri.go:89] found id: ""
I1122 02:43:48.831526 186979 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:48.841854 186979 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:48.851847 186979 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:48.851893 186979 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:48.861073 186979 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:48.861121 186979 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:48.910116 186979 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
I1122 02:43:48.910158 186979 kubeadm.go:322] [preflight] Running pre-flight checks
I1122 02:43:48.952652 186979 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:48.952746 186979 kubeadm.go:322] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:48.952796 186979 kubeadm.go:322] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:48.952892 186979 kubeadm.go:322] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:48.952990 186979 kubeadm.go:322] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:48.953052 186979 kubeadm.go:322] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:48.953115 186979 kubeadm.go:322] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:48.953178 186979 kubeadm.go:322] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:48.953237 186979 kubeadm.go:322] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:48.953306 186979 kubeadm.go:322] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:48.953364 186979 kubeadm.go:322] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:49.027803 186979 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:49.027998 186979 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:49.028142 186979 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:49.234141 186979 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:43:44.294508 192693 addons.go:530] duration metric: took 2.390522ms for enable addons: enabled=[]
I1122 02:43:44.294542 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:44.430976 192693 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:44.445182 192693 node_ready.go:35] waiting up to 6m0s for node "pause-537523" to be "Ready" ...
W1122 02:43:46.448105 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
W1122 02:43:48.448511 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
I1122 02:43:49.236759 186979 out.go:204] - Generating certificates and keys ...
I1122 02:43:49.236896 186979 kubeadm.go:322] [certs] Using existing ca certificate authority
I1122 02:43:49.237016 186979 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:49.387062 186979 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:49.594560 186979 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:49.773229 186979 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:49.862363 186979 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:49.993779 186979 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I1122 02:43:49.994492 186979 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [localhost missing-upgrade-562593] and IPs [192.168.103.2 127.0.0.1 ::1]
I1122 02:43:50.173924 186979 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:50.174157 186979 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [localhost missing-upgrade-562593] and IPs [192.168.103.2 127.0.0.1 ::1]
I1122 02:43:50.285638 186979 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:47.251277 194201 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-019060:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.702427625s)
I1122 02:43:47.251321 194201 kic.go:203] duration metric: took 4.702622549s to extract preloaded images to volume ...
W1122 02:43:47.251433 194201 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:47.251481 194201 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:47.251527 194201 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:47.318828 194201 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-019060 --name kubernetes-upgrade-019060 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --network kubernetes-upgrade-019060 --ip 192.168.76.2 --volume kubernetes-upgrade-019060:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
I1122 02:43:47.639766 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Running}}
I1122 02:43:47.658928 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:47.680186 194201 cli_runner.go:164] Run: docker exec kubernetes-upgrade-019060 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:47.725775 194201 oci.go:144] the created container "kubernetes-upgrade-019060" has a running status.
I1122 02:43:47.725812 194201 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa...
I1122 02:43:47.895859 194201 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:47.932615 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:47.958465 194201 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:47.958489 194201 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-019060 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:48.016178 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:48.037367 194201 machine.go:94] provisionDockerMachine start ...
I1122 02:43:48.037466 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.056673 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.057032 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.057055 194201 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:43:48.195572 194201 main.go:143] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-019060
I1122 02:43:48.195603 194201 ubuntu.go:182] provisioning hostname "kubernetes-upgrade-019060"
I1122 02:43:48.195675 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.217230 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.217533 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.217557 194201 main.go:143] libmachine: About to run SSH command:
sudo hostname kubernetes-upgrade-019060 && echo "kubernetes-upgrade-019060" | sudo tee /etc/hostname
I1122 02:43:48.360608 194201 main.go:143] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-019060
I1122 02:43:48.360691 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.379729 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.380045 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.380080 194201 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\skubernetes-upgrade-019060' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-019060/g' /etc/hosts;
else
echo '127.0.1.1 kubernetes-upgrade-019060' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:48.514172 194201 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:48.514197 194201 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:48.514221 194201 ubuntu.go:190] setting up certificates
I1122 02:43:48.514234 194201 provision.go:84] configureAuth start
I1122 02:43:48.514290 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:48.532806 194201 provision.go:143] copyHostCerts
I1122 02:43:48.532864 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:48.532875 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:48.532960 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:48.533095 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:48.533109 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:48.533156 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:48.533238 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:48.533248 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:48.533297 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:48.533371 194201 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-019060 san=[127.0.0.1 192.168.76.2 kubernetes-upgrade-019060 localhost minikube]
I1122 02:43:48.611067 194201 provision.go:177] copyRemoteCerts
I1122 02:43:48.611136 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:48.611179 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.629439 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:48.724835 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:48.745302 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:48.763328 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:48.781380 194201 provision.go:87] duration metric: took 267.130767ms to configureAuth
I1122 02:43:48.781412 194201 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:43:48.781587 194201 config.go:182] Loaded profile config "kubernetes-upgrade-019060": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:43:48.781694 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.800825 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.801144 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.801164 194201 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:49.081561 194201 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:49.081593 194201 machine.go:97] duration metric: took 1.044202233s to provisionDockerMachine
I1122 02:43:49.081606 194201 client.go:176] duration metric: took 7.324828905s to LocalClient.Create
I1122 02:43:49.081623 194201 start.go:167] duration metric: took 7.324902697s to libmachine.API.Create "kubernetes-upgrade-019060"
I1122 02:43:49.081632 194201 start.go:293] postStartSetup for "kubernetes-upgrade-019060" (driver="docker")
I1122 02:43:49.081645 194201 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:49.081719 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:49.081770 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.101307 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.203163 194201 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:49.207268 194201 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:49.207303 194201 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:43:49.207315 194201 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:49.207359 194201 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:49.207438 194201 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:49.207527 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:49.215051 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:49.235494 194201 start.go:296] duration metric: took 153.848197ms for postStartSetup
I1122 02:43:49.236407 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:49.253594 194201 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json ...
I1122 02:43:49.253843 194201 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:49.253896 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.271220 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.361268 194201 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:49.365360 194201 start.go:128] duration metric: took 7.61079158s to createHost
I1122 02:43:49.365383 194201 start.go:83] releasing machines lock for "kubernetes-upgrade-019060", held for 7.610940501s
I1122 02:43:49.365445 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:49.383939 194201 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:49.383967 194201 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:49.383983 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.384045 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.402407 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.402836 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.551007 194201 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:49.557212 194201 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:49.591932 194201 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:43:49.596296 194201 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:43:49.596359 194201 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:49.622688 194201 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 02:43:49.622720 194201 start.go:496] detecting cgroup driver to use...
I1122 02:43:49.622753 194201 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:43:49.622799 194201 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:49.639459 194201 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:49.650423 194201 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:43:49.650475 194201 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:49.665517 194201 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:49.683059 194201 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:49.766345 194201 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:49.867926 194201 docker.go:234] disabling docker service ...
I1122 02:43:49.867998 194201 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:49.887173 194201 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:49.898512 194201 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:49.984231 194201 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:50.067804 194201 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:50.079353 194201 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:50.092223 194201 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:50.092277 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.101877 194201 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:50.101982 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.110224 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.117946 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.125590 194201 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:50.133225 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.141125 194201 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.153394 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.161664 194201 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:50.168756 194201 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:50.175795 194201 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:50.254206 194201 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:50.402146 194201 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:50.402222 194201 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:50.406146 194201 start.go:564] Will wait 60s for crictl version
I1122 02:43:50.406206 194201 ssh_runner.go:195] Run: which crictl
I1122 02:43:50.409581 194201 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:43:50.434689 194201 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:43:50.434791 194201 ssh_runner.go:195] Run: crio --version
I1122 02:43:50.464384 194201 ssh_runner.go:195] Run: crio --version
I1122 02:43:50.498177 194201 out.go:179] * Preparing Kubernetes v1.28.0 on CRI-O 1.34.2 ...
I1122 02:43:47.413147 186990 cli_runner.go:164] Run: docker network inspect stopped-upgrade-549569 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:47.431604 186990 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:43:47.435380 186990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.446479 186990 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime crio
I1122 02:43:47.446529 186990 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.516533 186990 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.516552 186990 crio.go:415] Images already preloaded, skipping extraction
I1122 02:43:47.516596 186990 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.556565 186990 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.556578 186990 cache_images.go:84] Images are preloaded, skipping loading
I1122 02:43:47.556631 186990 ssh_runner.go:195] Run: crio config
I1122 02:43:47.609611 186990 cni.go:84] Creating CNI manager for ""
I1122 02:43:47.609624 186990 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:47.609645 186990 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1122 02:43:47.609668 186990 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-549569 NodeName:stopped-upgrade-549569 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPod
Path:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:47.609834 186990 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "stopped-upgrade-549569"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:47.609974 186990 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=stopped-upgrade-549569 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.28.3 ClusterName:stopped-upgrade-549569 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1122 02:43:47.610036 186990 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
I1122 02:43:47.619504 186990 binaries.go:44] Found k8s binaries, skipping transfer
I1122 02:43:47.619565 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:47.628757 186990 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (432 bytes)
I1122 02:43:47.648413 186990 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:47.670842 186990 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)
I1122 02:43:47.692081 186990 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:47.696379 186990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.709737 186990 certs.go:56] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569 for IP: 192.168.94.2
I1122 02:43:47.709767 186990 certs.go:190] acquiring lock for shared ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.709964 186990 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:47.710034 186990 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:47.710098 186990 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key
I1122 02:43:47.710111 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt with IP's: []
I1122 02:43:47.884928 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt ...
I1122 02:43:47.884951 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt: {Name:mk304444fa319ab563168233d3eada9d2e91ecff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.885149 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key ...
I1122 02:43:47.885167 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key: {Name:mk8e7eeef9bc3161ebf685cc6623e345ba6609c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.885302 186990 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a
I1122 02:43:47.885319 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1122 02:43:48.098878 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a ...
I1122 02:43:48.098893 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a: {Name:mk0090f8ed0650e34934eb3ea1e9cd2d06071f72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.099043 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a ...
I1122 02:43:48.099055 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a: {Name:mk62f0883bd8e9bf59e5bcb69de7563a3a48693e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.099179 186990 certs.go:337] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt
I1122 02:43:48.099294 186990 certs.go:341] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key
I1122 02:43:48.099381 186990 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key
I1122 02:43:48.099404 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt with IP's: []
I1122 02:43:48.171199 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt ...
I1122 02:43:48.171213 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt: {Name:mk8f73e486405ac0285fd1407bb8bb47b4086920 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.171367 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key ...
I1122 02:43:48.171382 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key: {Name:mk81dba3ff018328cebccc8af4e779b6b43e6212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.171609 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:48.171653 186990 certs.go:433] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:48.171661 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:48.171693 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:48.171713 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:48.171735 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:48.171771 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:48.172462 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1122 02:43:48.198500 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:48.224815 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:48.251873 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:43:48.278244 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:48.304013 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:48.326777 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:48.349142 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:48.373314 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:48.399632 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:48.423985 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:48.449245 186990 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:48.466602 186990 ssh_runner.go:195] Run: openssl version
I1122 02:43:48.471970 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:48.481127 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:48.484542 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:48.484574 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:48.490837 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:48.499513 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:48.508584 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.511957 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.512000 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.519457 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:48.529047 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:48.539170 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:48.542677 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:48.542716 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:48.549038 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:48.558419 186990 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I1122 02:43:48.561584 186990 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I1122 02:43:48.561629 186990 kubeadm.go:404] StartCluster: {Name:stopped-upgrade-549569 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:stopped-upgrade-549569 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1122 02:43:48.561707 186990 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:48.561760 186990 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:48.597145 186990 cri.go:89] found id: ""
I1122 02:43:48.597189 186990 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:48.605704 186990 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:48.615056 186990 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:48.615103 186990 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:48.624240 186990 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:48.624283 186990 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:48.712320 186990 kubeadm.go:322] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:43:48.785472 186990 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:43:50.638337 186979 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:50.950654 186979 kubeadm.go:322] [certs] Generating "sa" key and public key
I1122 02:43:50.950788 186979 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:51.137316 186979 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:51.229576 186979 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:51.367617 186979 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:51.458528 186979 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:51.459083 186979 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:51.464117 186979 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:50.499234 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:50.519097 194201 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:43:50.523100 194201 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:50.533068 194201 kubeadm.go:884] updating cluster {Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerNam
e:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:43:50.533188 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:50.533249 194201 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:50.562603 194201 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:50.562626 194201 crio.go:433] Images already preloaded, skipping extraction
I1122 02:43:50.562674 194201 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:50.586008 194201 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:50.586029 194201 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:43:50.586038 194201 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.28.0 crio true true} ...
I1122 02:43:50.586157 194201 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=kubernetes-upgrade-019060 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:43:50.586233 194201 ssh_runner.go:195] Run: crio config
I1122 02:43:50.634480 194201 cni.go:84] Creating CNI manager for ""
I1122 02:43:50.634502 194201 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:50.634518 194201 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:43:50.634537 194201 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.28.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-019060 NodeName:kubernetes-upgrade-019060 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt Sta
ticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:50.634672 194201 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "kubernetes-upgrade-019060"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:50.634725 194201 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.0
I1122 02:43:50.642397 194201 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:43:50.642454 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:50.649699 194201 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)
I1122 02:43:50.661125 194201 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:50.675414 194201 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I1122 02:43:50.687510 194201 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:50.691006 194201 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:50.700408 194201 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:50.785024 194201 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:50.814239 194201 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060 for IP: 192.168.76.2
I1122 02:43:50.814260 194201 certs.go:195] generating shared ca certs ...
I1122 02:43:50.814280 194201 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.814433 194201 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:50.814482 194201 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:50.814495 194201 certs.go:257] generating profile certs ...
I1122 02:43:50.814559 194201 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key
I1122 02:43:50.814587 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt with IP's: []
I1122 02:43:50.867558 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt ...
I1122 02:43:50.867585 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt: {Name:mkfd827a4617dd805df02aa63d7b6004578464ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.867773 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key ...
I1122 02:43:50.867790 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key: {Name:mk324fe887b9a1232675ce0e78ee1319dbc7529e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.867914 194201 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9
I1122 02:43:50.867940 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I1122 02:43:51.265177 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 ...
I1122 02:43:51.265206 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9: {Name:mk620bcb325e05fd88108049871019d3710ed464 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.265387 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9 ...
I1122 02:43:51.265407 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9: {Name:mk797cb3de23d6d0fa499247f7785155c49499c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.265517 194201 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt
I1122 02:43:51.265627 194201 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key
I1122 02:43:51.265724 194201 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key
I1122 02:43:51.265744 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt with IP's: []
I1122 02:43:51.472189 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt ...
I1122 02:43:51.472216 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt: {Name:mk742ded5434e029c121a839393182ff52a8db9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.472370 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key ...
I1122 02:43:51.472390 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key: {Name:mk852935967438bdfae3d41b6a6705323af8514f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.472596 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:51.472634 194201 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:51.472644 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:51.472667 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:51.472695 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:51.472715 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:51.472752 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:51.473388 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:51.492079 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:51.512957 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:51.528874 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:51.546232 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
I1122 02:43:51.562752 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:51.579863 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:51.597118 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:43:51.613242 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:51.630538 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:51.646289 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:51.661967 194201 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:51.673967 194201 ssh_runner.go:195] Run: openssl version
I1122 02:43:51.679954 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:51.687700 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:51.691613 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:51.691652 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:51.728720 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:51.736916 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:51.744708 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:51.748339 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:51.748385 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:51.782323 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:51.789975 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:51.798071 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.801823 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.801876 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.835662 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:51.843619 194201 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:43:51.846940 194201 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 02:43:51.847000 194201 kubeadm.go:401] StartCluster: {Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:m
inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:51.847086 194201 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:51.847142 194201 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:51.875095 194201 cri.go:89] found id: ""
I1122 02:43:51.875155 194201 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:51.882727 194201 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:51.890070 194201 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:51.890115 194201 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:51.897380 194201 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:51.897436 194201 kubeadm.go:158] found existing configuration files:
I1122 02:43:51.897481 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1122 02:43:51.904377 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 02:43:51.904420 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 02:43:51.911144 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1122 02:43:51.918127 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 02:43:51.918165 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 02:43:51.925226 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1122 02:43:51.932189 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 02:43:51.932232 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 02:43:51.938682 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1122 02:43:51.945523 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 02:43:51.945565 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 02:43:51.952772 194201 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:51.999992 194201 kubeadm.go:319] [init] Using Kubernetes version: v1.28.0
I1122 02:43:52.000065 194201 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:43:52.038706 194201 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:52.038808 194201 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:52.038899 194201 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:52.038998 194201 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:52.039092 194201 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:52.039167 194201 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:52.039241 194201 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:52.039316 194201 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:52.039391 194201 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:52.039465 194201 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:52.039533 194201 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:52.114224 194201 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:52.114376 194201 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:52.114522 194201 kubeadm.go:319] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:52.253016 194201 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
W1122 02:43:50.948595 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
W1122 02:43:53.448235 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
I1122 02:43:52.255490 194201 out.go:252] - Generating certificates and keys ...
I1122 02:43:52.255570 194201 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:43:52.255665 194201 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:52.316570 194201 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:52.398082 194201 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:52.689230 194201 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:52.832602 194201 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:52.920425 194201 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:43:52.920656 194201 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [kubernetes-upgrade-019060 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:43:53.007876 194201 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:53.008079 194201 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [kubernetes-upgrade-019060 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:43:53.253461 194201 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:53.548760 194201 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:53.734571 194201 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:43:53.734654 194201 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:54.013096 194201 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:54.172898 194201 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:54.610893 194201 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:54.751307 194201 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:54.751441 194201 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:54.759041 194201 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:51.465398 186979 out.go:204] - Booting up control plane ...
I1122 02:43:51.465549 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:51.465632 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:51.466402 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:51.476428 186979 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:51.477289 186979 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:51.477341 186979 kubeadm.go:322] [kubelet-start] Starting the kubelet
I1122 02:43:51.550083 186979 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:54.760521 194201 out.go:252] - Booting up control plane ...
I1122 02:43:54.760649 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:54.760756 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:54.766970 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:54.798591 194201 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:54.800393 194201 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:54.800734 194201 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:43:54.942388 194201 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:54.948925 192693 node_ready.go:49] node "pause-537523" is "Ready"
I1122 02:43:54.948960 192693 node_ready.go:38] duration metric: took 10.503744684s for node "pause-537523" to be "Ready" ...
I1122 02:43:54.948975 192693 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:43:54.949044 192693 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:43:54.965223 192693 api_server.go:72] duration metric: took 10.673142184s to wait for apiserver process to appear ...
I1122 02:43:54.965264 192693 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:43:54.965289 192693 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:43:54.971550 192693 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:43:54.972943 192693 api_server.go:141] control plane version: v1.34.1
I1122 02:43:54.972968 192693 api_server.go:131] duration metric: took 7.697547ms to wait for apiserver health ...
I1122 02:43:54.972978 192693 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:43:54.978094 192693 system_pods.go:59] 7 kube-system pods found
I1122 02:43:54.978120 192693 system_pods.go:61] "coredns-66bc5c9577-hv5cb" [70e5ba26-8049-417b-834b-a031a54d09ea] Running
I1122 02:43:54.978126 192693 system_pods.go:61] "etcd-pause-537523" [e5cb1a46-c768-45ec-b457-0bb37a7e747c] Running
I1122 02:43:54.978131 192693 system_pods.go:61] "kindnet-fxcd4" [c70b8a6e-3290-4da7-8b8b-0ffdd946607d] Running
I1122 02:43:54.978136 192693 system_pods.go:61] "kube-apiserver-pause-537523" [aefaebb5-3f2d-4e56-a898-7b89c6a34a38] Running
I1122 02:43:54.978141 192693 system_pods.go:61] "kube-controller-manager-pause-537523" [2829e90e-1d28-41a8-88ae-dbb1765bd53f] Running
I1122 02:43:54.978146 192693 system_pods.go:61] "kube-proxy-bq4cg" [123edc9d-2827-4c1d-83ed-08bf1654d118] Running
I1122 02:43:54.978150 192693 system_pods.go:61] "kube-scheduler-pause-537523" [a7ff4666-e94f-43ad-9557-5f0d528bec91] Running
I1122 02:43:54.978156 192693 system_pods.go:74] duration metric: took 5.172405ms to wait for pod list to return data ...
I1122 02:43:54.978165 192693 default_sa.go:34] waiting for default service account to be created ...
I1122 02:43:54.980821 192693 default_sa.go:45] found service account: "default"
I1122 02:43:54.980839 192693 default_sa.go:55] duration metric: took 2.669145ms for default service account to be created ...
I1122 02:43:54.980850 192693 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:43:54.983274 192693 system_pods.go:86] 7 kube-system pods found
I1122 02:43:54.983297 192693 system_pods.go:89] "coredns-66bc5c9577-hv5cb" [70e5ba26-8049-417b-834b-a031a54d09ea] Running
I1122 02:43:54.983304 192693 system_pods.go:89] "etcd-pause-537523" [e5cb1a46-c768-45ec-b457-0bb37a7e747c] Running
I1122 02:43:54.983309 192693 system_pods.go:89] "kindnet-fxcd4" [c70b8a6e-3290-4da7-8b8b-0ffdd946607d] Running
I1122 02:43:54.983314 192693 system_pods.go:89] "kube-apiserver-pause-537523" [aefaebb5-3f2d-4e56-a898-7b89c6a34a38] Running
I1122 02:43:54.983320 192693 system_pods.go:89] "kube-controller-manager-pause-537523" [2829e90e-1d28-41a8-88ae-dbb1765bd53f] Running
I1122 02:43:54.983333 192693 system_pods.go:89] "kube-proxy-bq4cg" [123edc9d-2827-4c1d-83ed-08bf1654d118] Running
I1122 02:43:54.983338 192693 system_pods.go:89] "kube-scheduler-pause-537523" [a7ff4666-e94f-43ad-9557-5f0d528bec91] Running
I1122 02:43:54.983345 192693 system_pods.go:126] duration metric: took 2.489594ms to wait for k8s-apps to be running ...
I1122 02:43:54.983353 192693 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:43:54.983402 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:55.000534 192693 system_svc.go:56] duration metric: took 17.172356ms WaitForService to wait for kubelet
I1122 02:43:55.000594 192693 kubeadm.go:587] duration metric: took 10.708512075s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:43:55.000616 192693 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:43:55.003439 192693 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:43:55.003464 192693 node_conditions.go:123] node cpu capacity is 8
I1122 02:43:55.003477 192693 node_conditions.go:105] duration metric: took 2.855642ms to run NodePressure ...
I1122 02:43:55.003492 192693 start.go:242] waiting for startup goroutines ...
I1122 02:43:55.003503 192693 start.go:247] waiting for cluster config update ...
I1122 02:43:55.003514 192693 start.go:256] writing updated cluster config ...
I1122 02:43:55.003826 192693 ssh_runner.go:195] Run: rm -f paused
I1122 02:43:55.009022 192693 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:43:55.009718 192693 kapi.go:59] client config for pause-537523: &rest.Config{Host:"https://192.168.85.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]stri
ng(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:43:55.013351 192693 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-hv5cb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.019638 192693 pod_ready.go:94] pod "coredns-66bc5c9577-hv5cb" is "Ready"
I1122 02:43:55.019666 192693 pod_ready.go:86] duration metric: took 6.293614ms for pod "coredns-66bc5c9577-hv5cb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.021821 192693 pod_ready.go:83] waiting for pod "etcd-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.027590 192693 pod_ready.go:94] pod "etcd-pause-537523" is "Ready"
I1122 02:43:55.027620 192693 pod_ready.go:86] duration metric: took 5.773281ms for pod "etcd-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.030609 192693 pod_ready.go:83] waiting for pod "kube-apiserver-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.035403 192693 pod_ready.go:94] pod "kube-apiserver-pause-537523" is "Ready"
I1122 02:43:55.035470 192693 pod_ready.go:86] duration metric: took 4.839416ms for pod "kube-apiserver-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.037579 192693 pod_ready.go:83] waiting for pod "kube-controller-manager-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.413651 192693 pod_ready.go:94] pod "kube-controller-manager-pause-537523" is "Ready"
I1122 02:43:55.413683 192693 pod_ready.go:86] duration metric: took 376.084759ms for pod "kube-controller-manager-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.613536 192693 pod_ready.go:83] waiting for pod "kube-proxy-bq4cg" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.014242 192693 pod_ready.go:94] pod "kube-proxy-bq4cg" is "Ready"
I1122 02:43:56.014280 192693 pod_ready.go:86] duration metric: took 400.71755ms for pod "kube-proxy-bq4cg" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.213931 192693 pod_ready.go:83] waiting for pod "kube-scheduler-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.613547 192693 pod_ready.go:94] pod "kube-scheduler-pause-537523" is "Ready"
I1122 02:43:56.613576 192693 pod_ready.go:86] duration metric: took 399.618914ms for pod "kube-scheduler-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.613587 192693 pod_ready.go:40] duration metric: took 1.604533435s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:43:56.671536 192693 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:43:56.673013 192693 out.go:179] * Done! kubectl is now configured to use "pause-537523" cluster and "default" namespace by default
I1122 02:43:56.552861 186979 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.002852 seconds
I1122 02:43:56.553061 186979 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:43:56.563942 186979 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:43:57.087744 186979 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:43:57.087990 186979 kubeadm.go:322] [mark-control-plane] Marking the node missing-upgrade-562593 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:43:57.601201 186979 kubeadm.go:322] [bootstrap-token] Using token: jkgcoj.omc242w6116kkaoa
I1122 02:43:57.603453 186979 out.go:204] - Configuring RBAC rules ...
I1122 02:43:57.603603 186979 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:43:57.610877 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:43:57.621667 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:43:57.628987 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:43:57.633478 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:43:57.641093 186979 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:43:57.652457 186979 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:43:57.872699 186979 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I1122 02:43:58.014391 186979 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I1122 02:43:58.015367 186979 kubeadm.go:322]
I1122 02:43:58.015451 186979 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I1122 02:43:58.015458 186979 kubeadm.go:322]
I1122 02:43:58.015525 186979 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I1122 02:43:58.015528 186979 kubeadm.go:322]
I1122 02:43:58.015548 186979 kubeadm.go:322] mkdir -p $HOME/.kube
I1122 02:43:58.015598 186979 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:43:58.015662 186979 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:43:58.015673 186979 kubeadm.go:322]
I1122 02:43:58.015724 186979 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I1122 02:43:58.015729 186979 kubeadm.go:322]
I1122 02:43:58.015806 186979 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:43:58.015813 186979 kubeadm.go:322]
I1122 02:43:58.015862 186979 kubeadm.go:322] You should now deploy a pod network to the cluster.
I1122 02:43:58.015982 186979 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:43:58.016042 186979 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:43:58.016044 186979 kubeadm.go:322]
I1122 02:43:58.016110 186979 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:43:58.016203 186979 kubeadm.go:322] and service account keys on each node and then running the following as root:
I1122 02:43:58.016219 186979 kubeadm.go:322]
I1122 02:43:58.016328 186979 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token jkgcoj.omc242w6116kkaoa \
I1122 02:43:58.016431 186979 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:43:58.016448 186979 kubeadm.go:322] --control-plane
I1122 02:43:58.016451 186979 kubeadm.go:322]
I1122 02:43:58.016562 186979 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:43:58.016566 186979 kubeadm.go:322]
I1122 02:43:58.016632 186979 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token jkgcoj.omc242w6116kkaoa \
I1122 02:43:58.016705 186979 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:43:58.018862 186979 kubeadm.go:322] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:43:58.018985 186979 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:43:58.019009 186979 cni.go:84] Creating CNI manager for ""
I1122 02:43:58.019015 186979 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:58.020399 186979 out.go:177] * Configuring CNI (Container Networking Interface) ...
I1122 02:43:58.021662 186979 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:43:58.025761 186979 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.3/kubectl ...
I1122 02:43:58.025771 186979 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I1122 02:43:58.046449 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:43:58.683167 186979 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:43:58.683217 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:43:58.683254 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=8220a6eb95f0a4d75f7f2d7b14cef975f050512d minikube.k8s.io/name=missing-upgrade-562593 minikube.k8s.io/updated_at=2025_11_22T02_43_58_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:43:58.780398 186979 kubeadm.go:1081] duration metric: took 97.221922ms to wait for elevateKubeSystemPrivileges.
I1122 02:43:58.792519 186979 ops.go:34] apiserver oom_adj: -16
I1122 02:43:58.792547 186979 kubeadm.go:406] StartCluster complete in 10.000456685s
I1122 02:43:58.792575 186979 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:58.792670 186979 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:58.795695 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:58.796139 186979 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:43:58.796977 186979 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:58.797173 186979 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]
I1122 02:43:58.797325 186979 addons.go:69] Setting storage-provisioner=true in profile "missing-upgrade-562593"
I1122 02:43:58.797344 186979 addons.go:231] Setting addon storage-provisioner=true in "missing-upgrade-562593"
I1122 02:43:58.797492 186979 host.go:66] Checking if "missing-upgrade-562593" exists ...
I1122 02:43:58.798468 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:58.798991 186979 addons.go:69] Setting default-storageclass=true in profile "missing-upgrade-562593"
I1122 02:43:58.799034 186979 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "missing-upgrade-562593"
I1122 02:43:58.799402 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:58.832299 186979 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:43:58.833528 186979 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:43:58.833541 186979 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:43:58.833616 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:58.839353 186979 kapi.go:248] "coredns" deployment in "kube-system" namespace and "missing-upgrade-562593" context rescaled to 1 replicas
I1122 02:43:58.839410 186979 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:58.841486 186979 out.go:177] * Verifying Kubernetes components...
I1122 02:43:59.157492 186990 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
I1122 02:43:59.157558 186990 kubeadm.go:322] [preflight] Running pre-flight checks
I1122 02:43:59.157667 186990 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:59.157747 186990 kubeadm.go:322] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:59.157791 186990 kubeadm.go:322] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:59.157849 186990 kubeadm.go:322] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:59.157920 186990 kubeadm.go:322] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:59.157981 186990 kubeadm.go:322] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:59.158041 186990 kubeadm.go:322] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:59.158102 186990 kubeadm.go:322] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:59.158161 186990 kubeadm.go:322] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:59.158221 186990 kubeadm.go:322] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:59.158275 186990 kubeadm.go:322] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:59.158367 186990 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:59.158482 186990 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:59.158597 186990 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:59.158677 186990 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:43:59.160659 186990 out.go:204] - Generating certificates and keys ...
I1122 02:43:59.160956 186990 kubeadm.go:322] [certs] Using existing ca certificate authority
I1122 02:43:59.161044 186990 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:59.161142 186990 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:59.161214 186990 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:59.161297 186990 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:59.161362 186990 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:59.161436 186990 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I1122 02:43:59.161578 186990 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [localhost stopped-upgrade-549569] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:43:59.161631 186990 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:59.161765 186990 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [localhost stopped-upgrade-549569] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:43:59.161829 186990 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:59.161890 186990 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:59.161958 186990 kubeadm.go:322] [certs] Generating "sa" key and public key
I1122 02:43:59.162030 186990 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:59.162097 186990 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:59.162161 186990 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:59.162234 186990 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:59.162481 186990 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:59.162758 186990 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:59.162880 186990 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:59.164291 186990 out.go:204] - Booting up control plane ...
I1122 02:43:59.164408 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:59.164497 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:59.164583 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:59.165046 186990 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:59.165223 186990 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:59.165299 186990 kubeadm.go:322] [kubelet-start] Starting the kubelet
I1122 02:43:59.165530 186990 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:59.165632 186990 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.005038 seconds
I1122 02:43:59.165781 186990 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:43:59.165961 186990 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:43:59.166034 186990 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:43:59.169969 186990 kubeadm.go:322] [mark-control-plane] Marking the node stopped-upgrade-549569 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:43:59.170103 186990 kubeadm.go:322] [bootstrap-token] Using token: 6y2o66.jogpxtr1vydl7i1b
I1122 02:43:59.171302 186990 out.go:204] - Configuring RBAC rules ...
I1122 02:43:59.171441 186990 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:43:59.171545 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:43:59.171759 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:43:59.171978 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:43:59.172120 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:43:59.172241 186990 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:43:59.172416 186990 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:43:59.172469 186990 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I1122 02:43:59.172529 186990 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I1122 02:43:59.172532 186990 kubeadm.go:322]
I1122 02:43:59.172609 186990 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I1122 02:43:59.172614 186990 kubeadm.go:322]
I1122 02:43:59.172710 186990 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I1122 02:43:59.172714 186990 kubeadm.go:322]
I1122 02:43:59.172746 186990 kubeadm.go:322] mkdir -p $HOME/.kube
I1122 02:43:59.172820 186990 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:43:59.172887 186990 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:43:59.172890 186990 kubeadm.go:322]
I1122 02:43:59.172995 186990 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I1122 02:43:59.173000 186990 kubeadm.go:322]
I1122 02:43:59.173064 186990 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:43:59.173072 186990 kubeadm.go:322]
I1122 02:43:59.173147 186990 kubeadm.go:322] You should now deploy a pod network to the cluster.
I1122 02:43:59.173246 186990 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:43:59.173322 186990 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:43:59.173327 186990 kubeadm.go:322]
I1122 02:43:59.173436 186990 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:43:59.173524 186990 kubeadm.go:322] and service account keys on each node and then running the following as root:
I1122 02:43:59.173530 186990 kubeadm.go:322]
I1122 02:43:59.173637 186990 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 6y2o66.jogpxtr1vydl7i1b \
I1122 02:43:59.173898 186990 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:43:59.173971 186990 kubeadm.go:322] --control-plane
I1122 02:43:59.173980 186990 kubeadm.go:322]
I1122 02:43:59.174097 186990 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:43:59.174112 186990 kubeadm.go:322]
I1122 02:43:59.174204 186990 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 6y2o66.jogpxtr1vydl7i1b \
I1122 02:43:59.174341 186990 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:43:59.174355 186990 cni.go:84] Creating CNI manager for ""
I1122 02:43:59.174363 186990 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:59.176159 186990 out.go:177] * Configuring CNI (Container Networking Interface) ...
==> CRI-O <==
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.935974096Z" level=info msg="RDT not available in the host system"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.935987375Z" level=info msg="Using conmon executable: /usr/libexec/crio/conmon"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936799073Z" level=info msg="Conmon does support the --sync option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936816584Z" level=info msg="Conmon does support the --log-global-size-max option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936830156Z" level=info msg="Using conmon executable: /usr/libexec/crio/conmon"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.937725776Z" level=info msg="Conmon does support the --sync option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.937739919Z" level=info msg="Conmon does support the --log-global-size-max option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.941963075Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.941979852Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.943471756Z" level=info msg="Current CRI-O configuration:\n[crio]\n root = \"/var/lib/containers/storage\"\n runroot = \"/run/containers/storage\"\n imagestore = \"\"\n storage_driver = \"overlay\"\n log_dir = \"/var/log/crio/pods\"\n version_file = \"/var/run/crio/version\"\n version_file_persist = \"\"\n clean_shutdown_file = \"/var/lib/crio/clean.shutdown\"\n internal_wipe = true\n internal_repair = true\n [crio.api]\n grpc_max_send_msg_size = 83886080\n grpc_max_recv_msg_size = 83886080\n listen = \"/var/run/crio/crio.sock\"\n stream_address = \"127.0.0.1\"\n stream_port = \"0\"\n stream_enable_tls = false\n stream_tls_cert = \"\"\n stream_tls_key = \"\"\n stream_tls_ca = \"\"\n stream_idle_timeout = \"\"\n [crio.runtime]\n no_pivot = false\n selinux = false\n log_to_journald = false\n drop_infra_ctr = true\n read_only = false\n hooks_dir = [\"/usr/share/containers/oci/hoo
ks.d\"]\n default_capabilities = [\"CHOWN\", \"DAC_OVERRIDE\", \"FSETID\", \"FOWNER\", \"SETGID\", \"SETUID\", \"SETPCAP\", \"NET_BIND_SERVICE\", \"KILL\"]\n add_inheritable_capabilities = false\n default_sysctls = [\"net.ipv4.ip_unprivileged_port_start=0\"]\n allowed_devices = [\"/dev/fuse\", \"/dev/net/tun\"]\n cdi_spec_dirs = [\"/etc/cdi\", \"/var/run/cdi\"]\n device_ownership_from_security_context = false\n default_runtime = \"crun\"\n decryption_keys_path = \"/etc/crio/keys/\"\n conmon = \"\"\n conmon_cgroup = \"pod\"\n seccomp_profile = \"\"\n privileged_seccomp_profile = \"\"\n apparmor_profile = \"crio-default\"\n blockio_config_file = \"\"\n blockio_reload = false\n irqbalance_config_file = \"/etc/sysconfig/irqbalance\"\n rdt_config_file = \"\"\n cgroup_manager = \"systemd\"\n default_mounts_file = \"\"\n container_exits_dir = \"/var/run/crio/exits\"\n container_attach_socket_dir = \"/var/run/crio\"\n bind_mount_prefix = \"\"\n uid_
mappings = \"\"\n minimum_mappable_uid = -1\n gid_mappings = \"\"\n minimum_mappable_gid = -1\n log_level = \"info\"\n log_filter = \"\"\n namespaces_dir = \"/var/run\"\n pinns_path = \"/usr/bin/pinns\"\n enable_criu_support = false\n pids_limit = -1\n log_size_max = -1\n ctr_stop_timeout = 30\n separate_pull_cgroup = \"\"\n infra_ctr_cpuset = \"\"\n shared_cpuset = \"\"\n enable_pod_events = false\n irqbalance_config_restore_file = \"/etc/sysconfig/orig_irq_banned_cpus\"\n hostnetwork_disable_selinux = true\n disable_hostport_mapping = false\n timezone = \"\"\n [crio.runtime.runtimes]\n [crio.runtime.runtimes.crun]\n runtime_config_path = \"\"\n runtime_path = \"/usr/libexec/crio/crun\"\n runtime_type = \"\"\n runtime_root = \"/run/crun\"\n allowed_annotations = [\"io.containers.trace-syscall\"]\n monitor_path = \"/usr/libexec/crio/conmon\"\n monitor_cgroup = \"pod\"\n container_min_memory
= \"12MiB\"\n no_sync_log = false\n [crio.runtime.runtimes.runc]\n runtime_config_path = \"\"\n runtime_path = \"/usr/libexec/crio/runc\"\n runtime_type = \"\"\n runtime_root = \"/run/runc\"\n monitor_path = \"/usr/libexec/crio/conmon\"\n monitor_cgroup = \"pod\"\n container_min_memory = \"12MiB\"\n no_sync_log = false\n [crio.image]\n default_transport = \"docker://\"\n global_auth_file = \"\"\n pause_image = \"registry.k8s.io/pause:3.10.1\"\n pause_image_auth_file = \"\"\n pause_command = \"/pause\"\n signature_policy = \"/etc/crio/policy.json\"\n signature_policy_dir = \"/etc/crio/policies\"\n image_volumes = \"mkdir\"\n big_files_temporary_dir = \"\"\n auto_reload_registries = false\n pull_progress_timeout = \"0s\"\n oci_artifact_mount_support = true\n short_name_mode = \"enforcing\"\n [crio.network]\n cni_default_network = \"\"\n network_dir = \"/etc/cni/net.d/\"\n plugin_dirs = [\"/opt/
cni/bin/\"]\n [crio.metrics]\n enable_metrics = false\n metrics_collectors = [\"image_pulls_layer_size\", \"containers_events_dropped_total\", \"containers_oom_total\", \"processes_defunct\", \"operations_total\", \"operations_latency_seconds\", \"operations_latency_seconds_total\", \"operations_errors_total\", \"image_pulls_bytes_total\", \"image_pulls_skipped_bytes_total\", \"image_pulls_failure_total\", \"image_pulls_success_total\", \"image_layer_reuse_total\", \"containers_oom_count_total\", \"containers_seccomp_notifier_count_total\", \"resources_stalled_at_stage\", \"containers_stopped_monitor_count\"]\n metrics_host = \"127.0.0.1\"\n metrics_port = 9090\n metrics_socket = \"\"\n metrics_cert = \"\"\n metrics_key = \"\"\n [crio.tracing]\n enable_tracing = false\n tracing_endpoint = \"127.0.0.1:4317\"\n tracing_sampling_rate_per_million = 0\n [crio.stats]\n stats_collection_period = 0\n collection_period = 0\n [crio.nri]\n enable_nri = true\n nri_listen = \"
/var/run/nri/nri.sock\"\n nri_plugin_dir = \"/opt/nri/plugins\"\n nri_plugin_config_dir = \"/etc/nri/conf.d\"\n nri_plugin_registration_timeout = \"5s\"\n nri_plugin_request_timeout = \"2s\"\n nri_disable_connections = false\n [crio.nri.default_validator]\n nri_enable_default_validator = false\n nri_validator_reject_oci_hook_adjustment = false\n nri_validator_reject_runtime_default_seccomp_adjustment = false\n nri_validator_reject_unconfined_seccomp_adjustment = false\n nri_validator_reject_custom_seccomp_adjustment = false\n nri_validator_reject_namespace_adjustment = false\n nri_validator_tolerate_missing_plugins_annotation = \"\"\n"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.943968561Z" level=info msg="Attempting to restore irqbalance config from /etc/sysconfig/orig_irq_banned_cpus"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.944031122Z" level=info msg="Restore irqbalance config: failed to get current CPU ban list, ignoring"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.035428746Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-hv5cb Namespace:kube-system ID:d68223e030107a9d287bcd99be6ed0bf10077350b5e7bc6f4b24247b316a4806 UID:70e5ba26-8049-417b-834b-a031a54d09ea NetNS:/var/run/netns/9c1c6d0b-a74f-4e22-b0ea-4aae24976614 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc000898938}] Aliases:map[]}"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.035748673Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-hv5cb for CNI network kindnet (type=ptp)"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036308268Z" level=info msg="Registered SIGHUP reload watcher"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036340898Z" level=info msg="Starting seccomp notifier watcher"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036388191Z" level=info msg="Create NRI interface"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036506943Z" level=info msg="built-in NRI default validator is disabled"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.03652213Z" level=info msg="runtime interface created"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036534998Z" level=info msg="Registered domain \"k8s.io\" with NRI"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036542813Z" level=info msg="runtime interface starting up..."
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036561622Z" level=info msg="starting plugins..."
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036580538Z" level=info msg="Synchronizing NRI (plugin) with current runtime state"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036995988Z" level=info msg="No systemd watchdog enabled"
Nov 22 02:43:43 pause-537523 systemd[1]: Started crio.service - Container Runtime Interface for OCI (CRI-O).
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
a1900d5a94165 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 28 seconds ago Running coredns 0 d68223e030107 coredns-66bc5c9577-hv5cb kube-system
76c103ade12b5 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 40 seconds ago Running kindnet-cni 0 e6bcde3a6524d kindnet-fxcd4 kube-system
8ee826891fe8b fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 40 seconds ago Running kube-proxy 0 58f67893efd78 kube-proxy-bq4cg kube-system
19937eb9c4a3f 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 51 seconds ago Running etcd 0 83217135d4296 etcd-pause-537523 kube-system
f9b1fa7dcad62 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 51 seconds ago Running kube-scheduler 0 de86c336660b9 kube-scheduler-pause-537523 kube-system
954fe52a33995 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 51 seconds ago Running kube-apiserver 0 baa55c7d2913e kube-apiserver-pause-537523 kube-system
3d518d8a64067 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 51 seconds ago Running kube-controller-manager 0 f58876a454914 kube-controller-manager-pause-537523 kube-system
==> coredns [a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = fa9a0cdcdddcb4be74a0eaf7cfcb211c40e29ddf5507e03bbfc0065bade31f0f2641a2513136e246f32328dd126fc93236fb5c595246f0763926a524386705e8
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:38617 - 45567 "HINFO IN 503470649774205904.839763709708322538. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.873004485s
==> describe nodes <==
Name: pause-537523
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=pause-537523
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=pause-537523
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_43_14_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:43:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: pause-537523
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:43:54 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:54 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: pause-537523
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 316e3060-1642-498f-ab78-0998f1eb023b
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (7 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-66bc5c9577-hv5cb 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 41s
kube-system etcd-pause-537523 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 47s
kube-system kindnet-fxcd4 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 42s
kube-system kube-apiserver-pause-537523 250m (3%) 0 (0%) 0 (0%) 0 (0%) 47s
kube-system kube-controller-manager-pause-537523 200m (2%) 0 (0%) 0 (0%) 0 (0%) 47s
kube-system kube-proxy-bq4cg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 42s
kube-system kube-scheduler-pause-537523 100m (1%) 0 (0%) 0 (0%) 0 (0%) 47s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 40s kube-proxy
Normal Starting 47s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 47s kubelet Node pause-537523 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 47s kubelet Node pause-537523 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 47s kubelet Node pause-537523 status is now: NodeHasSufficientPID
Normal RegisteredNode 43s node-controller Node pause-537523 event: Registered Node pause-537523 in Controller
Normal NodeNotReady 16s kubelet Node pause-537523 status is now: NodeNotReady
Normal NodeReady 6s (x2 over 30s) kubelet Node pause-537523 status is now: NodeReady
==> dmesg <==
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
[Nov22 01:58] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.019095] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000021] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023876] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023874] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023866] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023868] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000009] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +2.047813] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +4.031574] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +8.127154] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 01:59] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
==> etcd [19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4] <==
{"level":"warn","ts":"2025-11-22T02:43:10.244838Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35566","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.262491Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35572","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.269867Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35602","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.276308Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35606","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.334429Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35624","server-name":"","error":"EOF"}
{"level":"info","ts":"2025-11-22T02:43:30.644742Z","caller":"traceutil/trace.go:172","msg":"trace[1310905291] transaction","detail":"{read_only:false; response_revision:386; number_of_response:1; }","duration":"111.104805ms","start":"2025-11-22T02:43:30.533617Z","end":"2025-11-22T02:43:30.644722Z","steps":["trace[1310905291] 'process raft request' (duration: 96.939064ms)","trace[1310905291] 'compare' (duration: 14.077427ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:31.593474Z","caller":"traceutil/trace.go:172","msg":"trace[997715274] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"117.603185ms","start":"2025-11-22T02:43:31.475854Z","end":"2025-11-22T02:43:31.593457Z","steps":["trace[997715274] 'process raft request' (duration: 117.497344ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:43:31.840367Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"122.997986ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223109599453 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" mod_revision:334 > success:<request_put:<key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" value_size:1193 >> failure:<request_range:<key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:43:31.840712Z","caller":"traceutil/trace.go:172","msg":"trace[1867170773] transaction","detail":"{read_only:false; response_revision:396; number_of_response:1; }","duration":"243.631895ms","start":"2025-11-22T02:43:31.597060Z","end":"2025-11-22T02:43:31.840692Z","steps":["trace[1867170773] 'process raft request' (duration: 119.833684ms)","trace[1867170773] 'compare' (duration: 122.920198ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:31.840802Z","caller":"traceutil/trace.go:172","msg":"trace[1115065947] transaction","detail":"{read_only:false; response_revision:397; number_of_response:1; }","duration":"239.723165ms","start":"2025-11-22T02:43:31.601068Z","end":"2025-11-22T02:43:31.840791Z","steps":["trace[1115065947] 'process raft request' (duration: 239.457179ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.014646Z","caller":"traceutil/trace.go:172","msg":"trace[183583259] linearizableReadLoop","detail":"{readStateIndex:412; appliedIndex:412; }","duration":"106.03359ms","start":"2025-11-22T02:43:31.908587Z","end":"2025-11-22T02:43:32.014620Z","steps":["trace[183583259] 'read index received' (duration: 106.02911ms)","trace[183583259] 'applied index is now lower than readState.Index' (duration: 3.75µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.079031Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"216.474864ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.079129Z","caller":"traceutil/trace.go:172","msg":"trace[270425495] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:398; }","duration":"216.611319ms","start":"2025-11-22T02:43:31.862500Z","end":"2025-11-22T02:43:32.079112Z","steps":["trace[270425495] 'agreement among raft nodes before linearized reading' (duration: 152.20084ms)","trace[270425495] 'range keys from in-memory index tree' (duration: 64.254359ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.079274Z","caller":"traceutil/trace.go:172","msg":"trace[1352216748] transaction","detail":"{read_only:false; response_revision:400; number_of_response:1; }","duration":"231.454954ms","start":"2025-11-22T02:43:31.847806Z","end":"2025-11-22T02:43:32.079261Z","steps":["trace[1352216748] 'process raft request' (duration: 231.23495ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.079303Z","caller":"traceutil/trace.go:172","msg":"trace[561689057] transaction","detail":"{read_only:false; response_revision:399; number_of_response:1; }","duration":"234.593264ms","start":"2025-11-22T02:43:31.844694Z","end":"2025-11-22T02:43:32.079288Z","steps":["trace[561689057] 'process raft request' (duration: 169.966703ms)","trace[561689057] 'compare' (duration: 64.30066ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.230100Z","caller":"traceutil/trace.go:172","msg":"trace[791380359] linearizableReadLoop","detail":"{readStateIndex:414; appliedIndex:414; }","duration":"142.923195ms","start":"2025-11-22T02:43:32.087162Z","end":"2025-11-22T02:43:32.230085Z","steps":["trace[791380359] 'read index received' (duration: 142.918792ms)","trace[791380359] 'applied index is now lower than readState.Index' (duration: 3.725µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.309432Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"222.247177ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.309495Z","caller":"traceutil/trace.go:172","msg":"trace[807621915] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:400; }","duration":"222.321309ms","start":"2025-11-22T02:43:32.087158Z","end":"2025-11-22T02:43:32.309479Z","steps":["trace[807621915] 'agreement among raft nodes before linearized reading' (duration: 142.996602ms)","trace[807621915] 'range keys from in-memory index tree' (duration: 79.227051ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.309548Z","caller":"traceutil/trace.go:172","msg":"trace[1786513713] transaction","detail":"{read_only:false; response_revision:401; number_of_response:1; }","duration":"224.722266ms","start":"2025-11-22T02:43:32.084804Z","end":"2025-11-22T02:43:32.309526Z","steps":["trace[1786513713] 'process raft request' (duration: 145.356597ms)","trace[1786513713] 'compare' (duration: 79.276474ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.597075Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"177.504561ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.597139Z","caller":"traceutil/trace.go:172","msg":"trace[53850969] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:401; }","duration":"177.576149ms","start":"2025-11-22T02:43:32.419548Z","end":"2025-11-22T02:43:32.597124Z","steps":["trace[53850969] 'range keys from in-memory index tree' (duration: 177.452892ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:43:32.597170Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"157.102292ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/192.168.85.2\" limit:1 ","response":"range_response_count:1 size:131"}
{"level":"info","ts":"2025-11-22T02:43:32.597212Z","caller":"traceutil/trace.go:172","msg":"trace[1335493678] range","detail":"{range_begin:/registry/masterleases/192.168.85.2; range_end:; response_count:1; response_revision:401; }","duration":"157.163364ms","start":"2025-11-22T02:43:32.440039Z","end":"2025-11-22T02:43:32.597202Z","steps":["trace[1335493678] 'range keys from in-memory index tree' (duration: 157.006818ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.745398Z","caller":"traceutil/trace.go:172","msg":"trace[190339287] transaction","detail":"{read_only:false; response_revision:402; number_of_response:1; }","duration":"145.110807ms","start":"2025-11-22T02:43:32.600275Z","end":"2025-11-22T02:43:32.745385Z","steps":["trace[190339287] 'process raft request' (duration: 129.780301ms)","trace[190339287] 'compare' (duration: 15.255342ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:38.012344Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"118.304766ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223109599503 > lease_revoke:<id:06ed9aa971a5a08f>","response":"size:28"}
==> kernel <==
02:44:00 up 1:26, 0 user, load average: 4.34, 1.61, 1.00
Linux pause-537523 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83] <==
I1122 02:43:19.760520 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:43:19.760767 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:43:19.760924 1 main.go:148] setting mtu 1500 for CNI
I1122 02:43:19.760942 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:43:19.760963 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:43:19Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:43:20.055582 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:43:20.055623 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:43:20.055636 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:43:20.055791 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:43:20.355960 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:43:20.355995 1 metrics.go:72] Registering metrics
I1122 02:43:20.356315 1 controller.go:711] "Syncing nftables rules"
I1122 02:43:30.055650 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:30.055704 1 main.go:301] handling current node
I1122 02:43:40.055627 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:40.055659 1 main.go:301] handling current node
I1122 02:43:50.056052 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:50.056081 1 main.go:301] handling current node
I1122 02:44:00.055800 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:44:00.055876 1 main.go:301] handling current node
==> kube-apiserver [954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5] <==
I1122 02:43:10.934832 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:43:10.935577 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:43:10.937981 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:43:10.938962 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:10.940210 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:43:10.946312 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:10.946872 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:43:10.957734 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:43:11.835393 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:43:11.839216 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:43:11.839235 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:43:12.298164 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:43:12.329131 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:43:12.442966 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:43:12.448682 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I1122 02:43:12.449494 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:43:12.452821 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:43:12.881384 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:43:13.536108 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:43:13.542709 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:43:13.549138 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:43:18.586950 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:43:18.632740 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1122 02:43:18.792428 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:18.798010 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
==> kube-controller-manager [3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b] <==
I1122 02:43:17.880841 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:43:17.880862 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:43:17.880885 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:43:17.880884 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:43:17.880901 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:43:17.880935 1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
I1122 02:43:17.880949 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:43:17.880976 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:43:17.881002 1 shared_informer.go:356] "Caches are synced" controller="ClusterRoleAggregator"
I1122 02:43:17.881144 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:43:17.883225 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:43:17.883297 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:43:17.883340 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:43:17.883357 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:43:17.883364 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:43:17.883583 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:43:17.886492 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:43:17.889086 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="pause-537523" podCIDRs=["10.244.0.0/24"]
I1122 02:43:17.890024 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:43:17.896335 1 shared_informer.go:356] "Caches are synced" controller="disruption"
I1122 02:43:17.903605 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:43:17.915095 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:43:32.831893 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
I1122 02:43:47.834675 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:43:57.836431 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443] <==
I1122 02:43:19.647213 1 server_linux.go:53] "Using iptables proxy"
I1122 02:43:19.707618 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:43:19.808713 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:43:19.808748 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.85.2"]
E1122 02:43:19.808860 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:43:19.831393 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:43:19.831434 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:43:19.836944 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:43:19.837318 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:43:19.837344 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:43:19.838750 1 config.go:200] "Starting service config controller"
I1122 02:43:19.838775 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:43:19.838783 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:43:19.838805 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:43:19.838861 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:43:19.838892 1 config.go:309] "Starting node config controller"
I1122 02:43:19.838917 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:43:19.838926 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:43:19.839301 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:43:19.938966 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:43:19.939061 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:43:19.939766 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522] <==
E1122 02:43:10.897930 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:43:10.897930 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:43:10.897968 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:43:10.897974 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:43:10.898040 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:43:10.898051 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:43:10.898345 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:43:10.898447 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:43:10.898520 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:43:10.899028 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:43:10.898382 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:43:10.899412 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:43:11.738983 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:43:11.769852 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:43:11.781732 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:43:11.800108 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:43:11.838243 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:43:11.858279 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:43:11.957210 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:43:12.006427 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:43:12.059513 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:43:12.077597 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:43:12.115031 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:43:12.137140 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
I1122 02:43:13.894395 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:43:37 pause-537523 kubelet[1299]: E1122 02:43:37.446513 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:37 pause-537523 kubelet[1299]: E1122 02:43:37.446530 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: W1122 02:43:38.159747 1299 logging.go:55] [core] [Channel #1 SubChannel #2]grpc: addrConn.createTransport failed to connect to {Addr: "/var/run/crio/crio.sock", ServerName: "localhost", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.401172 1299 log.go:32] "Status from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.401217 1299 kubelet.go:2996] "Container runtime sanity check failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446793 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446830 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446843 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: W1122 02:43:39.098267 1299 logging.go:55] [core] [Channel #1 SubChannel #2]grpc: addrConn.createTransport failed to connect to {Addr: "/var/run/crio/crio.sock", ServerName: "localhost", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389860 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="state:{}"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389958 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389996 1299 kubelet_pods.go:1266] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.390009 1299 kubelet.go:2613] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447610 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447685 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447703 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448021 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448066 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448076 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:43 pause-537523 kubelet[1299]: E1122 02:43:43.402053 1299 kubelet.go:3011] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: plugin status uninitialized"
Nov 22 02:43:44 pause-537523 kubelet[1299]: I1122 02:43:44.208166 1299 setters.go:543] "Node became not ready" node="pause-537523" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2025-11-22T02:43:44Z","lastTransitionTime":"2025-11-22T02:43:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: plugin status uninitialized"}
Nov 22 02:43:57 pause-537523 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:43:57 pause-537523 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:43:57 pause-537523 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:43:57 pause-537523 systemd[1]: kubelet.service: Consumed 1.432s CPU time.
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-537523 -n pause-537523
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-537523 -n pause-537523: exit status 2 (374.526452ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context pause-537523 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestPause/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestPause/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestPause/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect pause-537523
helpers_test.go:243: (dbg) docker inspect pause-537523:
-- stdout --
[
{
"Id": "ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430",
"Created": "2025-11-22T02:42:57.183534681Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 187891,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:42:57.258873196Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/hostname",
"HostsPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/hosts",
"LogPath": "/var/lib/docker/containers/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430/ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430-json.log",
"Name": "/pause-537523",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"pause-537523:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "pause-537523",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "ef53e1f28f8a82ebd57754bc25c0e85662fca66eddb75b35be92eab1f3152430",
"LowerDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/merged",
"UpperDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/diff",
"WorkDir": "/var/lib/docker/overlay2/23f467abf04fa76d4ae2240809f89454c75bd3ddbc59b69cc6746862e1237af0/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "pause-537523",
"Source": "/var/lib/docker/volumes/pause-537523/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "pause-537523",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "pause-537523",
"name.minikube.sigs.k8s.io": "pause-537523",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "6f858a54b892d6e444da003c35ec673311bf9b8eb459c8fb28693b7362a7d585",
"SandboxKey": "/var/run/docker/netns/6f858a54b892",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32978"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32979"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32982"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32980"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32981"
}
]
},
"Networks": {
"pause-537523": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "869a3ed0d6d2f35d03c4475ed49a70b56606d421d3ddf6d31c0fc87bd8d0e4d1",
"EndpointID": "76c06bd5029657097713dde2b687916792b93e8186001f16d62784c2572db2b1",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "32:8a:dc:56:d3:ee",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"pause-537523",
"ef53e1f28f8a"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p pause-537523 -n pause-537523
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-537523 -n pause-537523: exit status 2 (353.753632ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestPause/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p pause-537523 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p pause-537523 logs -n 25: (1.126074895s)
helpers_test.go:260: TestPause/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬─────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼─────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ -p test-preload-564056 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=crio │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:34 UTC │ │
│ delete │ -p test-preload-564056 │ test-preload-564056 │ jenkins │ v1.37.0 │ 22 Nov 25 02:40 UTC │ 22 Nov 25 02:40 UTC │
│ start │ -p scheduled-stop-195879 --memory=3072 --driver=docker --container-runtime=crio │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:40 UTC │ 22 Nov 25 02:41 UTC │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --cancel-scheduled │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ 22 Nov 25 02:41 UTC │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ │
│ stop │ -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:41 UTC │ 22 Nov 25 02:42 UTC │
│ delete │ -p scheduled-stop-195879 │ scheduled-stop-195879 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:42 UTC │
│ start │ -p insufficient-storage-280464 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=crio │ insufficient-storage-280464 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ │
│ delete │ -p insufficient-storage-280464 │ insufficient-storage-280464 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:42 UTC │
│ start │ -p offline-crio-452181 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=crio │ offline-crio-452181 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p pause-537523 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=crio │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p missing-upgrade-562593 --memory=3072 --driver=docker --container-runtime=crio │ missing-upgrade-562593 │ jenkins │ v1.32.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p stopped-upgrade-549569 --memory=3072 --vm-driver=docker --container-runtime=crio │ stopped-upgrade-549569 │ jenkins │ v1.32.0 │ 22 Nov 25 02:42 UTC │ 22 Nov 25 02:44 UTC │
│ start │ -p pause-537523 --alsologtostderr -v=1 --driver=docker --container-runtime=crio │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ 22 Nov 25 02:43 UTC │
│ delete │ -p offline-crio-452181 │ offline-crio-452181 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ 22 Nov 25 02:43 UTC │
│ start │ -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=crio │ kubernetes-upgrade-019060 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ │
│ pause │ -p pause-537523 --alsologtostderr -v=5 │ pause-537523 │ jenkins │ v1.37.0 │ 22 Nov 25 02:43 UTC │ │
│ stop │ stopped-upgrade-549569 stop │ stopped-upgrade-549569 │ jenkins │ v1.32.0 │ 22 Nov 25 02:44 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴─────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:43:41
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:43:41.506878 194201 out.go:360] Setting OutFile to fd 1 ...
I1122 02:43:41.506995 194201 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:41.507002 194201 out.go:374] Setting ErrFile to fd 2...
I1122 02:43:41.507008 194201 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:43:41.507291 194201 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:43:41.507832 194201 out.go:368] Setting JSON to false
I1122 02:43:41.508900 194201 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5164,"bootTime":1763774257,"procs":277,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:43:41.509052 194201 start.go:143] virtualization: kvm guest
I1122 02:43:41.513122 194201 out.go:179] * [kubernetes-upgrade-019060] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:43:41.514324 194201 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:43:41.514318 194201 notify.go:221] Checking for updates...
I1122 02:43:41.515649 194201 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:43:41.516732 194201 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:41.517996 194201 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:43:41.519214 194201 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:43:41.520428 194201 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:43:41.522357 194201 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:41.522564 194201 config.go:182] Loaded profile config "pause-537523": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:43:41.522682 194201 config.go:182] Loaded profile config "stopped-upgrade-549569": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:41.522809 194201 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:43:41.552959 194201 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:43:41.553207 194201 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:43:41.628177 194201 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:71 OomKillDisable:false NGoroutines:85 SystemTime:2025-11-22 02:43:41.61622402 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:43:41.628327 194201 docker.go:319] overlay module found
I1122 02:43:41.630169 194201 out.go:179] * Using the docker driver based on user configuration
I1122 02:43:41.631376 194201 start.go:309] selected driver: docker
I1122 02:43:41.631391 194201 start.go:927] validating driver "docker" against <nil>
I1122 02:43:41.631411 194201 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:43:41.632230 194201 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:43:41.708711 194201 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:68 OomKillDisable:false NGoroutines:79 SystemTime:2025-11-22 02:43:41.6961446 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:43:41.708945 194201 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 02:43:41.709262 194201 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
I1122 02:43:41.711150 194201 out.go:179] * Using Docker driver with root privileges
I1122 02:43:41.712529 194201 cni.go:84] Creating CNI manager for ""
I1122 02:43:41.712606 194201 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:41.712621 194201 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 02:43:41.712718 194201 start.go:353] cluster config:
{Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:41.714393 194201 out.go:179] * Starting "kubernetes-upgrade-019060" primary control-plane node in "kubernetes-upgrade-019060" cluster
I1122 02:43:41.716282 194201 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:43:41.717534 194201 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:43:41.718586 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:41.718620 194201 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
I1122 02:43:41.718637 194201 cache.go:65] Caching tarball of preloaded images
I1122 02:43:41.718649 194201 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:43:41.718737 194201 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:43:41.718750 194201 cache.go:68] Finished verifying existence of preloaded tar for v1.28.0 on crio
I1122 02:43:41.718872 194201 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json ...
I1122 02:43:41.718899 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json: {Name:mk0e0be1d4d3830f1ef53ffcbf5d6a40467f3ce3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:41.754272 194201 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:43:41.754303 194201 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:43:41.754317 194201 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:43:41.754349 194201 start.go:360] acquireMachinesLock for kubernetes-upgrade-019060: {Name:mkb63638579b47878f0940e681a90c1443ca2192 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:43:41.754434 194201 start.go:364] duration metric: took 65.59µs to acquireMachinesLock for "kubernetes-upgrade-019060"
I1122 02:43:41.754455 194201 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:41.754553 194201 start.go:125] createHost starting for "" (driver="docker")
I1122 02:43:41.065623 192693 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:41.065651 192693 machine.go:97] duration metric: took 6.476871268s to provisionDockerMachine
I1122 02:43:41.065667 192693 start.go:293] postStartSetup for "pause-537523" (driver="docker")
I1122 02:43:41.065681 192693 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:41.065769 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:41.065820 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.084343 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.176779 192693 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:41.180139 192693 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:41.180166 192693 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:43:41.180176 192693 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:41.180228 192693 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:41.180322 192693 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:41.180454 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:41.187750 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:41.204002 192693 start.go:296] duration metric: took 138.32119ms for postStartSetup
I1122 02:43:41.204071 192693 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:41.204116 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.223016 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.322092 192693 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:41.327155 192693 fix.go:56] duration metric: took 6.76056806s for fixHost
I1122 02:43:41.327186 192693 start.go:83] releasing machines lock for "pause-537523", held for 6.760638727s
I1122 02:43:41.327261 192693 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-537523
I1122 02:43:41.346884 192693 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:41.346965 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.347019 192693 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:41.347089 192693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-537523
I1122 02:43:41.369029 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.371298 192693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32978 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/pause-537523/id_rsa Username:docker}
I1122 02:43:41.481011 192693 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:41.551324 192693 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:41.604439 192693 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:43:41.612601 192693 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:43:41.612826 192693 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:41.623441 192693 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:43:41.623470 192693 start.go:496] detecting cgroup driver to use...
I1122 02:43:41.623505 192693 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:43:41.623551 192693 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:41.643501 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:41.662610 192693 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:43:41.662688 192693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:41.685892 192693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:41.707637 192693 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:41.886761 192693 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:42.115483 192693 docker.go:234] disabling docker service ...
I1122 02:43:42.115545 192693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:42.140728 192693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:42.162883 192693 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:42.334337 192693 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:42.483812 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:42.505755 192693 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:42.529776 192693 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:43:42.529876 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.541718 192693 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:42.541779 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.552617 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.563089 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.572531 192693 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:42.580531 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.589460 192693 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.598894 192693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:42.610088 192693 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:42.619563 192693 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:42.628235 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:42.760733 192693 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:43.040841 192693 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:43.040920 192693 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:43.045509 192693 start.go:564] Will wait 60s for crictl version
I1122 02:43:43.045564 192693 ssh_runner.go:195] Run: which crictl
I1122 02:43:43.049060 192693 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:43:43.079432 192693 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:43:43.079524 192693 ssh_runner.go:195] Run: crio --version
I1122 02:43:43.110158 192693 ssh_runner.go:195] Run: crio --version
I1122 02:43:43.143058 192693 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:43:43.144240 192693 cli_runner.go:164] Run: docker network inspect pause-537523 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:43.165446 192693 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:43:43.170331 192693 kubeadm.go:884] updating cluster {Name:pause-537523 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false regist
ry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:43:43.170541 192693 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:43:43.170604 192693 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:43.207307 192693 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:43.207330 192693 crio.go:433] Images already preloaded, skipping extraction
I1122 02:43:43.207382 192693 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:43.237145 192693 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:43.237167 192693 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:43:43.237174 192693 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:43:43.237283 192693 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=pause-537523 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:43:43.237350 192693 ssh_runner.go:195] Run: crio config
I1122 02:43:43.285538 192693 cni.go:84] Creating CNI manager for ""
I1122 02:43:43.285562 192693 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:43.285582 192693 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:43:43.285609 192693 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-537523 NodeName:pause-537523 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes
/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:43.285755 192693 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "pause-537523"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:43.285834 192693 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:43:43.294719 192693 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:43:43.294781 192693 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:43.302642 192693 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I1122 02:43:43.316668 192693 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:43.331543 192693 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2208 bytes)
I1122 02:43:43.345667 192693 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:43.350480 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:43.480533 192693 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:43.495376 192693 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523 for IP: 192.168.85.2
I1122 02:43:43.495402 192693 certs.go:195] generating shared ca certs ...
I1122 02:43:43.495421 192693 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:43.495591 192693 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:43.495660 192693 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:43.495681 192693 certs.go:257] generating profile certs ...
I1122 02:43:43.495799 192693 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key
I1122 02:43:43.495871 192693 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.key.b88d4e2f
I1122 02:43:43.495959 192693 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.key
I1122 02:43:43.496107 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:43.496236 192693 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:43.496402 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:43.496453 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:43.496490 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:43.496582 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:43.496646 192693 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.498471 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:43.524633 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:43.545964 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:43.566070 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:43.582815 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I1122 02:43:43.600041 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1122 02:43:43.617827 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:43.635344 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:43:43.653161 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:43.672725 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:43.694951 192693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:43.714561 192693 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:43.729479 192693 ssh_runner.go:195] Run: openssl version
I1122 02:43:43.735899 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:43.745768 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:43.749477 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:43.749550 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:43.786496 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:43.794552 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:43.802595 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.806145 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.806193 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:43.840253 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:43.848166 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:43.856251 192693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:43.860300 192693 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:43.860351 192693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:43.917666 192693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:43.928103 192693 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:43:43.932821 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:43:43.981504 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:43:44.016541 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:43:44.060119 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:43:44.107431 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:43:44.155160 192693 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:43:44.198731 192693 kubeadm.go:401] StartCluster: {Name:pause-537523 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:pause-537523 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-
aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:44.198863 192693 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:44.198982 192693 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:44.249695 192693 cri.go:89] found id: "a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e"
I1122 02:43:44.249721 192693 cri.go:89] found id: "76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83"
I1122 02:43:44.249727 192693 cri.go:89] found id: "8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443"
I1122 02:43:44.249733 192693 cri.go:89] found id: "19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4"
I1122 02:43:44.249738 192693 cri.go:89] found id: "f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522"
I1122 02:43:44.249742 192693 cri.go:89] found id: "954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5"
I1122 02:43:44.249747 192693 cri.go:89] found id: "3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b"
I1122 02:43:44.249751 192693 cri.go:89] found id: ""
I1122 02:43:44.249800 192693 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:43:44.262143 192693 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:43:44Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:43:44.262235 192693 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:44.270983 192693 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:43:44.271003 192693 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:43:44.271056 192693 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:43:44.280778 192693 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:43:44.281470 192693 kubeconfig.go:125] found "pause-537523" server: "https://192.168.85.2:8443"
I1122 02:43:44.282285 192693 kapi.go:59] client config for pause-537523: &rest.Config{Host:"https://192.168.85.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]stri
ng(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:43:44.282727 192693 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1122 02:43:44.282745 192693 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1122 02:43:44.282750 192693 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1122 02:43:44.282754 192693 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1122 02:43:44.282757 192693 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1122 02:43:44.283172 192693 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:43:44.291001 192693 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:43:44.291030 192693 kubeadm.go:602] duration metric: took 20.020682ms to restartPrimaryControlPlane
I1122 02:43:44.291040 192693 kubeadm.go:403] duration metric: took 92.323119ms to StartCluster
I1122 02:43:44.291058 192693 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:44.291125 192693 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:44.291799 192693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:44.292045 192693 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:44.292123 192693 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:43:44.292346 192693 config.go:182] Loaded profile config "pause-537523": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:43:44.293502 192693 out.go:179] * Verifying Kubernetes components...
I1122 02:43:44.293518 192693 out.go:179] * Enabled addons:
I1122 02:43:40.944455 186979 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-562593:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (6.06560741s)
I1122 02:43:40.944479 186979 kic.go:203] duration metric: took 6.065748 seconds to extract preloaded images to volume
W1122 02:43:40.944573 186979 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:40.944600 186979 oci.go:243] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:40.944633 186979 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:41.013483 186979 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-562593 --name missing-upgrade-562593 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-562593 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-562593 --network missing-upgrade-562593 --ip 192.168.103.2 --volume missing-upgrade-562593:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
I1122 02:43:41.539473 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Running}}
I1122 02:43:41.564019 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:41.590265 186979 cli_runner.go:164] Run: docker exec missing-upgrade-562593 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:41.649551 186979 oci.go:144] the created container "missing-upgrade-562593" has a running status.
I1122 02:43:41.649576 186979 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa...
I1122 02:43:41.862570 186979 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:41.898801 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:41.938943 186979 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:41.938957 186979 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-562593 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:42.032533 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:42.063158 186979 machine.go:88] provisioning docker machine ...
I1122 02:43:42.063195 186979 ubuntu.go:169] provisioning hostname "missing-upgrade-562593"
I1122 02:43:42.063264 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.091747 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.092543 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:42.092584 186979 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-562593 && echo "missing-upgrade-562593" | sudo tee /etc/hostname
I1122 02:43:42.262961 186979 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-562593
I1122 02:43:42.263034 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.288625 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.289165 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:42.289186 186979 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-562593' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-562593/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-562593' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:42.426428 186979 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:42.426453 186979 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:42.426485 186979 ubuntu.go:177] setting up certificates
I1122 02:43:42.426507 186979 provision.go:83] configureAuth start
I1122 02:43:42.426578 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:42.453696 186979 provision.go:138] copyHostCerts
I1122 02:43:42.453782 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:42.453792 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:42.453878 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:42.454038 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:42.454047 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:42.454111 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:42.454213 186979 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:42.454222 186979 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:42.454264 186979 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:42.454343 186979 provision.go:112] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-562593 san=[192.168.103.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-562593]
I1122 02:43:42.863793 186979 provision.go:172] copyRemoteCerts
I1122 02:43:42.863840 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:42.863878 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:42.884686 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:42.979289 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:43.011052 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:43.037697 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:43.066063 186979 provision.go:86] duration metric: configureAuth took 639.543926ms
I1122 02:43:43.066085 186979 ubuntu.go:193] setting minikube options for container-runtime
I1122 02:43:43.066260 186979 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:43.066369 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.087839 186979 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:43.088201 186979 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32983 <nil> <nil>}
I1122 02:43:43.088214 186979 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:43.348249 186979 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:43.348269 186979 machine.go:91] provisioned docker machine in 1.285095917s
I1122 02:43:43.348280 186979 client.go:171] LocalClient.Create took 25.278306059s
I1122 02:43:43.348303 186979 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-562593" took 25.278400311s
I1122 02:43:43.348311 186979 start.go:300] post-start starting for "missing-upgrade-562593" (driver="docker")
I1122 02:43:43.348323 186979 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:43.348393 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:43.348437 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.368444 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.470863 186979 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:43.474525 186979 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:43.474557 186979 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1122 02:43:43.474569 186979 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1122 02:43:43.474576 186979 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I1122 02:43:43.474587 186979 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:43.474637 186979 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:43.474740 186979 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:43.474865 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:43.485171 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.518252 186979 start.go:303] post-start completed in 169.923393ms
I1122 02:43:43.518668 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:43.541550 186979 profile.go:148] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/config.json ...
I1122 02:43:43.541876 186979 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:43.541945 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.562632 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.650447 186979 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:43.656257 186979 start.go:128] duration metric: createHost completed in 25.587941752s
I1122 02:43:43.656272 186979 start.go:83] releasing machines lock for "missing-upgrade-562593", held for 25.588056206s
I1122 02:43:43.656328 186979 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-562593
I1122 02:43:43.678177 186979 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:43.678212 186979 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:43.678223 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.678265 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:43.700656 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.700732 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:43.895534 186979 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:43.901317 186979 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:44.052110 186979 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1122 02:43:44.056814 186979 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:44.081388 186979 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I1122 02:43:44.081481 186979 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:44.118579 186979 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I1122 02:43:44.118593 186979 start.go:472] detecting cgroup driver to use...
I1122 02:43:44.118626 186979 detect.go:199] detected "systemd" cgroup driver on host os
I1122 02:43:44.118675 186979 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:44.135557 186979 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:44.147616 186979 docker.go:203] disabling cri-docker service (if available) ...
I1122 02:43:44.147668 186979 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:44.163502 186979 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:44.179709 186979 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:44.266507 186979 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:44.358399 186979 docker.go:219] disabling docker service ...
I1122 02:43:44.358465 186979 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:44.377794 186979 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:44.389472 186979 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:44.476193 186979 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:44.716209 186979 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:44.728395 186979 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:44.745894 186979 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:44.745958 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.855799 186979 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:44.855876 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.927079 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.976536 186979 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.993620 186979 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:45.003350 186979 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:45.011869 186979 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:45.020535 186979 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:45.090137 186979 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:41.242207 186990 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v stopped-upgrade-549569:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (6.342832556s)
I1122 02:43:41.242345 186990 kic.go:203] duration metric: took 6.343109 seconds to extract preloaded images to volume
W1122 02:43:41.242455 186990 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:41.242493 186990 oci.go:243] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:41.242543 186990 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:41.308913 186990 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname stopped-upgrade-549569 --name stopped-upgrade-549569 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=stopped-upgrade-549569 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=stopped-upgrade-549569 --network stopped-upgrade-549569 --ip 192.168.94.2 --volume stopped-upgrade-549569:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
I1122 02:43:41.671585 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Running}}
I1122 02:43:41.698377 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:41.721725 186990 cli_runner.go:164] Run: docker exec stopped-upgrade-549569 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:41.788480 186990 oci.go:144] the created container "stopped-upgrade-549569" has a running status.
I1122 02:43:41.788505 186990 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa...
I1122 02:43:42.085975 186990 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:42.126811 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:42.153790 186990 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:42.153920 186990 kic_runner.go:114] Args: [docker exec --privileged stopped-upgrade-549569 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:42.235331 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:43:42.262179 186990 machine.go:88] provisioning docker machine ...
I1122 02:43:42.262216 186990 ubuntu.go:169] provisioning hostname "stopped-upgrade-549569"
I1122 02:43:42.262301 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.288483 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.289129 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.289146 186990 main.go:141] libmachine: About to run SSH command:
sudo hostname stopped-upgrade-549569 && echo "stopped-upgrade-549569" | sudo tee /etc/hostname
I1122 02:43:42.442787 186990 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-549569
I1122 02:43:42.442894 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.468534 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.469245 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.469267 186990 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sstopped-upgrade-549569' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-549569/g' /etc/hosts;
else
echo '127.0.1.1 stopped-upgrade-549569' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:42.599578 186990 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:42.599599 186990 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:42.599637 186990 ubuntu.go:177] setting up certificates
I1122 02:43:42.599654 186990 provision.go:83] configureAuth start
I1122 02:43:42.599719 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:42.621177 186990 provision.go:138] copyHostCerts
I1122 02:43:42.621233 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:42.621240 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:42.621308 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:42.621407 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:42.621412 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:42.621450 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:42.621522 186990 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:42.621527 186990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:42.621562 186990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:42.621623 186990 provision.go:112] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-549569 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-549569]
I1122 02:43:42.721472 186990 provision.go:172] copyRemoteCerts
I1122 02:43:42.721530 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:42.721574 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.743269 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:42.836445 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:42.866154 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:42.893687 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:42.918672 186990 provision.go:86] duration metric: configureAuth took 319.003441ms
I1122 02:43:42.918693 186990 ubuntu.go:193] setting minikube options for container-runtime
I1122 02:43:42.918894 186990 config.go:182] Loaded profile config "stopped-upgrade-549569": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:42.919074 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:42.939765 186990 main.go:141] libmachine: Using SSH client type: native
I1122 02:43:42.940208 186990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808a40] 0x80b720 <nil> [] 0s} 127.0.0.1 32988 <nil> <nil>}
I1122 02:43:42.940230 186990 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:43.180837 186990 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:43.180854 186990 machine.go:91] provisioned docker machine in 918.66032ms
I1122 02:43:43.180865 186990 client.go:171] LocalClient.Create took 25.115137961s
I1122 02:43:43.180887 186990 start.go:167] duration metric: libmachine.API.Create for "stopped-upgrade-549569" took 25.115181688s
I1122 02:43:43.180896 186990 start.go:300] post-start starting for "stopped-upgrade-549569" (driver="docker")
I1122 02:43:43.180934 186990 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:43.180997 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:43.181030 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.200780 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.292036 186990 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:43.296347 186990 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:43.296381 186990 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1122 02:43:43.296393 186990 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1122 02:43:43.296401 186990 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I1122 02:43:43.296413 186990 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:43.296467 186990 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:43.296570 186990 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:43.296684 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:43.306218 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:43.336257 186990 start.go:303] post-start completed in 155.343861ms
I1122 02:43:43.336668 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:43.358330 186990 profile.go:148] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/config.json ...
I1122 02:43:43.358626 186990 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:43.358674 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.379791 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.470000 186990 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:43.474818 186990 start.go:128] duration metric: createHost completed in 25.410908927s
I1122 02:43:43.474835 186990 start.go:83] releasing machines lock for "stopped-upgrade-549569", held for 25.4110247s
I1122 02:43:43.474928 186990 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-549569
I1122 02:43:43.498189 186990 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:43.498243 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.498268 186990 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:43.498325 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:43:43.520011 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.520637 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:43:43.607192 186990 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:43.718205 186990 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:43.861814 186990 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1122 02:43:43.866609 186990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:43.896586 186990 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I1122 02:43:43.896660 186990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:43.932708 186990 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I1122 02:43:43.932725 186990 start.go:472] detecting cgroup driver to use...
I1122 02:43:43.932762 186990 detect.go:199] detected "systemd" cgroup driver on host os
I1122 02:43:43.932812 186990 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:43.950381 186990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:43.964646 186990 docker.go:203] disabling cri-docker service (if available) ...
I1122 02:43:43.964703 186990 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:43.979328 186990 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:43.994738 186990 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:44.072770 186990 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:44.165393 186990 docker.go:219] disabling docker service ...
I1122 02:43:44.165451 186990 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:44.184326 186990 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:44.197186 186990 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:44.294439 186990 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:44.521112 186990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:44.532929 186990 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:44.549091 186990 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:44.549147 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.564139 186990 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:44.564195 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.574521 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.584377 186990 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:44.594145 186990 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:44.603405 186990 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:44.611845 186990 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:44.620126 186990 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:44.700306 186990 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:41.756442 194201 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1122 02:43:41.756723 194201 start.go:159] libmachine.API.Create for "kubernetes-upgrade-019060" (driver="docker")
I1122 02:43:41.756770 194201 client.go:173] LocalClient.Create starting
I1122 02:43:41.756863 194201 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 02:43:41.756926 194201 main.go:143] libmachine: Decoding PEM data...
I1122 02:43:41.756948 194201 main.go:143] libmachine: Parsing certificate...
I1122 02:43:41.757037 194201 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 02:43:41.757066 194201 main.go:143] libmachine: Decoding PEM data...
I1122 02:43:41.757078 194201 main.go:143] libmachine: Parsing certificate...
I1122 02:43:41.757500 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:43:41.781013 194201 cli_runner.go:211] docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:43:41.781102 194201 network_create.go:284] running [docker network inspect kubernetes-upgrade-019060] to gather additional debugging logs...
I1122 02:43:41.781135 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060
W1122 02:43:41.802604 194201 cli_runner.go:211] docker network inspect kubernetes-upgrade-019060 returned with exit code 1
I1122 02:43:41.802632 194201 network_create.go:287] error running [docker network inspect kubernetes-upgrade-019060]: docker network inspect kubernetes-upgrade-019060: exit status 1
stdout:
[]
stderr:
Error response from daemon: network kubernetes-upgrade-019060 not found
I1122 02:43:41.802648 194201 network_create.go:289] output of [docker network inspect kubernetes-upgrade-019060]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network kubernetes-upgrade-019060 not found
** /stderr **
I1122 02:43:41.802758 194201 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:41.826212 194201 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:43:41.827193 194201 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9423c3ade39b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:8e:36:bc:4b:d9:05} reservation:<nil>}
I1122 02:43:41.828091 194201 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-49270bd849d0 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:2a:04:6a:68:04:12} reservation:<nil>}
I1122 02:43:41.829690 194201 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001e98e10}
I1122 02:43:41.829825 194201 network_create.go:124] attempt to create docker network kubernetes-upgrade-019060 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I1122 02:43:41.830015 194201 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 kubernetes-upgrade-019060
I1122 02:43:41.906257 194201 network_create.go:108] docker network kubernetes-upgrade-019060 192.168.76.0/24 created
I1122 02:43:41.906292 194201 kic.go:121] calculated static IP "192.168.76.2" for the "kubernetes-upgrade-019060" container
I1122 02:43:41.906371 194201 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 02:43:41.966589 194201 cli_runner.go:164] Run: docker volume create kubernetes-upgrade-019060 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --label created_by.minikube.sigs.k8s.io=true
I1122 02:43:41.998308 194201 oci.go:103] Successfully created a docker volume kubernetes-upgrade-019060
I1122 02:43:41.998423 194201 cli_runner.go:164] Run: docker run --rm --name kubernetes-upgrade-019060-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --entrypoint /usr/bin/test -v kubernetes-upgrade-019060:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 02:43:42.548586 194201 oci.go:107] Successfully prepared a docker volume kubernetes-upgrade-019060
I1122 02:43:42.548679 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:42.548695 194201 kic.go:194] Starting extracting preloaded images to volume ...
I1122 02:43:42.548799 194201 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-019060:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 02:43:47.275256 186979 ssh_runner.go:235] Completed: sudo systemctl restart crio: (2.185084945s)
I1122 02:43:47.275281 186979 start.go:519] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:47.275327 186979 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:47.280645 186979 start.go:540] Will wait 60s for crictl version
I1122 02:43:47.280706 186979 ssh_runner.go:195] Run: which crictl
I1122 02:43:47.285237 186979 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1122 02:43:47.328955 186979 start.go:556] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I1122 02:43:47.329034 186979 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.368469 186979 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.273841 186990 ssh_runner.go:235] Completed: sudo systemctl restart crio: (2.573503097s)
I1122 02:43:47.273873 186990 start.go:519] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:47.273943 186990 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:47.280440 186990 start.go:540] Will wait 60s for crictl version
I1122 02:43:47.280514 186990 ssh_runner.go:195] Run: which crictl
I1122 02:43:47.285543 186990 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1122 02:43:47.329856 186990 start.go:556] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I1122 02:43:47.329979 186990 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.370346 186990 ssh_runner.go:195] Run: crio --version
I1122 02:43:47.411060 186979 out.go:177] * Preparing Kubernetes v1.28.3 on CRI-O 1.24.6 ...
I1122 02:43:47.411754 186990 out.go:177] * Preparing Kubernetes v1.28.3 on CRI-O 1.24.6 ...
I1122 02:43:47.412530 186979 cli_runner.go:164] Run: docker network inspect missing-upgrade-562593 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:47.431302 186979 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:43:47.435164 186979 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.446268 186979 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime crio
I1122 02:43:47.446329 186979 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.514526 186979 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.514539 186979 crio.go:415] Images already preloaded, skipping extraction
I1122 02:43:47.514581 186979 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.554847 186979 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.554868 186979 cache_images.go:84] Images are preloaded, skipping loading
I1122 02:43:47.554985 186979 ssh_runner.go:195] Run: crio config
I1122 02:43:47.608651 186979 cni.go:84] Creating CNI manager for ""
I1122 02:43:47.608666 186979 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:47.608686 186979 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1122 02:43:47.608711 186979 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:missing-upgrade-562593 NodeName:missing-upgrade-562593 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt Static
PodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:47.608886 186979 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "missing-upgrade-562593"
kubeletExtraArgs:
node-ip: 192.168.103.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:47.608991 186979 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=missing-upgrade-562593 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-562593 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1122 02:43:47.609066 186979 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
I1122 02:43:47.618708 186979 binaries.go:44] Found k8s binaries, skipping transfer
I1122 02:43:47.618757 186979 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:47.628104 186979 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (433 bytes)
I1122 02:43:47.648913 186979 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:47.674117 186979 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2105 bytes)
I1122 02:43:47.695415 186979 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:47.699461 186979 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.710964 186979 certs.go:56] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593 for IP: 192.168.103.2
I1122 02:43:47.710993 186979 certs.go:190] acquiring lock for shared ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.711150 186979 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:47.711198 186979 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:47.711256 186979 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key
I1122 02:43:47.711268 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt with IP's: []
I1122 02:43:47.801956 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt ...
I1122 02:43:47.801970 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt: {Name:mk71b3d2c793392c758f9424348b4590d3e9a031 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.802110 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key ...
I1122 02:43:47.802119 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key: {Name:mkad275acf23d5d3de6e0f51a62b039d993e2f45 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.802192 186979 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9
I1122 02:43:47.802202 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 with IP's: [192.168.103.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1122 02:43:48.210554 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 ...
I1122 02:43:48.210589 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9: {Name:mk14d297b67a580b4d61694d739e9e7421a3d746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.210780 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9 ...
I1122 02:43:48.210795 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9: {Name:mkfe54f5629efdd19e6e1e1eb1681d92250f357f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.210897 186979 certs.go:337] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt.33fce0b9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt
I1122 02:43:48.211028 186979 certs.go:341] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key.33fce0b9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key
I1122 02:43:48.211105 186979 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key
I1122 02:43:48.211128 186979 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt with IP's: []
I1122 02:43:48.402894 186979 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt ...
I1122 02:43:48.402919 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt: {Name:mk627e568909366e897fce92245611d8497909a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.403065 186979 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key ...
I1122 02:43:48.403073 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key: {Name:mka5ee671291d8129d24ad09326ec8c519197c21 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.403243 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:48.403275 186979 certs.go:433] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:48.403286 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:48.403309 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:48.403332 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:48.403350 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:48.403383 186979 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:48.404113 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1122 02:43:48.429806 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:48.453498 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:48.477406 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:43:48.500412 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:48.525139 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:48.549374 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:48.572880 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:48.596543 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:48.623071 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:48.647309 186979 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:48.671289 186979 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:48.689111 186979 ssh_runner.go:195] Run: openssl version
I1122 02:43:48.694289 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:48.704734 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.708279 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.708327 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.715219 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:48.724804 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:48.734748 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:48.738666 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:48.738711 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:48.745680 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:48.755513 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:48.766814 186979 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:48.771054 186979 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:48.771100 186979 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:48.778287 186979 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:48.788651 186979 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I1122 02:43:48.792049 186979 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I1122 02:43:48.792093 186979 kubeadm.go:404] StartCluster: {Name:missing-upgrade-562593 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-562593 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1122 02:43:48.792167 186979 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:48.792212 186979 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:48.831455 186979 cri.go:89] found id: ""
I1122 02:43:48.831526 186979 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:48.841854 186979 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:48.851847 186979 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:48.851893 186979 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:48.861073 186979 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:48.861121 186979 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:48.910116 186979 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
I1122 02:43:48.910158 186979 kubeadm.go:322] [preflight] Running pre-flight checks
I1122 02:43:48.952652 186979 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:48.952746 186979 kubeadm.go:322] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:48.952796 186979 kubeadm.go:322] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:48.952892 186979 kubeadm.go:322] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:48.952990 186979 kubeadm.go:322] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:48.953052 186979 kubeadm.go:322] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:48.953115 186979 kubeadm.go:322] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:48.953178 186979 kubeadm.go:322] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:48.953237 186979 kubeadm.go:322] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:48.953306 186979 kubeadm.go:322] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:48.953364 186979 kubeadm.go:322] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:49.027803 186979 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:49.027998 186979 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:49.028142 186979 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:49.234141 186979 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:43:44.294508 192693 addons.go:530] duration metric: took 2.390522ms for enable addons: enabled=[]
I1122 02:43:44.294542 192693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:44.430976 192693 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:44.445182 192693 node_ready.go:35] waiting up to 6m0s for node "pause-537523" to be "Ready" ...
W1122 02:43:46.448105 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
W1122 02:43:48.448511 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
I1122 02:43:49.236759 186979 out.go:204] - Generating certificates and keys ...
I1122 02:43:49.236896 186979 kubeadm.go:322] [certs] Using existing ca certificate authority
I1122 02:43:49.237016 186979 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:49.387062 186979 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:49.594560 186979 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:49.773229 186979 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:49.862363 186979 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:49.993779 186979 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I1122 02:43:49.994492 186979 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [localhost missing-upgrade-562593] and IPs [192.168.103.2 127.0.0.1 ::1]
I1122 02:43:50.173924 186979 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:50.174157 186979 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [localhost missing-upgrade-562593] and IPs [192.168.103.2 127.0.0.1 ::1]
I1122 02:43:50.285638 186979 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:47.251277 194201 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-019060:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.702427625s)
I1122 02:43:47.251321 194201 kic.go:203] duration metric: took 4.702622549s to extract preloaded images to volume ...
W1122 02:43:47.251433 194201 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:43:47.251481 194201 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:43:47.251527 194201 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:43:47.318828 194201 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-019060 --name kubernetes-upgrade-019060 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-019060 --network kubernetes-upgrade-019060 --ip 192.168.76.2 --volume kubernetes-upgrade-019060:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
I1122 02:43:47.639766 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Running}}
I1122 02:43:47.658928 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:47.680186 194201 cli_runner.go:164] Run: docker exec kubernetes-upgrade-019060 stat /var/lib/dpkg/alternatives/iptables
I1122 02:43:47.725775 194201 oci.go:144] the created container "kubernetes-upgrade-019060" has a running status.
I1122 02:43:47.725812 194201 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa...
I1122 02:43:47.895859 194201 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:43:47.932615 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:47.958465 194201 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:43:47.958489 194201 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-019060 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:43:48.016178 194201 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-019060 --format={{.State.Status}}
I1122 02:43:48.037367 194201 machine.go:94] provisionDockerMachine start ...
I1122 02:43:48.037466 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.056673 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.057032 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.057055 194201 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:43:48.195572 194201 main.go:143] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-019060
I1122 02:43:48.195603 194201 ubuntu.go:182] provisioning hostname "kubernetes-upgrade-019060"
I1122 02:43:48.195675 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.217230 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.217533 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.217557 194201 main.go:143] libmachine: About to run SSH command:
sudo hostname kubernetes-upgrade-019060 && echo "kubernetes-upgrade-019060" | sudo tee /etc/hostname
I1122 02:43:48.360608 194201 main.go:143] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-019060
I1122 02:43:48.360691 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.379729 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.380045 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.380080 194201 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\skubernetes-upgrade-019060' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-019060/g' /etc/hosts;
else
echo '127.0.1.1 kubernetes-upgrade-019060' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:43:48.514172 194201 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:43:48.514197 194201 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:43:48.514221 194201 ubuntu.go:190] setting up certificates
I1122 02:43:48.514234 194201 provision.go:84] configureAuth start
I1122 02:43:48.514290 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:48.532806 194201 provision.go:143] copyHostCerts
I1122 02:43:48.532864 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:43:48.532875 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:43:48.532960 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:43:48.533095 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:43:48.533109 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:43:48.533156 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:43:48.533238 194201 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:43:48.533248 194201 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:43:48.533297 194201 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:43:48.533371 194201 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-019060 san=[127.0.0.1 192.168.76.2 kubernetes-upgrade-019060 localhost minikube]
I1122 02:43:48.611067 194201 provision.go:177] copyRemoteCerts
I1122 02:43:48.611136 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:43:48.611179 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.629439 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:48.724835 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:43:48.745302 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:43:48.763328 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1122 02:43:48.781380 194201 provision.go:87] duration metric: took 267.130767ms to configureAuth
I1122 02:43:48.781412 194201 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:43:48.781587 194201 config.go:182] Loaded profile config "kubernetes-upgrade-019060": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:43:48.781694 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:48.800825 194201 main.go:143] libmachine: Using SSH client type: native
I1122 02:43:48.801144 194201 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 32993 <nil> <nil>}
I1122 02:43:48.801164 194201 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:43:49.081561 194201 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:43:49.081593 194201 machine.go:97] duration metric: took 1.044202233s to provisionDockerMachine
I1122 02:43:49.081606 194201 client.go:176] duration metric: took 7.324828905s to LocalClient.Create
I1122 02:43:49.081623 194201 start.go:167] duration metric: took 7.324902697s to libmachine.API.Create "kubernetes-upgrade-019060"
I1122 02:43:49.081632 194201 start.go:293] postStartSetup for "kubernetes-upgrade-019060" (driver="docker")
I1122 02:43:49.081645 194201 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:43:49.081719 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:43:49.081770 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.101307 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.203163 194201 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:43:49.207268 194201 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:43:49.207303 194201 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:43:49.207315 194201 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:43:49.207359 194201 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:43:49.207438 194201 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:43:49.207527 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:43:49.215051 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:49.235494 194201 start.go:296] duration metric: took 153.848197ms for postStartSetup
I1122 02:43:49.236407 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:49.253594 194201 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/config.json ...
I1122 02:43:49.253843 194201 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:43:49.253896 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.271220 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.361268 194201 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:43:49.365360 194201 start.go:128] duration metric: took 7.61079158s to createHost
I1122 02:43:49.365383 194201 start.go:83] releasing machines lock for "kubernetes-upgrade-019060", held for 7.610940501s
I1122 02:43:49.365445 194201 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-019060
I1122 02:43:49.383939 194201 ssh_runner.go:195] Run: cat /version.json
I1122 02:43:49.383967 194201 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:43:49.383983 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.384045 194201 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-019060
I1122 02:43:49.402407 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.402836 194201 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32993 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/kubernetes-upgrade-019060/id_rsa Username:docker}
I1122 02:43:49.551007 194201 ssh_runner.go:195] Run: systemctl --version
I1122 02:43:49.557212 194201 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:43:49.591932 194201 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:43:49.596296 194201 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:43:49.596359 194201 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:43:49.622688 194201 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 02:43:49.622720 194201 start.go:496] detecting cgroup driver to use...
I1122 02:43:49.622753 194201 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:43:49.622799 194201 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:43:49.639459 194201 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:43:49.650423 194201 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:43:49.650475 194201 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:43:49.665517 194201 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:43:49.683059 194201 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:43:49.766345 194201 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:43:49.867926 194201 docker.go:234] disabling docker service ...
I1122 02:43:49.867998 194201 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:43:49.887173 194201 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:43:49.898512 194201 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:43:49.984231 194201 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:43:50.067804 194201 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:43:50.079353 194201 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:43:50.092223 194201 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1122 02:43:50.092277 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.101877 194201 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:43:50.101982 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.110224 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.117946 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.125590 194201 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:43:50.133225 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.141125 194201 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.153394 194201 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:43:50.161664 194201 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:43:50.168756 194201 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:43:50.175795 194201 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:50.254206 194201 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:43:50.402146 194201 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:43:50.402222 194201 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:43:50.406146 194201 start.go:564] Will wait 60s for crictl version
I1122 02:43:50.406206 194201 ssh_runner.go:195] Run: which crictl
I1122 02:43:50.409581 194201 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:43:50.434689 194201 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:43:50.434791 194201 ssh_runner.go:195] Run: crio --version
I1122 02:43:50.464384 194201 ssh_runner.go:195] Run: crio --version
I1122 02:43:50.498177 194201 out.go:179] * Preparing Kubernetes v1.28.0 on CRI-O 1.34.2 ...
I1122 02:43:47.413147 186990 cli_runner.go:164] Run: docker network inspect stopped-upgrade-549569 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:47.431604 186990 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:43:47.435380 186990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.446479 186990 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime crio
I1122 02:43:47.446529 186990 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.516533 186990 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.516552 186990 crio.go:415] Images already preloaded, skipping extraction
I1122 02:43:47.516596 186990 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:47.556565 186990 crio.go:496] all images are preloaded for cri-o runtime.
I1122 02:43:47.556578 186990 cache_images.go:84] Images are preloaded, skipping loading
I1122 02:43:47.556631 186990 ssh_runner.go:195] Run: crio config
I1122 02:43:47.609611 186990 cni.go:84] Creating CNI manager for ""
I1122 02:43:47.609624 186990 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:47.609645 186990 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1122 02:43:47.609668 186990 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-549569 NodeName:stopped-upgrade-549569 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPod
Path:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:47.609834 186990 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "stopped-upgrade-549569"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:47.609974 186990 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=stopped-upgrade-549569 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.28.3 ClusterName:stopped-upgrade-549569 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1122 02:43:47.610036 186990 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
I1122 02:43:47.619504 186990 binaries.go:44] Found k8s binaries, skipping transfer
I1122 02:43:47.619565 186990 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:47.628757 186990 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (432 bytes)
I1122 02:43:47.648413 186990 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:47.670842 186990 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)
I1122 02:43:47.692081 186990 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:47.696379 186990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:47.709737 186990 certs.go:56] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569 for IP: 192.168.94.2
I1122 02:43:47.709767 186990 certs.go:190] acquiring lock for shared ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.709964 186990 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:47.710034 186990 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:47.710098 186990 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key
I1122 02:43:47.710111 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt with IP's: []
I1122 02:43:47.884928 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt ...
I1122 02:43:47.884951 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.crt: {Name:mk304444fa319ab563168233d3eada9d2e91ecff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.885149 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key ...
I1122 02:43:47.885167 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/client.key: {Name:mk8e7eeef9bc3161ebf685cc6623e345ba6609c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:47.885302 186990 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a
I1122 02:43:47.885319 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1122 02:43:48.098878 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a ...
I1122 02:43:48.098893 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a: {Name:mk0090f8ed0650e34934eb3ea1e9cd2d06071f72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.099043 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a ...
I1122 02:43:48.099055 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a: {Name:mk62f0883bd8e9bf59e5bcb69de7563a3a48693e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.099179 186990 certs.go:337] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt
I1122 02:43:48.099294 186990 certs.go:341] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key
I1122 02:43:48.099381 186990 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key
I1122 02:43:48.099404 186990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt with IP's: []
I1122 02:43:48.171199 186990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt ...
I1122 02:43:48.171213 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt: {Name:mk8f73e486405ac0285fd1407bb8bb47b4086920 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.171367 186990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key ...
I1122 02:43:48.171382 186990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key: {Name:mk81dba3ff018328cebccc8af4e779b6b43e6212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:48.171609 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:48.171653 186990 certs.go:433] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:48.171661 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:48.171693 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:48.171713 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:48.171735 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:48.171771 186990 certs.go:437] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:48.172462 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1122 02:43:48.198500 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:48.224815 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:48.251873 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/stopped-upgrade-549569/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:43:48.278244 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:48.304013 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:48.326777 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:48.349142 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:48.373314 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:48.399632 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:48.423985 186990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:48.449245 186990 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:48.466602 186990 ssh_runner.go:195] Run: openssl version
I1122 02:43:48.471970 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:48.481127 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:48.484542 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:48.484574 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:48.490837 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:48.499513 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:48.508584 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.511957 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.512000 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:48.519457 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:48.529047 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:48.539170 186990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:48.542677 186990 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:48.542716 186990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:48.549038 186990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:48.558419 186990 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I1122 02:43:48.561584 186990 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I1122 02:43:48.561629 186990 kubeadm.go:404] StartCluster: {Name:stopped-upgrade-549569 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:stopped-upgrade-549569 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1122 02:43:48.561707 186990 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:48.561760 186990 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:48.597145 186990 cri.go:89] found id: ""
I1122 02:43:48.597189 186990 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:48.605704 186990 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:48.615056 186990 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:48.615103 186990 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:48.624240 186990 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:48.624283 186990 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:48.712320 186990 kubeadm.go:322] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:43:48.785472 186990 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:43:50.638337 186979 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:50.950654 186979 kubeadm.go:322] [certs] Generating "sa" key and public key
I1122 02:43:50.950788 186979 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:51.137316 186979 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:51.229576 186979 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:51.367617 186979 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:51.458528 186979 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:51.459083 186979 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:51.464117 186979 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:50.499234 194201 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-019060 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:43:50.519097 194201 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:43:50.523100 194201 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:50.533068 194201 kubeadm.go:884] updating cluster {Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerNam
e:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:43:50.533188 194201 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 02:43:50.533249 194201 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:50.562603 194201 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:50.562626 194201 crio.go:433] Images already preloaded, skipping extraction
I1122 02:43:50.562674 194201 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:43:50.586008 194201 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:43:50.586029 194201 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:43:50.586038 194201 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.28.0 crio true true} ...
I1122 02:43:50.586157 194201 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=kubernetes-upgrade-019060 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:43:50.586233 194201 ssh_runner.go:195] Run: crio config
I1122 02:43:50.634480 194201 cni.go:84] Creating CNI manager for ""
I1122 02:43:50.634502 194201 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:50.634518 194201 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:43:50.634537 194201 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.28.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-019060 NodeName:kubernetes-upgrade-019060 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt Sta
ticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:43:50.634672 194201 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "kubernetes-upgrade-019060"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:43:50.634725 194201 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.0
I1122 02:43:50.642397 194201 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:43:50.642454 194201 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:43:50.649699 194201 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)
I1122 02:43:50.661125 194201 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:43:50.675414 194201 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I1122 02:43:50.687510 194201 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:43:50.691006 194201 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:43:50.700408 194201 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:43:50.785024 194201 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:43:50.814239 194201 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060 for IP: 192.168.76.2
I1122 02:43:50.814260 194201 certs.go:195] generating shared ca certs ...
I1122 02:43:50.814280 194201 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.814433 194201 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:43:50.814482 194201 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:43:50.814495 194201 certs.go:257] generating profile certs ...
I1122 02:43:50.814559 194201 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key
I1122 02:43:50.814587 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt with IP's: []
I1122 02:43:50.867558 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt ...
I1122 02:43:50.867585 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt: {Name:mkfd827a4617dd805df02aa63d7b6004578464ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.867773 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key ...
I1122 02:43:50.867790 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key: {Name:mk324fe887b9a1232675ce0e78ee1319dbc7529e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:50.867914 194201 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9
I1122 02:43:50.867940 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I1122 02:43:51.265177 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 ...
I1122 02:43:51.265206 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9: {Name:mk620bcb325e05fd88108049871019d3710ed464 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.265387 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9 ...
I1122 02:43:51.265407 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9: {Name:mk797cb3de23d6d0fa499247f7785155c49499c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.265517 194201 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt.01c88cf9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt
I1122 02:43:51.265627 194201 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key.01c88cf9 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key
I1122 02:43:51.265724 194201 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key
I1122 02:43:51.265744 194201 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt with IP's: []
I1122 02:43:51.472189 194201 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt ...
I1122 02:43:51.472216 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt: {Name:mk742ded5434e029c121a839393182ff52a8db9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.472370 194201 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key ...
I1122 02:43:51.472390 194201 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key: {Name:mk852935967438bdfae3d41b6a6705323af8514f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:51.472596 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:43:51.472634 194201 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:43:51.472644 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:43:51.472667 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:43:51.472695 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:43:51.472715 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:43:51.472752 194201 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:43:51.473388 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:43:51.492079 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:43:51.512957 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:43:51.528874 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:43:51.546232 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
I1122 02:43:51.562752 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:43:51.579863 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:43:51.597118 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:43:51.613242 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:43:51.630538 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:43:51.646289 194201 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:43:51.661967 194201 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:43:51.673967 194201 ssh_runner.go:195] Run: openssl version
I1122 02:43:51.679954 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:43:51.687700 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:43:51.691613 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:43:51.691652 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:43:51.728720 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:43:51.736916 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:43:51.744708 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:43:51.748339 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:43:51.748385 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:43:51.782323 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:43:51.789975 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:43:51.798071 194201 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.801823 194201 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.801876 194201 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:43:51.835662 194201 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:43:51.843619 194201 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:43:51.846940 194201 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 02:43:51.847000 194201 kubeadm.go:401] StartCluster: {Name:kubernetes-upgrade-019060 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:kubernetes-upgrade-019060 Namespace:default APIServerHAVIP: APIServerName:m
inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:43:51.847086 194201 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:43:51.847142 194201 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:43:51.875095 194201 cri.go:89] found id: ""
I1122 02:43:51.875155 194201 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:43:51.882727 194201 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:43:51.890070 194201 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:43:51.890115 194201 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:43:51.897380 194201 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:43:51.897436 194201 kubeadm.go:158] found existing configuration files:
I1122 02:43:51.897481 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1122 02:43:51.904377 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 02:43:51.904420 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 02:43:51.911144 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1122 02:43:51.918127 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 02:43:51.918165 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 02:43:51.925226 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1122 02:43:51.932189 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 02:43:51.932232 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 02:43:51.938682 194201 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1122 02:43:51.945523 194201 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 02:43:51.945565 194201 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 02:43:51.952772 194201 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:43:51.999992 194201 kubeadm.go:319] [init] Using Kubernetes version: v1.28.0
I1122 02:43:52.000065 194201 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:43:52.038706 194201 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:52.038808 194201 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:52.038899 194201 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:52.038998 194201 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:52.039092 194201 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:52.039167 194201 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:52.039241 194201 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:52.039316 194201 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:52.039391 194201 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:52.039465 194201 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:52.039533 194201 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:52.114224 194201 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:52.114376 194201 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:52.114522 194201 kubeadm.go:319] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:52.253016 194201 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
W1122 02:43:50.948595 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
W1122 02:43:53.448235 192693 node_ready.go:57] node "pause-537523" has "Ready":"False" status (will retry)
I1122 02:43:52.255490 194201 out.go:252] - Generating certificates and keys ...
I1122 02:43:52.255570 194201 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:43:52.255665 194201 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:52.316570 194201 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:52.398082 194201 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:52.689230 194201 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:52.832602 194201 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:52.920425 194201 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:43:52.920656 194201 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [kubernetes-upgrade-019060 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:43:53.007876 194201 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:53.008079 194201 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [kubernetes-upgrade-019060 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:43:53.253461 194201 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:53.548760 194201 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:53.734571 194201 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:43:53.734654 194201 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:54.013096 194201 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:54.172898 194201 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:54.610893 194201 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:54.751307 194201 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:54.751441 194201 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:54.759041 194201 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:51.465398 186979 out.go:204] - Booting up control plane ...
I1122 02:43:51.465549 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:51.465632 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:51.466402 186979 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:51.476428 186979 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:51.477289 186979 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:51.477341 186979 kubeadm.go:322] [kubelet-start] Starting the kubelet
I1122 02:43:51.550083 186979 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:54.760521 194201 out.go:252] - Booting up control plane ...
I1122 02:43:54.760649 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:54.760756 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:54.766970 194201 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:54.798591 194201 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:54.800393 194201 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:54.800734 194201 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:43:54.942388 194201 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:54.948925 192693 node_ready.go:49] node "pause-537523" is "Ready"
I1122 02:43:54.948960 192693 node_ready.go:38] duration metric: took 10.503744684s for node "pause-537523" to be "Ready" ...
I1122 02:43:54.948975 192693 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:43:54.949044 192693 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:43:54.965223 192693 api_server.go:72] duration metric: took 10.673142184s to wait for apiserver process to appear ...
I1122 02:43:54.965264 192693 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:43:54.965289 192693 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:43:54.971550 192693 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:43:54.972943 192693 api_server.go:141] control plane version: v1.34.1
I1122 02:43:54.972968 192693 api_server.go:131] duration metric: took 7.697547ms to wait for apiserver health ...
I1122 02:43:54.972978 192693 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:43:54.978094 192693 system_pods.go:59] 7 kube-system pods found
I1122 02:43:54.978120 192693 system_pods.go:61] "coredns-66bc5c9577-hv5cb" [70e5ba26-8049-417b-834b-a031a54d09ea] Running
I1122 02:43:54.978126 192693 system_pods.go:61] "etcd-pause-537523" [e5cb1a46-c768-45ec-b457-0bb37a7e747c] Running
I1122 02:43:54.978131 192693 system_pods.go:61] "kindnet-fxcd4" [c70b8a6e-3290-4da7-8b8b-0ffdd946607d] Running
I1122 02:43:54.978136 192693 system_pods.go:61] "kube-apiserver-pause-537523" [aefaebb5-3f2d-4e56-a898-7b89c6a34a38] Running
I1122 02:43:54.978141 192693 system_pods.go:61] "kube-controller-manager-pause-537523" [2829e90e-1d28-41a8-88ae-dbb1765bd53f] Running
I1122 02:43:54.978146 192693 system_pods.go:61] "kube-proxy-bq4cg" [123edc9d-2827-4c1d-83ed-08bf1654d118] Running
I1122 02:43:54.978150 192693 system_pods.go:61] "kube-scheduler-pause-537523" [a7ff4666-e94f-43ad-9557-5f0d528bec91] Running
I1122 02:43:54.978156 192693 system_pods.go:74] duration metric: took 5.172405ms to wait for pod list to return data ...
I1122 02:43:54.978165 192693 default_sa.go:34] waiting for default service account to be created ...
I1122 02:43:54.980821 192693 default_sa.go:45] found service account: "default"
I1122 02:43:54.980839 192693 default_sa.go:55] duration metric: took 2.669145ms for default service account to be created ...
I1122 02:43:54.980850 192693 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:43:54.983274 192693 system_pods.go:86] 7 kube-system pods found
I1122 02:43:54.983297 192693 system_pods.go:89] "coredns-66bc5c9577-hv5cb" [70e5ba26-8049-417b-834b-a031a54d09ea] Running
I1122 02:43:54.983304 192693 system_pods.go:89] "etcd-pause-537523" [e5cb1a46-c768-45ec-b457-0bb37a7e747c] Running
I1122 02:43:54.983309 192693 system_pods.go:89] "kindnet-fxcd4" [c70b8a6e-3290-4da7-8b8b-0ffdd946607d] Running
I1122 02:43:54.983314 192693 system_pods.go:89] "kube-apiserver-pause-537523" [aefaebb5-3f2d-4e56-a898-7b89c6a34a38] Running
I1122 02:43:54.983320 192693 system_pods.go:89] "kube-controller-manager-pause-537523" [2829e90e-1d28-41a8-88ae-dbb1765bd53f] Running
I1122 02:43:54.983333 192693 system_pods.go:89] "kube-proxy-bq4cg" [123edc9d-2827-4c1d-83ed-08bf1654d118] Running
I1122 02:43:54.983338 192693 system_pods.go:89] "kube-scheduler-pause-537523" [a7ff4666-e94f-43ad-9557-5f0d528bec91] Running
I1122 02:43:54.983345 192693 system_pods.go:126] duration metric: took 2.489594ms to wait for k8s-apps to be running ...
I1122 02:43:54.983353 192693 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:43:54.983402 192693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:55.000534 192693 system_svc.go:56] duration metric: took 17.172356ms WaitForService to wait for kubelet
I1122 02:43:55.000594 192693 kubeadm.go:587] duration metric: took 10.708512075s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:43:55.000616 192693 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:43:55.003439 192693 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:43:55.003464 192693 node_conditions.go:123] node cpu capacity is 8
I1122 02:43:55.003477 192693 node_conditions.go:105] duration metric: took 2.855642ms to run NodePressure ...
I1122 02:43:55.003492 192693 start.go:242] waiting for startup goroutines ...
I1122 02:43:55.003503 192693 start.go:247] waiting for cluster config update ...
I1122 02:43:55.003514 192693 start.go:256] writing updated cluster config ...
I1122 02:43:55.003826 192693 ssh_runner.go:195] Run: rm -f paused
I1122 02:43:55.009022 192693 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:43:55.009718 192693 kapi.go:59] client config for pause-537523: &rest.Config{Host:"https://192.168.85.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.crt", KeyFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/profiles/pause-537523/client.key", CAFile:"/home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]stri
ng(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2825880), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1122 02:43:55.013351 192693 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-hv5cb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.019638 192693 pod_ready.go:94] pod "coredns-66bc5c9577-hv5cb" is "Ready"
I1122 02:43:55.019666 192693 pod_ready.go:86] duration metric: took 6.293614ms for pod "coredns-66bc5c9577-hv5cb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.021821 192693 pod_ready.go:83] waiting for pod "etcd-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.027590 192693 pod_ready.go:94] pod "etcd-pause-537523" is "Ready"
I1122 02:43:55.027620 192693 pod_ready.go:86] duration metric: took 5.773281ms for pod "etcd-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.030609 192693 pod_ready.go:83] waiting for pod "kube-apiserver-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.035403 192693 pod_ready.go:94] pod "kube-apiserver-pause-537523" is "Ready"
I1122 02:43:55.035470 192693 pod_ready.go:86] duration metric: took 4.839416ms for pod "kube-apiserver-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.037579 192693 pod_ready.go:83] waiting for pod "kube-controller-manager-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.413651 192693 pod_ready.go:94] pod "kube-controller-manager-pause-537523" is "Ready"
I1122 02:43:55.413683 192693 pod_ready.go:86] duration metric: took 376.084759ms for pod "kube-controller-manager-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:55.613536 192693 pod_ready.go:83] waiting for pod "kube-proxy-bq4cg" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.014242 192693 pod_ready.go:94] pod "kube-proxy-bq4cg" is "Ready"
I1122 02:43:56.014280 192693 pod_ready.go:86] duration metric: took 400.71755ms for pod "kube-proxy-bq4cg" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.213931 192693 pod_ready.go:83] waiting for pod "kube-scheduler-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.613547 192693 pod_ready.go:94] pod "kube-scheduler-pause-537523" is "Ready"
I1122 02:43:56.613576 192693 pod_ready.go:86] duration metric: took 399.618914ms for pod "kube-scheduler-pause-537523" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:43:56.613587 192693 pod_ready.go:40] duration metric: took 1.604533435s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:43:56.671536 192693 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:43:56.673013 192693 out.go:179] * Done! kubectl is now configured to use "pause-537523" cluster and "default" namespace by default
I1122 02:43:56.552861 186979 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.002852 seconds
I1122 02:43:56.553061 186979 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:43:56.563942 186979 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:43:57.087744 186979 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:43:57.087990 186979 kubeadm.go:322] [mark-control-plane] Marking the node missing-upgrade-562593 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:43:57.601201 186979 kubeadm.go:322] [bootstrap-token] Using token: jkgcoj.omc242w6116kkaoa
I1122 02:43:57.603453 186979 out.go:204] - Configuring RBAC rules ...
I1122 02:43:57.603603 186979 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:43:57.610877 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:43:57.621667 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:43:57.628987 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:43:57.633478 186979 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:43:57.641093 186979 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:43:57.652457 186979 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:43:57.872699 186979 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I1122 02:43:58.014391 186979 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I1122 02:43:58.015367 186979 kubeadm.go:322]
I1122 02:43:58.015451 186979 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I1122 02:43:58.015458 186979 kubeadm.go:322]
I1122 02:43:58.015525 186979 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I1122 02:43:58.015528 186979 kubeadm.go:322]
I1122 02:43:58.015548 186979 kubeadm.go:322] mkdir -p $HOME/.kube
I1122 02:43:58.015598 186979 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:43:58.015662 186979 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:43:58.015673 186979 kubeadm.go:322]
I1122 02:43:58.015724 186979 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I1122 02:43:58.015729 186979 kubeadm.go:322]
I1122 02:43:58.015806 186979 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:43:58.015813 186979 kubeadm.go:322]
I1122 02:43:58.015862 186979 kubeadm.go:322] You should now deploy a pod network to the cluster.
I1122 02:43:58.015982 186979 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:43:58.016042 186979 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:43:58.016044 186979 kubeadm.go:322]
I1122 02:43:58.016110 186979 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:43:58.016203 186979 kubeadm.go:322] and service account keys on each node and then running the following as root:
I1122 02:43:58.016219 186979 kubeadm.go:322]
I1122 02:43:58.016328 186979 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token jkgcoj.omc242w6116kkaoa \
I1122 02:43:58.016431 186979 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:43:58.016448 186979 kubeadm.go:322] --control-plane
I1122 02:43:58.016451 186979 kubeadm.go:322]
I1122 02:43:58.016562 186979 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:43:58.016566 186979 kubeadm.go:322]
I1122 02:43:58.016632 186979 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token jkgcoj.omc242w6116kkaoa \
I1122 02:43:58.016705 186979 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:43:58.018862 186979 kubeadm.go:322] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:43:58.018985 186979 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:43:58.019009 186979 cni.go:84] Creating CNI manager for ""
I1122 02:43:58.019015 186979 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:58.020399 186979 out.go:177] * Configuring CNI (Container Networking Interface) ...
I1122 02:43:58.021662 186979 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:43:58.025761 186979 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.3/kubectl ...
I1122 02:43:58.025771 186979 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I1122 02:43:58.046449 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:43:58.683167 186979 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:43:58.683217 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:43:58.683254 186979 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=8220a6eb95f0a4d75f7f2d7b14cef975f050512d minikube.k8s.io/name=missing-upgrade-562593 minikube.k8s.io/updated_at=2025_11_22T02_43_58_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:43:58.780398 186979 kubeadm.go:1081] duration metric: took 97.221922ms to wait for elevateKubeSystemPrivileges.
I1122 02:43:58.792519 186979 ops.go:34] apiserver oom_adj: -16
I1122 02:43:58.792547 186979 kubeadm.go:406] StartCluster complete in 10.000456685s
I1122 02:43:58.792575 186979 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:58.792670 186979 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:43:58.795695 186979 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:43:58.796139 186979 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:43:58.796977 186979 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:43:58.797173 186979 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]
I1122 02:43:58.797325 186979 addons.go:69] Setting storage-provisioner=true in profile "missing-upgrade-562593"
I1122 02:43:58.797344 186979 addons.go:231] Setting addon storage-provisioner=true in "missing-upgrade-562593"
I1122 02:43:58.797492 186979 host.go:66] Checking if "missing-upgrade-562593" exists ...
I1122 02:43:58.798468 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:58.798991 186979 addons.go:69] Setting default-storageclass=true in profile "missing-upgrade-562593"
I1122 02:43:58.799034 186979 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "missing-upgrade-562593"
I1122 02:43:58.799402 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:58.832299 186979 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:43:58.833528 186979 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:43:58.833541 186979 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:43:58.833616 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:58.839353 186979 kapi.go:248] "coredns" deployment in "kube-system" namespace and "missing-upgrade-562593" context rescaled to 1 replicas
I1122 02:43:58.839410 186979 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:43:58.841486 186979 out.go:177] * Verifying Kubernetes components...
I1122 02:43:59.157492 186990 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
I1122 02:43:59.157558 186990 kubeadm.go:322] [preflight] Running pre-flight checks
I1122 02:43:59.157667 186990 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:43:59.157747 186990 kubeadm.go:322] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:43:59.157791 186990 kubeadm.go:322] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:43:59.157849 186990 kubeadm.go:322] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:43:59.157920 186990 kubeadm.go:322] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:43:59.157981 186990 kubeadm.go:322] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:43:59.158041 186990 kubeadm.go:322] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:43:59.158102 186990 kubeadm.go:322] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:43:59.158161 186990 kubeadm.go:322] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:43:59.158221 186990 kubeadm.go:322] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:43:59.158275 186990 kubeadm.go:322] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:43:59.158367 186990 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:43:59.158482 186990 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:43:59.158597 186990 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1122 02:43:59.158677 186990 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:43:59.160659 186990 out.go:204] - Generating certificates and keys ...
I1122 02:43:59.160956 186990 kubeadm.go:322] [certs] Using existing ca certificate authority
I1122 02:43:59.161044 186990 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I1122 02:43:59.161142 186990 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:43:59.161214 186990 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:43:59.161297 186990 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I1122 02:43:59.161362 186990 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I1122 02:43:59.161436 186990 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I1122 02:43:59.161578 186990 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [localhost stopped-upgrade-549569] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:43:59.161631 186990 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I1122 02:43:59.161765 186990 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [localhost stopped-upgrade-549569] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:43:59.161829 186990 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:43:59.161890 186990 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:43:59.161958 186990 kubeadm.go:322] [certs] Generating "sa" key and public key
I1122 02:43:59.162030 186990 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:43:59.162097 186990 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:43:59.162161 186990 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:43:59.162234 186990 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:43:59.162481 186990 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:43:59.162758 186990 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:43:59.162880 186990 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:43:59.164291 186990 out.go:204] - Booting up control plane ...
I1122 02:43:59.164408 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:43:59.164497 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:43:59.164583 186990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:43:59.165046 186990 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:43:59.165223 186990 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:43:59.165299 186990 kubeadm.go:322] [kubelet-start] Starting the kubelet
I1122 02:43:59.165530 186990 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1122 02:43:59.165632 186990 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.005038 seconds
I1122 02:43:59.165781 186990 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:43:59.165961 186990 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:43:59.166034 186990 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:43:59.169969 186990 kubeadm.go:322] [mark-control-plane] Marking the node stopped-upgrade-549569 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:43:59.170103 186990 kubeadm.go:322] [bootstrap-token] Using token: 6y2o66.jogpxtr1vydl7i1b
I1122 02:43:59.171302 186990 out.go:204] - Configuring RBAC rules ...
I1122 02:43:59.171441 186990 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:43:59.171545 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:43:59.171759 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:43:59.171978 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:43:59.172120 186990 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:43:59.172241 186990 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:43:59.172416 186990 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:43:59.172469 186990 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I1122 02:43:59.172529 186990 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I1122 02:43:59.172532 186990 kubeadm.go:322]
I1122 02:43:59.172609 186990 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I1122 02:43:59.172614 186990 kubeadm.go:322]
I1122 02:43:59.172710 186990 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I1122 02:43:59.172714 186990 kubeadm.go:322]
I1122 02:43:59.172746 186990 kubeadm.go:322] mkdir -p $HOME/.kube
I1122 02:43:59.172820 186990 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:43:59.172887 186990 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:43:59.172890 186990 kubeadm.go:322]
I1122 02:43:59.172995 186990 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I1122 02:43:59.173000 186990 kubeadm.go:322]
I1122 02:43:59.173064 186990 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:43:59.173072 186990 kubeadm.go:322]
I1122 02:43:59.173147 186990 kubeadm.go:322] You should now deploy a pod network to the cluster.
I1122 02:43:59.173246 186990 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:43:59.173322 186990 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:43:59.173327 186990 kubeadm.go:322]
I1122 02:43:59.173436 186990 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:43:59.173524 186990 kubeadm.go:322] and service account keys on each node and then running the following as root:
I1122 02:43:59.173530 186990 kubeadm.go:322]
I1122 02:43:59.173637 186990 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 6y2o66.jogpxtr1vydl7i1b \
I1122 02:43:59.173898 186990 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:43:59.173971 186990 kubeadm.go:322] --control-plane
I1122 02:43:59.173980 186990 kubeadm.go:322]
I1122 02:43:59.174097 186990 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:43:59.174112 186990 kubeadm.go:322]
I1122 02:43:59.174204 186990 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 6y2o66.jogpxtr1vydl7i1b \
I1122 02:43:59.174341 186990 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:43:59.174355 186990 cni.go:84] Creating CNI manager for ""
I1122 02:43:59.174363 186990 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:43:59.176159 186990 out.go:177] * Configuring CNI (Container Networking Interface) ...
I1122 02:43:58.840294 186979 addons.go:231] Setting addon default-storageclass=true in "missing-upgrade-562593"
I1122 02:43:58.842944 186979 host.go:66] Checking if "missing-upgrade-562593" exists ...
I1122 02:43:58.843129 186979 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:43:58.843521 186979 cli_runner.go:164] Run: docker container inspect missing-upgrade-562593 --format={{.State.Status}}
I1122 02:43:58.862678 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:58.873357 186979 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:43:58.873371 186979 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:43:58.873440 186979 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-562593
I1122 02:43:58.899160 186979 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32983 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/missing-upgrade-562593/id_rsa Username:docker}
I1122 02:43:58.913182 186979 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.103.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:43:58.914222 186979 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:43:58.914267 186979 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:43:58.980319 186979 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:43:59.022069 186979 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:43:59.291071 186979 start.go:926] {"host.minikube.internal": 192.168.103.1} host record injected into CoreDNS's ConfigMap
I1122 02:43:59.291122 186979 api_server.go:72] duration metric: took 451.672134ms to wait for apiserver process to appear ...
I1122 02:43:59.291132 186979 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:43:59.291151 186979 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:43:59.299968 186979 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:43:59.302118 186979 api_server.go:141] control plane version: v1.28.3
I1122 02:43:59.302138 186979 api_server.go:131] duration metric: took 11.000504ms to wait for apiserver health ...
I1122 02:43:59.302149 186979 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:43:59.316976 186979 system_pods.go:59] 4 kube-system pods found
I1122 02:43:59.317001 186979 system_pods.go:61] "etcd-missing-upgrade-562593" [e42618ed-0e5e-417e-8278-a6b7ebd01f49] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:43:59.317010 186979 system_pods.go:61] "kube-apiserver-missing-upgrade-562593" [0cb2ded5-ecaa-4458-b003-657c1e964f1f] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:43:59.317027 186979 system_pods.go:61] "kube-controller-manager-missing-upgrade-562593" [ba2963a2-b7d9-4c73-8e8f-9c6ee53273e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:43:59.317034 186979 system_pods.go:61] "kube-scheduler-missing-upgrade-562593" [33e5537c-6407-4c4c-906a-c419fc61d655] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:43:59.317046 186979 system_pods.go:74] duration metric: took 14.890899ms to wait for pod list to return data ...
I1122 02:43:59.317056 186979 kubeadm.go:581] duration metric: took 477.60922ms to wait for : map[apiserver:true system_pods:true] ...
I1122 02:43:59.317074 186979 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:43:59.323284 186979 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:43:59.323303 186979 node_conditions.go:123] node cpu capacity is 8
I1122 02:43:59.323319 186979 node_conditions.go:105] duration metric: took 6.239406ms to run NodePressure ...
I1122 02:43:59.323333 186979 start.go:228] waiting for startup goroutines ...
I1122 02:43:59.547282 186979 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I1122 02:43:59.548318 186979 addons.go:502] enable addons completed in 751.14447ms: enabled=[storage-provisioner default-storageclass]
I1122 02:43:59.548353 186979 start.go:233] waiting for cluster config update ...
I1122 02:43:59.548362 186979 start.go:242] writing updated cluster config ...
I1122 02:43:59.548581 186979 ssh_runner.go:195] Run: rm -f paused
I1122 02:43:59.602797 186979 start.go:600] kubectl: 1.34.2, cluster: 1.28.3 (minor skew: 6)
I1122 02:43:59.604419 186979 out.go:177]
W1122 02:43:59.605517 186979 out.go:239] ! /usr/local/bin/kubectl is version 1.34.2, which may have incompatibilities with Kubernetes 1.28.3.
I1122 02:43:59.606676 186979 out.go:177] - Want kubectl v1.28.3? Try 'minikube kubectl -- get pods -A'
I1122 02:43:59.607870 186979 out.go:177] * Done! kubectl is now configured to use "missing-upgrade-562593" cluster and "default" namespace by default
I1122 02:43:59.179830 186990 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:43:59.188351 186990 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.3/kubectl ...
I1122 02:43:59.188365 186990 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I1122 02:43:59.234295 186990 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:44:00.021238 186990 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:44:00.021379 186990 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:44:00.021379 186990 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=8220a6eb95f0a4d75f7f2d7b14cef975f050512d minikube.k8s.io/name=stopped-upgrade-549569 minikube.k8s.io/updated_at=2025_11_22T02_44_00_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:44:00.109642 186990 ops.go:34] apiserver oom_adj: -16
I1122 02:44:00.109696 186990 kubeadm.go:1081] duration metric: took 88.402207ms to wait for elevateKubeSystemPrivileges.
I1122 02:44:00.109732 186990 kubeadm.go:406] StartCluster complete in 11.548109473s
I1122 02:44:00.109812 186990 settings.go:142] acquiring lock: {Name:mk18c2824aa737beb7daeec08111c9ba64bfd462 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:44:00.110003 186990 settings.go:150] Updating kubeconfig: /tmp/legacy_kubeconfig691475272
I1122 02:44:00.110477 186990 lock.go:35] WriteFile acquiring /tmp/legacy_kubeconfig691475272: {Name:mk34a3caccca127c843499fcffa7578c575c945b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:44:00.110682 186990 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:44:00.110843 186990 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]
I1122 02:44:00.110924 186990 addons.go:69] Setting storage-provisioner=true in profile "stopped-upgrade-549569"
I1122 02:44:00.110943 186990 addons.go:69] Setting default-storageclass=true in profile "stopped-upgrade-549569"
I1122 02:44:00.110952 186990 addons.go:231] Setting addon storage-provisioner=true in "stopped-upgrade-549569"
I1122 02:44:00.110965 186990 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-549569"
I1122 02:44:00.111014 186990 host.go:66] Checking if "stopped-upgrade-549569" exists ...
I1122 02:44:00.111023 186990 config.go:182] Loaded profile config "stopped-upgrade-549569": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:44:00.111400 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:44:00.111610 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:44:00.133870 186990 kapi.go:248] "coredns" deployment in "kube-system" namespace and "stopped-upgrade-549569" context rescaled to 1 replicas
I1122 02:44:00.133933 186990 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:44:00.135404 186990 out.go:177] * Verifying Kubernetes components...
I1122 02:44:00.136509 186990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:44:00.137789 186990 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:43:59.449733 194201 kubeadm.go:319] [apiclient] All control plane components are healthy after 4.505649 seconds
I1122 02:43:59.449942 194201 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:43:59.464786 194201 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:43:59.986329 194201 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:43:59.986586 194201 kubeadm.go:319] [mark-control-plane] Marking the node kubernetes-upgrade-019060 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:44:00.500305 194201 kubeadm.go:319] [bootstrap-token] Using token: 8mrgx4.6gljefzfryb9r7dp
I1122 02:44:00.137016 186990 addons.go:231] Setting addon default-storageclass=true in "stopped-upgrade-549569"
I1122 02:44:00.138928 186990 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:44:00.138938 186990 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:44:00.138960 186990 host.go:66] Checking if "stopped-upgrade-549569" exists ...
I1122 02:44:00.138985 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:44:00.139490 186990 cli_runner.go:164] Run: docker container inspect stopped-upgrade-549569 --format={{.State.Status}}
I1122 02:44:00.163973 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:44:00.165513 186990 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:44:00.165527 186990 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:44:00.165587 186990 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-549569
I1122 02:44:00.190410 186990 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32988 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/stopped-upgrade-549569/id_rsa Username:docker}
I1122 02:44:00.206306 186990 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.94.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:44:00.207272 186990 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:44:00.207321 186990 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:44:00.275274 186990 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:44:00.299969 186990 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:44:00.458891 186990 start.go:926] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS's ConfigMap
I1122 02:44:00.458890 186990 api_server.go:72] duration metric: took 324.910572ms to wait for apiserver process to appear ...
I1122 02:44:00.458937 186990 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:44:00.458957 186990 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
I1122 02:44:00.464947 186990 api_server.go:279] https://192.168.94.2:8443/healthz returned 200:
ok
I1122 02:44:00.466367 186990 api_server.go:141] control plane version: v1.28.3
I1122 02:44:00.466384 186990 api_server.go:131] duration metric: took 7.440768ms to wait for apiserver health ...
I1122 02:44:00.466394 186990 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:44:00.476253 186990 system_pods.go:59] 4 kube-system pods found
I1122 02:44:00.476280 186990 system_pods.go:61] "etcd-stopped-upgrade-549569" [92ee29fa-2746-4e85-a572-732b824556b3] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:44:00.476291 186990 system_pods.go:61] "kube-apiserver-stopped-upgrade-549569" [bc44a5a1-8a5c-4635-a19d-4f186c55155a] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:44:00.476302 186990 system_pods.go:61] "kube-controller-manager-stopped-upgrade-549569" [79530412-fa4b-4f31-987c-dd5c7bdbb05f] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:44:00.476314 186990 system_pods.go:61] "kube-scheduler-stopped-upgrade-549569" [7241af98-9064-45af-a501-d179528222ac] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:44:00.476322 186990 system_pods.go:74] duration metric: took 9.921702ms to wait for pod list to return data ...
I1122 02:44:00.476337 186990 kubeadm.go:581] duration metric: took 342.365152ms to wait for : map[apiserver:true system_pods:true] ...
I1122 02:44:00.476356 186990 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:44:00.480150 186990 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:44:00.480168 186990 node_conditions.go:123] node cpu capacity is 8
I1122 02:44:00.480187 186990 node_conditions.go:105] duration metric: took 3.825636ms to run NodePressure ...
I1122 02:44:00.480200 186990 start.go:228] waiting for startup goroutines ...
I1122 02:44:00.686539 186990 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I1122 02:44:00.687922 186990 addons.go:502] enable addons completed in 577.062985ms: enabled=[storage-provisioner default-storageclass]
I1122 02:44:00.687955 186990 start.go:233] waiting for cluster config update ...
I1122 02:44:00.687967 186990 start.go:242] writing updated cluster config ...
I1122 02:44:00.688244 186990 ssh_runner.go:195] Run: rm -f paused
I1122 02:44:00.749779 186990 start.go:600] kubectl: 1.34.2, cluster: 1.28.3 (minor skew: 6)
I1122 02:44:00.750969 186990 out.go:177]
W1122 02:44:00.756223 186990 out.go:239] ! /usr/local/bin/kubectl is version 1.34.2, which may have incompatibilities with Kubernetes 1.28.3.
I1122 02:44:00.757709 186990 out.go:177] - Want kubectl v1.28.3? Try 'minikube kubectl -- get pods -A'
I1122 02:44:00.759180 186990 out.go:177] * Done! kubectl is now configured to use "stopped-upgrade-549569" cluster and "default" namespace by default
I1122 02:44:00.501734 194201 out.go:252] - Configuring RBAC rules ...
I1122 02:44:00.501896 194201 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:44:00.508229 194201 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:44:00.515664 194201 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:44:00.518210 194201 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:44:00.521674 194201 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:44:00.524386 194201 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:44:00.536300 194201 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:44:00.731062 194201 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:44:00.912349 194201 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:44:00.915859 194201 kubeadm.go:319]
I1122 02:44:00.915993 194201 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:44:00.916026 194201 kubeadm.go:319]
I1122 02:44:00.916228 194201 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:44:00.916245 194201 kubeadm.go:319]
I1122 02:44:00.916279 194201 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:44:00.916357 194201 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:44:00.916426 194201 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:44:00.916431 194201 kubeadm.go:319]
I1122 02:44:00.916509 194201 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:44:00.916518 194201 kubeadm.go:319]
I1122 02:44:00.916581 194201 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:44:00.916589 194201 kubeadm.go:319]
I1122 02:44:00.916657 194201 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:44:00.916763 194201 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:44:00.916856 194201 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:44:00.916868 194201 kubeadm.go:319]
I1122 02:44:00.917047 194201 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:44:00.917161 194201 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:44:00.917171 194201 kubeadm.go:319]
I1122 02:44:00.917290 194201 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 8mrgx4.6gljefzfryb9r7dp \
I1122 02:44:00.917377 194201 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:44:00.917396 194201 kubeadm.go:319] --control-plane
I1122 02:44:00.917402 194201 kubeadm.go:319]
I1122 02:44:00.917467 194201 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:44:00.917473 194201 kubeadm.go:319]
I1122 02:44:00.917536 194201 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token 8mrgx4.6gljefzfryb9r7dp \
I1122 02:44:00.917642 194201 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:44:00.919555 194201 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:44:00.919749 194201 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:44:00.919784 194201 cni.go:84] Creating CNI manager for ""
I1122 02:44:00.919793 194201 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:44:00.923254 194201 out.go:179] * Configuring CNI (Container Networking Interface) ...
==> CRI-O <==
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.935974096Z" level=info msg="RDT not available in the host system"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.935987375Z" level=info msg="Using conmon executable: /usr/libexec/crio/conmon"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936799073Z" level=info msg="Conmon does support the --sync option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936816584Z" level=info msg="Conmon does support the --log-global-size-max option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.936830156Z" level=info msg="Using conmon executable: /usr/libexec/crio/conmon"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.937725776Z" level=info msg="Conmon does support the --sync option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.937739919Z" level=info msg="Conmon does support the --log-global-size-max option"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.941963075Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.941979852Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.943471756Z" level=info msg="Current CRI-O configuration:\n[crio]\n root = \"/var/lib/containers/storage\"\n runroot = \"/run/containers/storage\"\n imagestore = \"\"\n storage_driver = \"overlay\"\n log_dir = \"/var/log/crio/pods\"\n version_file = \"/var/run/crio/version\"\n version_file_persist = \"\"\n clean_shutdown_file = \"/var/lib/crio/clean.shutdown\"\n internal_wipe = true\n internal_repair = true\n [crio.api]\n grpc_max_send_msg_size = 83886080\n grpc_max_recv_msg_size = 83886080\n listen = \"/var/run/crio/crio.sock\"\n stream_address = \"127.0.0.1\"\n stream_port = \"0\"\n stream_enable_tls = false\n stream_tls_cert = \"\"\n stream_tls_key = \"\"\n stream_tls_ca = \"\"\n stream_idle_timeout = \"\"\n [crio.runtime]\n no_pivot = false\n selinux = false\n log_to_journald = false\n drop_infra_ctr = true\n read_only = false\n hooks_dir = [\"/usr/share/containers/oci/hoo
ks.d\"]\n default_capabilities = [\"CHOWN\", \"DAC_OVERRIDE\", \"FSETID\", \"FOWNER\", \"SETGID\", \"SETUID\", \"SETPCAP\", \"NET_BIND_SERVICE\", \"KILL\"]\n add_inheritable_capabilities = false\n default_sysctls = [\"net.ipv4.ip_unprivileged_port_start=0\"]\n allowed_devices = [\"/dev/fuse\", \"/dev/net/tun\"]\n cdi_spec_dirs = [\"/etc/cdi\", \"/var/run/cdi\"]\n device_ownership_from_security_context = false\n default_runtime = \"crun\"\n decryption_keys_path = \"/etc/crio/keys/\"\n conmon = \"\"\n conmon_cgroup = \"pod\"\n seccomp_profile = \"\"\n privileged_seccomp_profile = \"\"\n apparmor_profile = \"crio-default\"\n blockio_config_file = \"\"\n blockio_reload = false\n irqbalance_config_file = \"/etc/sysconfig/irqbalance\"\n rdt_config_file = \"\"\n cgroup_manager = \"systemd\"\n default_mounts_file = \"\"\n container_exits_dir = \"/var/run/crio/exits\"\n container_attach_socket_dir = \"/var/run/crio\"\n bind_mount_prefix = \"\"\n uid_
mappings = \"\"\n minimum_mappable_uid = -1\n gid_mappings = \"\"\n minimum_mappable_gid = -1\n log_level = \"info\"\n log_filter = \"\"\n namespaces_dir = \"/var/run\"\n pinns_path = \"/usr/bin/pinns\"\n enable_criu_support = false\n pids_limit = -1\n log_size_max = -1\n ctr_stop_timeout = 30\n separate_pull_cgroup = \"\"\n infra_ctr_cpuset = \"\"\n shared_cpuset = \"\"\n enable_pod_events = false\n irqbalance_config_restore_file = \"/etc/sysconfig/orig_irq_banned_cpus\"\n hostnetwork_disable_selinux = true\n disable_hostport_mapping = false\n timezone = \"\"\n [crio.runtime.runtimes]\n [crio.runtime.runtimes.crun]\n runtime_config_path = \"\"\n runtime_path = \"/usr/libexec/crio/crun\"\n runtime_type = \"\"\n runtime_root = \"/run/crun\"\n allowed_annotations = [\"io.containers.trace-syscall\"]\n monitor_path = \"/usr/libexec/crio/conmon\"\n monitor_cgroup = \"pod\"\n container_min_memory
= \"12MiB\"\n no_sync_log = false\n [crio.runtime.runtimes.runc]\n runtime_config_path = \"\"\n runtime_path = \"/usr/libexec/crio/runc\"\n runtime_type = \"\"\n runtime_root = \"/run/runc\"\n monitor_path = \"/usr/libexec/crio/conmon\"\n monitor_cgroup = \"pod\"\n container_min_memory = \"12MiB\"\n no_sync_log = false\n [crio.image]\n default_transport = \"docker://\"\n global_auth_file = \"\"\n pause_image = \"registry.k8s.io/pause:3.10.1\"\n pause_image_auth_file = \"\"\n pause_command = \"/pause\"\n signature_policy = \"/etc/crio/policy.json\"\n signature_policy_dir = \"/etc/crio/policies\"\n image_volumes = \"mkdir\"\n big_files_temporary_dir = \"\"\n auto_reload_registries = false\n pull_progress_timeout = \"0s\"\n oci_artifact_mount_support = true\n short_name_mode = \"enforcing\"\n [crio.network]\n cni_default_network = \"\"\n network_dir = \"/etc/cni/net.d/\"\n plugin_dirs = [\"/opt/
cni/bin/\"]\n [crio.metrics]\n enable_metrics = false\n metrics_collectors = [\"image_pulls_layer_size\", \"containers_events_dropped_total\", \"containers_oom_total\", \"processes_defunct\", \"operations_total\", \"operations_latency_seconds\", \"operations_latency_seconds_total\", \"operations_errors_total\", \"image_pulls_bytes_total\", \"image_pulls_skipped_bytes_total\", \"image_pulls_failure_total\", \"image_pulls_success_total\", \"image_layer_reuse_total\", \"containers_oom_count_total\", \"containers_seccomp_notifier_count_total\", \"resources_stalled_at_stage\", \"containers_stopped_monitor_count\"]\n metrics_host = \"127.0.0.1\"\n metrics_port = 9090\n metrics_socket = \"\"\n metrics_cert = \"\"\n metrics_key = \"\"\n [crio.tracing]\n enable_tracing = false\n tracing_endpoint = \"127.0.0.1:4317\"\n tracing_sampling_rate_per_million = 0\n [crio.stats]\n stats_collection_period = 0\n collection_period = 0\n [crio.nri]\n enable_nri = true\n nri_listen = \"
/var/run/nri/nri.sock\"\n nri_plugin_dir = \"/opt/nri/plugins\"\n nri_plugin_config_dir = \"/etc/nri/conf.d\"\n nri_plugin_registration_timeout = \"5s\"\n nri_plugin_request_timeout = \"2s\"\n nri_disable_connections = false\n [crio.nri.default_validator]\n nri_enable_default_validator = false\n nri_validator_reject_oci_hook_adjustment = false\n nri_validator_reject_runtime_default_seccomp_adjustment = false\n nri_validator_reject_unconfined_seccomp_adjustment = false\n nri_validator_reject_custom_seccomp_adjustment = false\n nri_validator_reject_namespace_adjustment = false\n nri_validator_tolerate_missing_plugins_annotation = \"\"\n"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.943968561Z" level=info msg="Attempting to restore irqbalance config from /etc/sysconfig/orig_irq_banned_cpus"
Nov 22 02:43:42 pause-537523 crio[2156]: time="2025-11-22T02:43:42.944031122Z" level=info msg="Restore irqbalance config: failed to get current CPU ban list, ignoring"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.035428746Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-hv5cb Namespace:kube-system ID:d68223e030107a9d287bcd99be6ed0bf10077350b5e7bc6f4b24247b316a4806 UID:70e5ba26-8049-417b-834b-a031a54d09ea NetNS:/var/run/netns/9c1c6d0b-a74f-4e22-b0ea-4aae24976614 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc000898938}] Aliases:map[]}"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.035748673Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-hv5cb for CNI network kindnet (type=ptp)"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036308268Z" level=info msg="Registered SIGHUP reload watcher"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036340898Z" level=info msg="Starting seccomp notifier watcher"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036388191Z" level=info msg="Create NRI interface"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036506943Z" level=info msg="built-in NRI default validator is disabled"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.03652213Z" level=info msg="runtime interface created"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036534998Z" level=info msg="Registered domain \"k8s.io\" with NRI"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036542813Z" level=info msg="runtime interface starting up..."
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036561622Z" level=info msg="starting plugins..."
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036580538Z" level=info msg="Synchronizing NRI (plugin) with current runtime state"
Nov 22 02:43:43 pause-537523 crio[2156]: time="2025-11-22T02:43:43.036995988Z" level=info msg="No systemd watchdog enabled"
Nov 22 02:43:43 pause-537523 systemd[1]: Started crio.service - Container Runtime Interface for OCI (CRI-O).
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
a1900d5a94165 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 30 seconds ago Running coredns 0 d68223e030107 coredns-66bc5c9577-hv5cb kube-system
76c103ade12b5 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 42 seconds ago Running kindnet-cni 0 e6bcde3a6524d kindnet-fxcd4 kube-system
8ee826891fe8b fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 42 seconds ago Running kube-proxy 0 58f67893efd78 kube-proxy-bq4cg kube-system
19937eb9c4a3f 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 53 seconds ago Running etcd 0 83217135d4296 etcd-pause-537523 kube-system
f9b1fa7dcad62 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 53 seconds ago Running kube-scheduler 0 de86c336660b9 kube-scheduler-pause-537523 kube-system
954fe52a33995 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 53 seconds ago Running kube-apiserver 0 baa55c7d2913e kube-apiserver-pause-537523 kube-system
3d518d8a64067 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 53 seconds ago Running kube-controller-manager 0 f58876a454914 kube-controller-manager-pause-537523 kube-system
==> coredns [a1900d5a94165918a441a5a40b1422904f546ddef0b3f2db6a67a44545a74d0e] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = fa9a0cdcdddcb4be74a0eaf7cfcb211c40e29ddf5507e03bbfc0065bade31f0f2641a2513136e246f32328dd126fc93236fb5c595246f0763926a524386705e8
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:38617 - 45567 "HINFO IN 503470649774205904.839763709708322538. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.873004485s
==> describe nodes <==
Name: pause-537523
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=pause-537523
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=pause-537523
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_43_14_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:43:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: pause-537523
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:43:54 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:43:54 +0000 Sat, 22 Nov 2025 02:43:54 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: pause-537523
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 316e3060-1642-498f-ab78-0998f1eb023b
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (7 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-66bc5c9577-hv5cb 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 43s
kube-system etcd-pause-537523 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 49s
kube-system kindnet-fxcd4 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 44s
kube-system kube-apiserver-pause-537523 250m (3%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system kube-controller-manager-pause-537523 200m (2%) 0 (0%) 0 (0%) 0 (0%) 49s
kube-system kube-proxy-bq4cg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 44s
kube-system kube-scheduler-pause-537523 100m (1%) 0 (0%) 0 (0%) 0 (0%) 49s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 42s kube-proxy
Normal Starting 49s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 49s kubelet Node pause-537523 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 49s kubelet Node pause-537523 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 49s kubelet Node pause-537523 status is now: NodeHasSufficientPID
Normal RegisteredNode 45s node-controller Node pause-537523 event: Registered Node pause-537523 in Controller
Normal NodeNotReady 18s kubelet Node pause-537523 status is now: NodeNotReady
Normal NodeReady 8s (x2 over 32s) kubelet Node pause-537523 status is now: NodeReady
==> dmesg <==
[ +0.083227] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.024406] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +4.966472] kauditd_printk_skb: 47 callbacks suppressed
[Nov22 01:58] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.019095] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000021] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023876] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023874] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023866] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +1.023868] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000009] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +2.047813] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +4.031574] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000022] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +8.127154] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 01:59] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
==> etcd [19937eb9c4a3f739410086fc6daebdd9d7ff5c7bcc4058f49c09ef3a10de9bd4] <==
{"level":"warn","ts":"2025-11-22T02:43:10.244838Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35566","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.262491Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35572","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.269867Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35602","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.276308Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35606","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:43:10.334429Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35624","server-name":"","error":"EOF"}
{"level":"info","ts":"2025-11-22T02:43:30.644742Z","caller":"traceutil/trace.go:172","msg":"trace[1310905291] transaction","detail":"{read_only:false; response_revision:386; number_of_response:1; }","duration":"111.104805ms","start":"2025-11-22T02:43:30.533617Z","end":"2025-11-22T02:43:30.644722Z","steps":["trace[1310905291] 'process raft request' (duration: 96.939064ms)","trace[1310905291] 'compare' (duration: 14.077427ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:31.593474Z","caller":"traceutil/trace.go:172","msg":"trace[997715274] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"117.603185ms","start":"2025-11-22T02:43:31.475854Z","end":"2025-11-22T02:43:31.593457Z","steps":["trace[997715274] 'process raft request' (duration: 117.497344ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:43:31.840367Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"122.997986ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223109599453 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" mod_revision:334 > success:<request_put:<key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" value_size:1193 >> failure:<request_range:<key:\"/registry/endpointslices/kube-system/kube-dns-jp8s2\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:43:31.840712Z","caller":"traceutil/trace.go:172","msg":"trace[1867170773] transaction","detail":"{read_only:false; response_revision:396; number_of_response:1; }","duration":"243.631895ms","start":"2025-11-22T02:43:31.597060Z","end":"2025-11-22T02:43:31.840692Z","steps":["trace[1867170773] 'process raft request' (duration: 119.833684ms)","trace[1867170773] 'compare' (duration: 122.920198ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:31.840802Z","caller":"traceutil/trace.go:172","msg":"trace[1115065947] transaction","detail":"{read_only:false; response_revision:397; number_of_response:1; }","duration":"239.723165ms","start":"2025-11-22T02:43:31.601068Z","end":"2025-11-22T02:43:31.840791Z","steps":["trace[1115065947] 'process raft request' (duration: 239.457179ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.014646Z","caller":"traceutil/trace.go:172","msg":"trace[183583259] linearizableReadLoop","detail":"{readStateIndex:412; appliedIndex:412; }","duration":"106.03359ms","start":"2025-11-22T02:43:31.908587Z","end":"2025-11-22T02:43:32.014620Z","steps":["trace[183583259] 'read index received' (duration: 106.02911ms)","trace[183583259] 'applied index is now lower than readState.Index' (duration: 3.75µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.079031Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"216.474864ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.079129Z","caller":"traceutil/trace.go:172","msg":"trace[270425495] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:398; }","duration":"216.611319ms","start":"2025-11-22T02:43:31.862500Z","end":"2025-11-22T02:43:32.079112Z","steps":["trace[270425495] 'agreement among raft nodes before linearized reading' (duration: 152.20084ms)","trace[270425495] 'range keys from in-memory index tree' (duration: 64.254359ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.079274Z","caller":"traceutil/trace.go:172","msg":"trace[1352216748] transaction","detail":"{read_only:false; response_revision:400; number_of_response:1; }","duration":"231.454954ms","start":"2025-11-22T02:43:31.847806Z","end":"2025-11-22T02:43:32.079261Z","steps":["trace[1352216748] 'process raft request' (duration: 231.23495ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.079303Z","caller":"traceutil/trace.go:172","msg":"trace[561689057] transaction","detail":"{read_only:false; response_revision:399; number_of_response:1; }","duration":"234.593264ms","start":"2025-11-22T02:43:31.844694Z","end":"2025-11-22T02:43:32.079288Z","steps":["trace[561689057] 'process raft request' (duration: 169.966703ms)","trace[561689057] 'compare' (duration: 64.30066ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.230100Z","caller":"traceutil/trace.go:172","msg":"trace[791380359] linearizableReadLoop","detail":"{readStateIndex:414; appliedIndex:414; }","duration":"142.923195ms","start":"2025-11-22T02:43:32.087162Z","end":"2025-11-22T02:43:32.230085Z","steps":["trace[791380359] 'read index received' (duration: 142.918792ms)","trace[791380359] 'applied index is now lower than readState.Index' (duration: 3.725µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.309432Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"222.247177ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.309495Z","caller":"traceutil/trace.go:172","msg":"trace[807621915] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:400; }","duration":"222.321309ms","start":"2025-11-22T02:43:32.087158Z","end":"2025-11-22T02:43:32.309479Z","steps":["trace[807621915] 'agreement among raft nodes before linearized reading' (duration: 142.996602ms)","trace[807621915] 'range keys from in-memory index tree' (duration: 79.227051ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:43:32.309548Z","caller":"traceutil/trace.go:172","msg":"trace[1786513713] transaction","detail":"{read_only:false; response_revision:401; number_of_response:1; }","duration":"224.722266ms","start":"2025-11-22T02:43:32.084804Z","end":"2025-11-22T02:43:32.309526Z","steps":["trace[1786513713] 'process raft request' (duration: 145.356597ms)","trace[1786513713] 'compare' (duration: 79.276474ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:32.597075Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"177.504561ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:43:32.597139Z","caller":"traceutil/trace.go:172","msg":"trace[53850969] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:401; }","duration":"177.576149ms","start":"2025-11-22T02:43:32.419548Z","end":"2025-11-22T02:43:32.597124Z","steps":["trace[53850969] 'range keys from in-memory index tree' (duration: 177.452892ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:43:32.597170Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"157.102292ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/192.168.85.2\" limit:1 ","response":"range_response_count:1 size:131"}
{"level":"info","ts":"2025-11-22T02:43:32.597212Z","caller":"traceutil/trace.go:172","msg":"trace[1335493678] range","detail":"{range_begin:/registry/masterleases/192.168.85.2; range_end:; response_count:1; response_revision:401; }","duration":"157.163364ms","start":"2025-11-22T02:43:32.440039Z","end":"2025-11-22T02:43:32.597202Z","steps":["trace[1335493678] 'range keys from in-memory index tree' (duration: 157.006818ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:43:32.745398Z","caller":"traceutil/trace.go:172","msg":"trace[190339287] transaction","detail":"{read_only:false; response_revision:402; number_of_response:1; }","duration":"145.110807ms","start":"2025-11-22T02:43:32.600275Z","end":"2025-11-22T02:43:32.745385Z","steps":["trace[190339287] 'process raft request' (duration: 129.780301ms)","trace[190339287] 'compare' (duration: 15.255342ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:43:38.012344Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"118.304766ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223109599503 > lease_revoke:<id:06ed9aa971a5a08f>","response":"size:28"}
==> kernel <==
02:44:02 up 1:26, 0 user, load average: 4.34, 1.61, 1.00
Linux pause-537523 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [76c103ade12b509698eaffccc3f0988b159647f29269ecdac110a2749055bd83] <==
I1122 02:43:19.760520 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:43:19.760767 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:43:19.760924 1 main.go:148] setting mtu 1500 for CNI
I1122 02:43:19.760942 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:43:19.760963 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:43:19Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:43:20.055582 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:43:20.055623 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:43:20.055636 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:43:20.055791 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:43:20.355960 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:43:20.355995 1 metrics.go:72] Registering metrics
I1122 02:43:20.356315 1 controller.go:711] "Syncing nftables rules"
I1122 02:43:30.055650 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:30.055704 1 main.go:301] handling current node
I1122 02:43:40.055627 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:40.055659 1 main.go:301] handling current node
I1122 02:43:50.056052 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:43:50.056081 1 main.go:301] handling current node
I1122 02:44:00.055800 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:44:00.055876 1 main.go:301] handling current node
==> kube-apiserver [954fe52a33995ce5f9d3005603e7cafa90189b4f467bd2e51cf53e855528e5d5] <==
I1122 02:43:10.934832 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:43:10.935577 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:43:10.937981 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:43:10.938962 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:10.940210 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:43:10.946312 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:10.946872 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:43:10.957734 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:43:11.835393 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:43:11.839216 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:43:11.839235 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:43:12.298164 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:43:12.329131 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:43:12.442966 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:43:12.448682 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I1122 02:43:12.449494 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:43:12.452821 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:43:12.881384 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:43:13.536108 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:43:13.542709 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:43:13.549138 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:43:18.586950 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:43:18.632740 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1122 02:43:18.792428 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:43:18.798010 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
==> kube-controller-manager [3d518d8a6406763fe5cd27cda57c9fea7eb9a562698a49207e0d421618b1d63b] <==
I1122 02:43:17.880841 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:43:17.880862 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:43:17.880885 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:43:17.880884 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:43:17.880901 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:43:17.880935 1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
I1122 02:43:17.880949 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:43:17.880976 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:43:17.881002 1 shared_informer.go:356] "Caches are synced" controller="ClusterRoleAggregator"
I1122 02:43:17.881144 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:43:17.883225 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:43:17.883297 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:43:17.883340 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:43:17.883357 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:43:17.883364 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:43:17.883583 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:43:17.886492 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:43:17.889086 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="pause-537523" podCIDRs=["10.244.0.0/24"]
I1122 02:43:17.890024 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:43:17.896335 1 shared_informer.go:356] "Caches are synced" controller="disruption"
I1122 02:43:17.903605 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:43:17.915095 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:43:32.831893 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
I1122 02:43:47.834675 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:43:57.836431 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [8ee826891fe8b79af6bfb216b0dba69e53b2ee76600d440ca6607a190a1d4443] <==
I1122 02:43:19.647213 1 server_linux.go:53] "Using iptables proxy"
I1122 02:43:19.707618 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:43:19.808713 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:43:19.808748 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.85.2"]
E1122 02:43:19.808860 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:43:19.831393 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:43:19.831434 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:43:19.836944 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:43:19.837318 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:43:19.837344 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:43:19.838750 1 config.go:200] "Starting service config controller"
I1122 02:43:19.838775 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:43:19.838783 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:43:19.838805 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:43:19.838861 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:43:19.838892 1 config.go:309] "Starting node config controller"
I1122 02:43:19.838917 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:43:19.838926 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:43:19.839301 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:43:19.938966 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:43:19.939061 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:43:19.939766 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [f9b1fa7dcad6239a0fac31b3bdb522d58ba99264cff8f85e4de823cfb48dc522] <==
E1122 02:43:10.897930 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:43:10.897930 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:43:10.897968 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:43:10.897974 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:43:10.898040 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:43:10.898051 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:43:10.898345 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:43:10.898447 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:43:10.898520 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:43:10.899028 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:43:10.898382 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:43:10.899412 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:43:11.738983 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:43:11.769852 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:43:11.781732 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:43:11.800108 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:43:11.838243 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:43:11.858279 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:43:11.957210 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:43:12.006427 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:43:12.059513 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:43:12.077597 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:43:12.115031 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:43:12.137140 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
I1122 02:43:13.894395 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:43:37 pause-537523 kubelet[1299]: E1122 02:43:37.446513 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:37 pause-537523 kubelet[1299]: E1122 02:43:37.446530 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: W1122 02:43:38.159747 1299 logging.go:55] [core] [Channel #1 SubChannel #2]grpc: addrConn.createTransport failed to connect to {Addr: "/var/run/crio/crio.sock", ServerName: "localhost", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.401172 1299 log.go:32] "Status from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.401217 1299 kubelet.go:2996] "Container runtime sanity check failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446793 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446830 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:38 pause-537523 kubelet[1299]: E1122 02:43:38.446843 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: W1122 02:43:39.098267 1299 logging.go:55] [core] [Channel #1 SubChannel #2]grpc: addrConn.createTransport failed to connect to {Addr: "/var/run/crio/crio.sock", ServerName: "localhost", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389860 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="state:{}"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389958 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.389996 1299 kubelet_pods.go:1266] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.390009 1299 kubelet.go:2613] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447610 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447685 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:39 pause-537523 kubelet[1299]: E1122 02:43:39.447703 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448021 1299 log.go:32] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\"" filter="<nil>"
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448066 1299 kuberuntime_sandbox.go:297] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:40 pause-537523 kubelet[1299]: E1122 02:43:40.448076 1299 generic.go:254] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory\""
Nov 22 02:43:43 pause-537523 kubelet[1299]: E1122 02:43:43.402053 1299 kubelet.go:3011] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: plugin status uninitialized"
Nov 22 02:43:44 pause-537523 kubelet[1299]: I1122 02:43:44.208166 1299 setters.go:543] "Node became not ready" node="pause-537523" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2025-11-22T02:43:44Z","lastTransitionTime":"2025-11-22T02:43:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: plugin status uninitialized"}
Nov 22 02:43:57 pause-537523 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:43:57 pause-537523 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:43:57 pause-537523 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:43:57 pause-537523 systemd[1]: kubelet.service: Consumed 1.432s CPU time.
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-537523 -n pause-537523
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-537523 -n pause-537523: exit status 2 (335.83109ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context pause-537523 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestPause/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestPause/serial/Pause (6.25s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-169878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-169878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 11 (253.608066ms)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:49:54Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:205: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-169878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 11
start_stop_delete_test.go:213: (dbg) Run: kubectl --context old-k8s-version-169878 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:213: (dbg) Non-zero exit: kubectl --context old-k8s-version-169878 describe deploy/metrics-server -n kube-system: exit status 1 (74.84797ms)
** stderr **
Error from server (NotFound): deployments.apps "metrics-server" not found
** /stderr **
start_stop_delete_test.go:215: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-169878 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:219: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect old-k8s-version-169878
helpers_test.go:243: (dbg) docker inspect old-k8s-version-169878:
-- stdout --
[
{
"Id": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"Created": "2025-11-22T02:49:00.053065108Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 286068,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:49:00.089644443Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hostname",
"HostsPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hosts",
"LogPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf-json.log",
"Name": "/old-k8s-version-169878",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-169878:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "old-k8s-version-169878",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"LowerDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/merged",
"UpperDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/diff",
"WorkDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-169878",
"Source": "/var/lib/docker/volumes/old-k8s-version-169878/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-169878",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-169878",
"name.minikube.sigs.k8s.io": "old-k8s-version-169878",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "fa3cef3556e7f363de7b8a3b8d4c69749b9ff577762951a154808987becc1f20",
"SandboxKey": "/var/run/docker/netns/fa3cef3556e7",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33088"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33089"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33092"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33090"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33091"
}
]
},
"Networks": {
"old-k8s-version-169878": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "37299b5114cb0b65275d517d846c220687c34d27de79f0f10d855139d763153d",
"EndpointID": "7f642815aa6e9127708852922343c74c62d452ddcebb8cbae8c183d02de4f2c5",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "36:94:b5:0c:26:36",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-169878",
"44c48c4768af"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878
I1122 02:49:54.870882 15072 config.go:182] Loaded profile config "bridge-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
helpers_test.go:252: <<< TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25: (1.425330884s)
helpers_test.go:260: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive logs:
-- stdout --
==> Audit <==
┌─────────┬─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p enable-default-cni-430524 sudo cat /etc/kubernetes/kubelet.conf │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cat /var/lib/kubelet/config.yaml │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo systemctl status docker --all --full --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo systemctl cat docker --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cat /etc/docker/daemon.json │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo docker system info │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo systemctl status cri-docker --all --full --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo systemctl cat cri-docker --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cri-dockerd --version │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo systemctl status containerd --all --full --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p enable-default-cni-430524 sudo systemctl cat containerd --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cat /lib/systemd/system/containerd.service │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo cat /etc/containerd/config.toml │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo containerd config dump │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo systemctl status crio --all --full --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo systemctl cat crio --no-pager │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p flannel-430524 pgrep -a kubelet │ flannel-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ ssh │ -p enable-default-cni-430524 sudo crio config │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ delete │ -p enable-default-cni-430524 │ enable-default-cni-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ addons │ enable metrics-server -p old-k8s-version-169878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ │
│ ssh │ -p bridge-430524 pgrep -a kubelet │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:49 UTC │ 22 Nov 25 02:49 UTC │
└─────────┴─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:49:43
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:49:43.819563 296853 out.go:360] Setting OutFile to fd 1 ...
I1122 02:49:43.819653 296853 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:49:43.819658 296853 out.go:374] Setting ErrFile to fd 2...
I1122 02:49:43.819662 296853 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:49:43.819876 296853 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:49:43.820347 296853 out.go:368] Setting JSON to false
I1122 02:49:43.821641 296853 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5527,"bootTime":1763774257,"procs":329,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:49:43.821695 296853 start.go:143] virtualization: kvm guest
I1122 02:49:43.823258 296853 out.go:179] * [no-preload-346270] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:49:43.824962 296853 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:49:43.824953 296853 notify.go:221] Checking for updates...
I1122 02:49:43.826052 296853 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:49:43.827160 296853 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:49:43.828447 296853 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:49:43.829525 296853 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:49:43.830892 296853 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:49:43.832795 296853 config.go:182] Loaded profile config "bridge-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:49:43.832944 296853 config.go:182] Loaded profile config "flannel-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:49:43.833091 296853 config.go:182] Loaded profile config "old-k8s-version-169878": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:49:43.833210 296853 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:49:43.858627 296853 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:49:43.858709 296853 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:49:43.917002 296853 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:49:43.906516749 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:49:43.917129 296853 docker.go:319] overlay module found
I1122 02:49:43.918529 296853 out.go:179] * Using the docker driver based on user configuration
I1122 02:49:43.919453 296853 start.go:309] selected driver: docker
I1122 02:49:43.919468 296853 start.go:927] validating driver "docker" against <nil>
I1122 02:49:43.919480 296853 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:49:43.920110 296853 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:49:43.973432 296853 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:49:43.964182016 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:49:43.973580 296853 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 02:49:43.973769 296853 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:49:43.975183 296853 out.go:179] * Using Docker driver with root privileges
I1122 02:49:43.976211 296853 cni.go:84] Creating CNI manager for ""
I1122 02:49:43.976276 296853 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:49:43.976287 296853 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 02:49:43.976370 296853 start.go:353] cluster config:
{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID
:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:49:43.977543 296853 out.go:179] * Starting "no-preload-346270" primary control-plane node in "no-preload-346270" cluster
I1122 02:49:43.978533 296853 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:49:43.979578 296853 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:49:43.980497 296853 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:49:43.980586 296853 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:49:43.980610 296853 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:49:43.980635 296853 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json: {Name:mke7aca29a55b93dc11873617fc0839feedd1704 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:49:43.980805 296853 cache.go:107] acquiring lock: {Name:mk4d199bf40a6d6ba931e5e3bad6703ee1d4331a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.980806 296853 cache.go:107] acquiring lock: {Name:mk9fd95b82b8a0ed47b4c79f858a382e519ed06e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.980807 296853 cache.go:107] acquiring lock: {Name:mk650b39e13f205b236b21e6fa6a8094ff95570c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.980898 296853 cache.go:107] acquiring lock: {Name:mk3054179b69a4ecffba6a1633407784706f4e81 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.980958 296853 cache.go:107] acquiring lock: {Name:mkc2dd19224be48dd2b652c2ba743eee0462ec74 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.981004 296853 image.go:138] retrieving image: registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:43.980999 296853 cache.go:107] acquiring lock: {Name:mk4196ba38e7d41483a23902afbddf94052a6ebe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.980964 296853 cache.go:107] acquiring lock: {Name:mk9d6260ac85fdcae594a014de4c63c0ef47e012 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.981036 296853 image.go:138] retrieving image: registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:43.981050 296853 image.go:138] retrieving image: registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:43.981073 296853 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1122 02:49:43.981058 296853 cache.go:107] acquiring lock: {Name:mk4e022e496bff3a4a0a326b942b57b39fa644a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:43.981100 296853 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 298.534µs
I1122 02:49:43.981114 296853 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1122 02:49:43.981126 296853 image.go:138] retrieving image: registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:43.981128 296853 image.go:138] retrieving image: registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:43.981328 296853 image.go:138] retrieving image: registry.k8s.io/pause:3.10.1
I1122 02:49:43.981275 296853 image.go:138] retrieving image: registry.k8s.io/etcd:3.6.4-0
I1122 02:49:43.982075 296853 image.go:181] daemon lookup for registry.k8s.io/kube-controller-manager:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:43.982073 296853 image.go:181] daemon lookup for registry.k8s.io/kube-apiserver:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:43.982311 296853 image.go:181] daemon lookup for registry.k8s.io/kube-proxy:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:43.982329 296853 image.go:181] daemon lookup for registry.k8s.io/pause:3.10.1: Error response from daemon: No such image: registry.k8s.io/pause:3.10.1
I1122 02:49:43.982405 296853 image.go:181] daemon lookup for registry.k8s.io/etcd:3.6.4-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.6.4-0
I1122 02:49:43.982311 296853 image.go:181] daemon lookup for registry.k8s.io/coredns/coredns:v1.12.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:43.982484 296853 image.go:181] daemon lookup for registry.k8s.io/kube-scheduler:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:44.002578 296853 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:49:44.002601 296853 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:49:44.002617 296853 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:49:44.002634 296853 start.go:360] acquireMachinesLock for no-preload-346270: {Name:mkdc74b684c3fde528391b5ed567e203df475597 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:49:44.002738 296853 start.go:364] duration metric: took 88.135µs to acquireMachinesLock for "no-preload-346270"
I1122 02:49:44.002762 296853 start.go:93] Provisioning new machine with config: &{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwa
rePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:49:44.002844 296853 start.go:125] createHost starting for "" (driver="docker")
W1122 02:49:41.068764 284859 node_ready.go:57] node "old-k8s-version-169878" has "Ready":"False" status (will retry)
I1122 02:49:43.067758 284859 node_ready.go:49] node "old-k8s-version-169878" is "Ready"
I1122 02:49:43.067785 284859 node_ready.go:38] duration metric: took 13.503224693s for node "old-k8s-version-169878" to be "Ready" ...
I1122 02:49:43.067799 284859 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:49:43.067846 284859 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:49:43.079921 284859 api_server.go:72] duration metric: took 13.840036198s to wait for apiserver process to appear ...
I1122 02:49:43.079946 284859 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:49:43.079963 284859 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:49:43.085065 284859 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:49:43.086212 284859 api_server.go:141] control plane version: v1.28.0
I1122 02:49:43.086235 284859 api_server.go:131] duration metric: took 6.282887ms to wait for apiserver health ...
I1122 02:49:43.086243 284859 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:49:43.089755 284859 system_pods.go:59] 8 kube-system pods found
I1122 02:49:43.089785 284859 system_pods.go:61] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:49:43.089795 284859 system_pods.go:61] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running
I1122 02:49:43.089808 284859 system_pods.go:61] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running
I1122 02:49:43.089814 284859 system_pods.go:61] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running
I1122 02:49:43.089820 284859 system_pods.go:61] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running
I1122 02:49:43.089824 284859 system_pods.go:61] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running
I1122 02:49:43.089828 284859 system_pods.go:61] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running
I1122 02:49:43.089832 284859 system_pods.go:61] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:49:43.089838 284859 system_pods.go:74] duration metric: took 3.590828ms to wait for pod list to return data ...
I1122 02:49:43.089846 284859 default_sa.go:34] waiting for default service account to be created ...
I1122 02:49:43.091640 284859 default_sa.go:45] found service account: "default"
I1122 02:49:43.091660 284859 default_sa.go:55] duration metric: took 1.807371ms for default service account to be created ...
I1122 02:49:43.091669 284859 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:49:43.094736 284859 system_pods.go:86] 8 kube-system pods found
I1122 02:49:43.094762 284859 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:49:43.094768 284859 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running
I1122 02:49:43.094776 284859 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running
I1122 02:49:43.094781 284859 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running
I1122 02:49:43.094788 284859 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running
I1122 02:49:43.094797 284859 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running
I1122 02:49:43.094802 284859 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running
I1122 02:49:43.094809 284859 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:49:43.094841 284859 retry.go:31] will retry after 296.281628ms: missing components: kube-dns
I1122 02:49:43.395338 284859 system_pods.go:86] 8 kube-system pods found
I1122 02:49:43.395376 284859 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:49:43.395384 284859 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running
I1122 02:49:43.395393 284859 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running
I1122 02:49:43.395398 284859 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running
I1122 02:49:43.395404 284859 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running
I1122 02:49:43.395409 284859 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running
I1122 02:49:43.395414 284859 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running
I1122 02:49:43.395433 284859 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:49:43.395455 284859 retry.go:31] will retry after 348.880492ms: missing components: kube-dns
I1122 02:49:43.748339 284859 system_pods.go:86] 8 kube-system pods found
I1122 02:49:43.748368 284859 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:49:43.748375 284859 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running
I1122 02:49:43.748383 284859 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running
I1122 02:49:43.748392 284859 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running
I1122 02:49:43.748401 284859 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running
I1122 02:49:43.748409 284859 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running
I1122 02:49:43.748417 284859 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running
I1122 02:49:43.748431 284859 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:49:43.748451 284859 retry.go:31] will retry after 486.680521ms: missing components: kube-dns
I1122 02:49:44.239665 284859 system_pods.go:86] 8 kube-system pods found
I1122 02:49:44.239714 284859 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Running
I1122 02:49:44.239722 284859 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running
I1122 02:49:44.239725 284859 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running
I1122 02:49:44.239729 284859 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running
I1122 02:49:44.239732 284859 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running
I1122 02:49:44.239735 284859 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running
I1122 02:49:44.239739 284859 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running
I1122 02:49:44.239742 284859 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Running
I1122 02:49:44.239752 284859 system_pods.go:126] duration metric: took 1.14807702s to wait for k8s-apps to be running ...
I1122 02:49:44.239759 284859 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:49:44.239802 284859 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:49:44.253860 284859 system_svc.go:56] duration metric: took 14.090681ms WaitForService to wait for kubelet
I1122 02:49:44.253887 284859 kubeadm.go:587] duration metric: took 15.014017546s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:49:44.253922 284859 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:49:44.258996 284859 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:49:44.259026 284859 node_conditions.go:123] node cpu capacity is 8
I1122 02:49:44.259042 284859 node_conditions.go:105] duration metric: took 5.11364ms to run NodePressure ...
I1122 02:49:44.259057 284859 start.go:242] waiting for startup goroutines ...
I1122 02:49:44.259071 284859 start.go:247] waiting for cluster config update ...
I1122 02:49:44.259085 284859 start.go:256] writing updated cluster config ...
I1122 02:49:44.259347 284859 ssh_runner.go:195] Run: rm -f paused
I1122 02:49:44.263160 284859 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:49:44.266778 284859 pod_ready.go:83] waiting for pod "coredns-5dd5756b68-fkcs9" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.271990 284859 pod_ready.go:94] pod "coredns-5dd5756b68-fkcs9" is "Ready"
I1122 02:49:44.272011 284859 pod_ready.go:86] duration metric: took 5.214379ms for pod "coredns-5dd5756b68-fkcs9" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.275092 284859 pod_ready.go:83] waiting for pod "etcd-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.278808 284859 pod_ready.go:94] pod "etcd-old-k8s-version-169878" is "Ready"
I1122 02:49:44.278828 284859 pod_ready.go:86] duration metric: took 3.689404ms for pod "etcd-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.281651 284859 pod_ready.go:83] waiting for pod "kube-apiserver-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.285641 284859 pod_ready.go:94] pod "kube-apiserver-old-k8s-version-169878" is "Ready"
I1122 02:49:44.285663 284859 pod_ready.go:86] duration metric: took 3.991386ms for pod "kube-apiserver-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.287868 284859 pod_ready.go:83] waiting for pod "kube-controller-manager-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.667370 284859 pod_ready.go:94] pod "kube-controller-manager-old-k8s-version-169878" is "Ready"
I1122 02:49:44.667393 284859 pod_ready.go:86] duration metric: took 379.506541ms for pod "kube-controller-manager-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:44.868602 284859 pod_ready.go:83] waiting for pod "kube-proxy-c7nnb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:45.267876 284859 pod_ready.go:94] pod "kube-proxy-c7nnb" is "Ready"
I1122 02:49:45.267945 284859 pod_ready.go:86] duration metric: took 399.307904ms for pod "kube-proxy-c7nnb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:45.469019 284859 pod_ready.go:83] waiting for pod "kube-scheduler-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:45.867611 284859 pod_ready.go:94] pod "kube-scheduler-old-k8s-version-169878" is "Ready"
I1122 02:49:45.867640 284859 pod_ready.go:86] duration metric: took 398.592252ms for pod "kube-scheduler-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:45.867656 284859 pod_ready.go:40] duration metric: took 1.604465561s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:49:45.926565 284859 start.go:625] kubectl: 1.34.2, cluster: 1.28.0 (minor skew: 6)
I1122 02:49:45.929134 284859 out.go:203]
W1122 02:49:45.930465 284859 out.go:285] ! /usr/local/bin/kubectl is version 1.34.2, which may have incompatibilities with Kubernetes 1.28.0.
I1122 02:49:45.931594 284859 out.go:179] - Want kubectl v1.28.0? Try 'minikube kubectl -- get pods -A'
I1122 02:49:45.933115 284859 out.go:179] * Done! kubectl is now configured to use "old-k8s-version-169878" cluster and "default" namespace by default
W1122 02:49:42.866917 280090 pod_ready.go:104] pod "coredns-66bc5c9577-fbj99" is not "Ready", error: <nil>
W1122 02:49:44.867536 280090 pod_ready.go:104] pod "coredns-66bc5c9577-fbj99" is not "Ready", error: <nil>
W1122 02:49:47.366642 280090 pod_ready.go:104] pod "coredns-66bc5c9577-fbj99" is not "Ready", error: <nil>
I1122 02:49:44.004798 296853 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1122 02:49:44.005076 296853 start.go:159] libmachine.API.Create for "no-preload-346270" (driver="docker")
I1122 02:49:44.005111 296853 client.go:173] LocalClient.Create starting
I1122 02:49:44.005183 296853 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 02:49:44.005224 296853 main.go:143] libmachine: Decoding PEM data...
I1122 02:49:44.005246 296853 main.go:143] libmachine: Parsing certificate...
I1122 02:49:44.005315 296853 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 02:49:44.005355 296853 main.go:143] libmachine: Decoding PEM data...
I1122 02:49:44.005373 296853 main.go:143] libmachine: Parsing certificate...
I1122 02:49:44.005770 296853 cli_runner.go:164] Run: docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:49:44.020914 296853 cli_runner.go:211] docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:49:44.020976 296853 network_create.go:284] running [docker network inspect no-preload-346270] to gather additional debugging logs...
I1122 02:49:44.020997 296853 cli_runner.go:164] Run: docker network inspect no-preload-346270
W1122 02:49:44.036742 296853 cli_runner.go:211] docker network inspect no-preload-346270 returned with exit code 1
I1122 02:49:44.036761 296853 network_create.go:287] error running [docker network inspect no-preload-346270]: docker network inspect no-preload-346270: exit status 1
stdout:
[]
stderr:
Error response from daemon: network no-preload-346270 not found
I1122 02:49:44.036769 296853 network_create.go:289] output of [docker network inspect no-preload-346270]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network no-preload-346270 not found
** /stderr **
I1122 02:49:44.036839 296853 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:49:44.056233 296853 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:49:44.057496 296853 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9423c3ade39b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:8e:36:bc:4b:d9:05} reservation:<nil>}
I1122 02:49:44.058231 296853 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-49270bd849d0 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:2a:04:6a:68:04:12} reservation:<nil>}
I1122 02:49:44.058698 296853 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-fd0f48662406 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:4e:8d:59:2b:61:0e} reservation:<nil>}
I1122 02:49:44.059229 296853 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-37299b5114cb IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:76:db:27:16:0e:a6} reservation:<nil>}
I1122 02:49:44.059636 296853 network.go:211] skipping subnet 192.168.94.0/24 that is taken: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName:br-ccefa24bddb4 IfaceIPv4:192.168.94.1 IfaceMTU:1500 IfaceMAC:02:12:1e:68:93:88} reservation:<nil>}
I1122 02:49:44.060319 296853 network.go:206] using free private subnet 192.168.103.0/24: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001606510}
I1122 02:49:44.060346 296853 network_create.go:124] attempt to create docker network no-preload-346270 192.168.103.0/24 with gateway 192.168.103.1 and MTU of 1500 ...
I1122 02:49:44.060382 296853 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.103.0/24 --gateway=192.168.103.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=no-preload-346270 no-preload-346270
I1122 02:49:44.106674 296853 network_create.go:108] docker network no-preload-346270 192.168.103.0/24 created
I1122 02:49:44.106700 296853 kic.go:121] calculated static IP "192.168.103.2" for the "no-preload-346270" container
I1122 02:49:44.106746 296853 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 02:49:44.124475 296853 cli_runner.go:164] Run: docker volume create no-preload-346270 --label name.minikube.sigs.k8s.io=no-preload-346270 --label created_by.minikube.sigs.k8s.io=true
I1122 02:49:44.143241 296853 oci.go:103] Successfully created a docker volume no-preload-346270
I1122 02:49:44.143300 296853 cli_runner.go:164] Run: docker run --rm --name no-preload-346270-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=no-preload-346270 --entrypoint /usr/bin/test -v no-preload-346270:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 02:49:44.197100 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1
I1122 02:49:44.201805 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1
I1122 02:49:44.215705 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0
I1122 02:49:44.217356 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1
I1122 02:49:44.227282 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1
I1122 02:49:44.234273 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1
I1122 02:49:44.333369 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 exists
I1122 02:49:44.333400 296853 cache.go:96] cache image "registry.k8s.io/pause:3.10.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1" took 352.382952ms
I1122 02:49:44.333418 296853 cache.go:80] save to tar file registry.k8s.io/pause:3.10.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 succeeded
I1122 02:49:44.349448 296853 cache.go:162] opening: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1
I1122 02:49:44.585482 296853 oci.go:107] Successfully prepared a docker volume no-preload-346270
I1122 02:49:44.585524 296853 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
W1122 02:49:44.585598 296853 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:49:44.585629 296853 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:49:44.585673 296853 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:49:44.641270 296853 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname no-preload-346270 --name no-preload-346270 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=no-preload-346270 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=no-preload-346270 --network no-preload-346270 --ip 192.168.103.2 --volume no-preload-346270:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
I1122 02:49:44.687418 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 exists
I1122 02:49:44.687457 296853 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1" took 706.655897ms
I1122 02:49:44.687473 296853 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 succeeded
I1122 02:49:44.943783 296853 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Running}}
I1122 02:49:44.962961 296853 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:49:44.980592 296853 cli_runner.go:164] Run: docker exec no-preload-346270 stat /var/lib/dpkg/alternatives/iptables
I1122 02:49:45.029151 296853 oci.go:144] the created container "no-preload-346270" has a running status.
I1122 02:49:45.029181 296853 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa...
I1122 02:49:45.659046 296853 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:49:45.688313 296853 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:49:45.711722 296853 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:49:45.711746 296853 kic_runner.go:114] Args: [docker exec --privileged no-preload-346270 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:49:45.769891 296853 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:49:45.794866 296853 machine.go:94] provisionDockerMachine start ...
I1122 02:49:45.794992 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:45.818264 296853 main.go:143] libmachine: Using SSH client type: native
I1122 02:49:45.818578 296853 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I1122 02:49:45.818602 296853 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:49:45.865677 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 exists
I1122 02:49:45.865713 296853 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1" took 1.884826929s
I1122 02:49:45.865758 296853 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 succeeded
I1122 02:49:45.885996 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 exists
I1122 02:49:45.886031 296853 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.12.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1" took 1.905036779s
I1122 02:49:45.886047 296853 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.12.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 succeeded
I1122 02:49:45.917481 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 exists
I1122 02:49:45.917513 296853 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1" took 1.936721095s
I1122 02:49:45.917528 296853 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 succeeded
I1122 02:49:45.964138 296853 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:49:45.964189 296853 ubuntu.go:182] provisioning hostname "no-preload-346270"
I1122 02:49:45.964255 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:45.987590 296853 main.go:143] libmachine: Using SSH client type: native
I1122 02:49:45.987934 296853 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I1122 02:49:45.987964 296853 main.go:143] libmachine: About to run SSH command:
sudo hostname no-preload-346270 && echo "no-preload-346270" | sudo tee /etc/hostname
I1122 02:49:46.028175 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 exists
I1122 02:49:46.028204 296853 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1" took 2.047366562s
I1122 02:49:46.028216 296853 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 succeeded
I1122 02:49:46.140859 296853 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:49:46.140994 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:46.162873 296853 main.go:143] libmachine: Using SSH client type: native
I1122 02:49:46.163102 296853 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I1122 02:49:46.163122 296853 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-346270' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-346270/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-346270' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:49:46.295019 296853 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:49:46.295052 296853 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:49:46.295072 296853 ubuntu.go:190] setting up certificates
I1122 02:49:46.295084 296853 provision.go:84] configureAuth start
I1122 02:49:46.295144 296853 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:49:46.312820 296853 provision.go:143] copyHostCerts
I1122 02:49:46.312882 296853 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:49:46.312896 296853 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:49:46.312995 296853 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:49:46.313155 296853 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:49:46.313169 296853 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:49:46.313215 296853 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:49:46.313301 296853 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:49:46.313311 296853 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:49:46.313349 296853 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:49:46.313420 296853 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.no-preload-346270 san=[127.0.0.1 192.168.103.2 localhost minikube no-preload-346270]
I1122 02:49:46.459406 296853 provision.go:177] copyRemoteCerts
I1122 02:49:46.459462 296853 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:49:46.459503 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:46.478377 296853 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:49:46.482155 296853 cache.go:157] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 exists
I1122 02:49:46.482176 296853 cache.go:96] cache image "registry.k8s.io/etcd:3.6.4-0" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0" took 2.501278718s
I1122 02:49:46.482189 296853 cache.go:80] save to tar file registry.k8s.io/etcd:3.6.4-0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 succeeded
I1122 02:49:46.482205 296853 cache.go:87] Successfully saved all images to host disk.
I1122 02:49:46.572256 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:49:46.591489 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:49:46.608339 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:49:46.625532 296853 provision.go:87] duration metric: took 330.434394ms to configureAuth
I1122 02:49:46.625555 296853 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:49:46.625704 296853 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:49:46.625825 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:46.643115 296853 main.go:143] libmachine: Using SSH client type: native
I1122 02:49:46.643312 296853 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I1122 02:49:46.643328 296853 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:49:46.928655 296853 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:49:46.928692 296853 machine.go:97] duration metric: took 1.133799676s to provisionDockerMachine
I1122 02:49:46.928702 296853 client.go:176] duration metric: took 2.923582153s to LocalClient.Create
I1122 02:49:46.928724 296853 start.go:167] duration metric: took 2.923648324s to libmachine.API.Create "no-preload-346270"
I1122 02:49:46.928733 296853 start.go:293] postStartSetup for "no-preload-346270" (driver="docker")
I1122 02:49:46.928745 296853 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:49:46.928812 296853 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:49:46.928865 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:46.946777 296853 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:49:47.042440 296853 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:49:47.046054 296853 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:49:47.046083 296853 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:49:47.046095 296853 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:49:47.046150 296853 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:49:47.046221 296853 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:49:47.046303 296853 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:49:47.054195 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:49:47.075442 296853 start.go:296] duration metric: took 146.695362ms for postStartSetup
I1122 02:49:47.075846 296853 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:49:47.097495 296853 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:49:47.097873 296853 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:49:47.097939 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:47.117289 296853 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:49:47.209825 296853 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:49:47.214342 296853 start.go:128] duration metric: took 3.211484259s to createHost
I1122 02:49:47.214369 296853 start.go:83] releasing machines lock for "no-preload-346270", held for 3.21161405s
I1122 02:49:47.214434 296853 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:49:47.231872 296853 ssh_runner.go:195] Run: cat /version.json
I1122 02:49:47.231934 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:47.231957 296853 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:49:47.232027 296853 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:49:47.249874 296853 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:49:47.250217 296853 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:49:47.341738 296853 ssh_runner.go:195] Run: systemctl --version
I1122 02:49:47.399210 296853 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:49:47.431189 296853 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:49:47.435681 296853 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:49:47.435733 296853 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:49:47.460274 296853 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 02:49:47.460301 296853 start.go:496] detecting cgroup driver to use...
I1122 02:49:47.460328 296853 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:49:47.460361 296853 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:49:47.475646 296853 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:49:47.487097 296853 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:49:47.487138 296853 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:49:47.502887 296853 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:49:47.518955 296853 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:49:47.599137 296853 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:49:47.684023 296853 docker.go:234] disabling docker service ...
I1122 02:49:47.684083 296853 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:49:47.701714 296853 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:49:47.713376 296853 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:49:47.793089 296853 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:49:47.874976 296853 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:49:47.887419 296853 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:49:47.901484 296853 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:49:47.901539 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.911276 296853 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:49:47.911332 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.919744 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.927951 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.935856 296853 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:49:47.943246 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.951105 296853 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.963527 296853 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:49:47.971515 296853 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:49:47.978340 296853 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:49:47.985130 296853 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:49:48.061706 296853 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:49:48.552630 296853 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:49:48.552706 296853 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:49:48.556513 296853 start.go:564] Will wait 60s for crictl version
I1122 02:49:48.556572 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.560331 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:49:48.583419 296853 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:49:48.583498 296853 ssh_runner.go:195] Run: crio --version
I1122 02:49:48.609569 296853 ssh_runner.go:195] Run: crio --version
I1122 02:49:48.637816 296853 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:49:48.638655 296853 cli_runner.go:164] Run: docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:49:48.656181 296853 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:49:48.660215 296853 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:49:48.670002 296853 kubeadm.go:884] updating cluster {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath
: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:49:48.670104 296853 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:49:48.670143 296853 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:49:48.693682 296853 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.34.1". assuming images are not preloaded.
I1122 02:49:48.693709 296853 cache_images.go:90] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.34.1 registry.k8s.io/kube-controller-manager:v1.34.1 registry.k8s.io/kube-scheduler:v1.34.1 registry.k8s.io/kube-proxy:v1.34.1 registry.k8s.io/pause:3.10.1 registry.k8s.io/etcd:3.6.4-0 registry.k8s.io/coredns/coredns:v1.12.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I1122 02:49:48.693769 296853 image.go:138] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:48.693773 296853 image.go:138] retrieving image: registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:48.693793 296853 image.go:138] retrieving image: registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.693812 296853 image.go:138] retrieving image: registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:48.693808 296853 image.go:138] retrieving image: registry.k8s.io/pause:3.10.1
I1122 02:49:48.693837 296853 image.go:138] retrieving image: registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.693854 296853 image.go:138] retrieving image: registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.693950 296853 image.go:138] retrieving image: registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.695026 296853 image.go:181] daemon lookup for registry.k8s.io/kube-controller-manager:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.695055 296853 image.go:181] daemon lookup for registry.k8s.io/coredns/coredns:v1.12.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.695043 296853 image.go:181] daemon lookup for registry.k8s.io/etcd:3.6.4-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.695044 296853 image.go:181] daemon lookup for registry.k8s.io/kube-apiserver:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:48.695102 296853 image.go:181] daemon lookup for registry.k8s.io/kube-scheduler:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.695125 296853 image.go:181] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:48.695275 296853 image.go:181] daemon lookup for registry.k8s.io/kube-proxy:v1.34.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:48.695300 296853 image.go:181] daemon lookup for registry.k8s.io/pause:3.10.1: Error response from daemon: No such image: registry.k8s.io/pause:3.10.1
W1122 02:49:49.370070 280090 pod_ready.go:104] pod "coredns-66bc5c9577-fbj99" is not "Ready", error: <nil>
W1122 02:49:51.866548 280090 pod_ready.go:104] pod "coredns-66bc5c9577-fbj99" is not "Ready", error: <nil>
I1122 02:49:48.870236 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.885200 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.885779 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.888964 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.897064 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:48.901978 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:48.908314 296853 cache_images.go:118] "registry.k8s.io/etcd:3.6.4-0" needs transfer: "registry.k8s.io/etcd:3.6.4-0" does not exist at hash "5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115" in container runtime
I1122 02:49:48.908358 296853 cri.go:218] Removing image: registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.908397 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.911608 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.10.1
I1122 02:49:48.929838 296853 cache_images.go:118] "registry.k8s.io/kube-controller-manager:v1.34.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.34.1" does not exist at hash "c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f" in container runtime
I1122 02:49:48.929884 296853 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.929957 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.929956 296853 cache_images.go:118] "registry.k8s.io/coredns/coredns:v1.12.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.12.1" does not exist at hash "52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969" in container runtime
I1122 02:49:48.930048 296853 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.930105 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.933838 296853 cache_images.go:118] "registry.k8s.io/kube-scheduler:v1.34.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.34.1" does not exist at hash "7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813" in container runtime
I1122 02:49:48.933878 296853 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.933968 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.939789 296853 cache_images.go:118] "registry.k8s.io/kube-apiserver:v1.34.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.34.1" does not exist at hash "c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97" in container runtime
I1122 02:49:48.939827 296853 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:48.939866 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.944255 296853 cache_images.go:118] "registry.k8s.io/kube-proxy:v1.34.1" needs transfer: "registry.k8s.io/kube-proxy:v1.34.1" does not exist at hash "fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7" in container runtime
I1122 02:49:48.944288 296853 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:48.944306 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.944329 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.952354 296853 cache_images.go:118] "registry.k8s.io/pause:3.10.1" needs transfer: "registry.k8s.io/pause:3.10.1" does not exist at hash "cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f" in container runtime
I1122 02:49:48.952369 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.952390 296853 cri.go:218] Removing image: registry.k8s.io/pause:3.10.1
I1122 02:49:48.952428 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.952455 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:48.952479 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.952533 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:48.975361 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/etcd:3.6.4-0
I1122 02:49:48.975390 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:48.986491 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:48.986556 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:48.986596 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/pause:3.10.1
I1122 02:49:48.986634 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:48.986658 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:49.012519 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/etcd:3.6.4-0
I1122 02:49:49.012539 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:49.026249 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.12.1
I1122 02:49:49.026268 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.34.1
I1122 02:49:49.026282 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.34.1
I1122 02:49:49.026355 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/pause:3.10.1
I1122 02:49:49.026416 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.34.1
I1122 02:49:49.052145 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/kube-proxy:v1.34.1
I1122 02:49:49.052164 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0
I1122 02:49:49.052242 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/etcd_3.6.4-0
I1122 02:49:49.061077 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1
I1122 02:49:49.061167 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.12.1
I1122 02:49:49.068019 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1
I1122 02:49:49.068061 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi registry.k8s.io/pause:3.10.1
I1122 02:49:49.068086 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1
I1122 02:49:49.068103 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-apiserver_v1.34.1
I1122 02:49:49.068021 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1
I1122 02:49:49.068145 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-scheduler_v1.34.1
I1122 02:49:49.068212 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-controller-manager_v1.34.1
I1122 02:49:49.081936 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.6.4-0: stat -c "%s %y" /var/lib/minikube/images/etcd_3.6.4-0: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/etcd_3.6.4-0': No such file or directory
I1122 02:49:49.081957 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.12.1: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.12.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/coredns_v1.12.1': No such file or directory
I1122 02:49:49.081971 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 --> /var/lib/minikube/images/etcd_3.6.4-0 (74320896 bytes)
I1122 02:49:49.081987 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 --> /var/lib/minikube/images/coredns_v1.12.1 (22394368 bytes)
I1122 02:49:49.081943 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1
I1122 02:49:49.082088 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-proxy_v1.34.1
I1122 02:49:49.082207 296853 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:49.108672 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1
I1122 02:49:49.108790 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.10.1
I1122 02:49:49.108825 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.34.1: stat -c "%s %y" /var/lib/minikube/images/kube-scheduler_v1.34.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-scheduler_v1.34.1': No such file or directory
I1122 02:49:49.108843 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 --> /var/lib/minikube/images/kube-scheduler_v1.34.1 (17396736 bytes)
I1122 02:49:49.108875 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.34.1: stat -c "%s %y" /var/lib/minikube/images/kube-apiserver_v1.34.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-apiserver_v1.34.1': No such file or directory
I1122 02:49:49.108912 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.34.1: stat -c "%s %y" /var/lib/minikube/images/kube-controller-manager_v1.34.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-controller-manager_v1.34.1': No such file or directory
I1122 02:49:49.108916 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 --> /var/lib/minikube/images/kube-apiserver_v1.34.1 (27073024 bytes)
I1122 02:49:49.108930 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 --> /var/lib/minikube/images/kube-controller-manager_v1.34.1 (22831104 bytes)
I1122 02:49:49.108994 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.34.1: stat -c "%s %y" /var/lib/minikube/images/kube-proxy_v1.34.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-proxy_v1.34.1': No such file or directory
I1122 02:49:49.109018 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 --> /var/lib/minikube/images/kube-proxy_v1.34.1 (25966080 bytes)
I1122 02:49:49.134412 296853 cache_images.go:118] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I1122 02:49:49.134456 296853 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:49.134513 296853 ssh_runner.go:195] Run: which crictl
I1122 02:49:49.239398 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.10.1: stat -c "%s %y" /var/lib/minikube/images/pause_3.10.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/pause_3.10.1': No such file or directory
I1122 02:49:49.239427 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 --> /var/lib/minikube/images/pause_3.10.1 (321024 bytes)
I1122 02:49:49.253787 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:49.320442 296853 crio.go:275] Loading image: /var/lib/minikube/images/pause_3.10.1
I1122 02:49:49.320507 296853 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/pause_3.10.1
I1122 02:49:49.326188 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:49.905320 296853 cache_images.go:323] Transferred and loaded /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 from cache
I1122 02:49:49.905364 296853 crio.go:275] Loading image: /var/lib/minikube/images/kube-scheduler_v1.34.1
I1122 02:49:49.905411 296853 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.34.1
I1122 02:49:49.905438 296853 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:49:49.934160 296853 cache_images.go:291] Loading image from: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I1122 02:49:49.934273 296853 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
I1122 02:49:50.954329 296853 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.34.1: (1.048886675s)
I1122 02:49:50.954362 296853 cache_images.go:323] Transferred and loaded /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 from cache
I1122 02:49:50.954382 296853 crio.go:275] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.34.1
I1122 02:49:50.954381 296853 ssh_runner.go:235] Completed: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: (1.020077369s)
I1122 02:49:50.954412 296853 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
I1122 02:49:50.954428 296853 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.34.1
I1122 02:49:50.954434 296853 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)
I1122 02:49:52.116914 296853 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.34.1: (1.162451915s)
I1122 02:49:52.116943 296853 cache_images.go:323] Transferred and loaded /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 from cache
I1122 02:49:52.116966 296853 crio.go:275] Loading image: /var/lib/minikube/images/coredns_v1.12.1
I1122 02:49:52.117006 296853 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.12.1
I1122 02:49:53.326594 296853 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.12.1: (1.209562612s)
I1122 02:49:53.326620 296853 cache_images.go:323] Transferred and loaded /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 from cache
I1122 02:49:53.326651 296853 crio.go:275] Loading image: /var/lib/minikube/images/kube-apiserver_v1.34.1
I1122 02:49:53.326714 296853 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.34.1
I1122 02:49:52.866454 280090 pod_ready.go:94] pod "coredns-66bc5c9577-fbj99" is "Ready"
I1122 02:49:52.866478 280090 pod_ready.go:86] duration metric: took 32.504881766s for pod "coredns-66bc5c9577-fbj99" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.866489 280090 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-g7c8c" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.868212 280090 pod_ready.go:99] pod "coredns-66bc5c9577-g7c8c" in "kube-system" namespace is gone: getting pod "coredns-66bc5c9577-g7c8c" in "kube-system" namespace (will retry): pods "coredns-66bc5c9577-g7c8c" not found
I1122 02:49:52.868232 280090 pod_ready.go:86] duration metric: took 1.736541ms for pod "coredns-66bc5c9577-g7c8c" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.870739 280090 pod_ready.go:83] waiting for pod "etcd-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.874524 280090 pod_ready.go:94] pod "etcd-bridge-430524" is "Ready"
I1122 02:49:52.874547 280090 pod_ready.go:86] duration metric: took 3.783688ms for pod "etcd-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.876618 280090 pod_ready.go:83] waiting for pod "kube-apiserver-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.880308 280090 pod_ready.go:94] pod "kube-apiserver-bridge-430524" is "Ready"
I1122 02:49:52.880331 280090 pod_ready.go:86] duration metric: took 3.690302ms for pod "kube-apiserver-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:52.882096 280090 pod_ready.go:83] waiting for pod "kube-controller-manager-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:53.265172 280090 pod_ready.go:94] pod "kube-controller-manager-bridge-430524" is "Ready"
I1122 02:49:53.265203 280090 pod_ready.go:86] duration metric: took 383.079168ms for pod "kube-controller-manager-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:53.465004 280090 pod_ready.go:83] waiting for pod "kube-proxy-6pmph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:53.864796 280090 pod_ready.go:94] pod "kube-proxy-6pmph" is "Ready"
I1122 02:49:53.864828 280090 pod_ready.go:86] duration metric: took 399.799015ms for pod "kube-proxy-6pmph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:54.064961 280090 pod_ready.go:83] waiting for pod "kube-scheduler-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:54.464666 280090 pod_ready.go:94] pod "kube-scheduler-bridge-430524" is "Ready"
I1122 02:49:54.464699 280090 pod_ready.go:86] duration metric: took 399.708827ms for pod "kube-scheduler-bridge-430524" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:49:54.464756 280090 pod_ready.go:40] duration metric: took 34.106012625s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:49:54.519453 280090 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:49:54.521357 280090 out.go:179] * Done! kubectl is now configured to use "bridge-430524" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:49:43 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:43.234734734Z" level=info msg="Started container" PID=2136 containerID=5fe98deb1acc14210a49824f2846e93b69e5136c8e36452dd8c9cb9ab6b3d7a6 description=kube-system/storage-provisioner/storage-provisioner id=b5c30e30-986f-4e8e-9e38-65a492073dec name=/runtime.v1.RuntimeService/StartContainer sandboxID=092fcd9aedd54593307ff6e6592e5de26b70d477e964f18361587b60fe6e1f1f
Nov 22 02:49:43 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:43.236763434Z" level=info msg="Started container" PID=2140 containerID=e94ed104a4c7cb6cfe3998893b3e6ad9c8e3a01b6887efc3a020eb2cdd42e981 description=kube-system/coredns-5dd5756b68-fkcs9/coredns id=963e851a-8296-456c-a9a9-18ab15e554e5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=a77973c09d52b8bfeff0d8c10ff60b2303363e9ae08c8025d1b35bd06765df51
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.428598074Z" level=info msg="Running pod sandbox: default/busybox/POD" id=9fa53b0e-7bb6-4782-ab73-43283fd567af name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.4286748Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.433815391Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:d47339f10fdd8b3de0a73bcc6477edfb1fc60626e0b67b7b6d882d3daa65e2e1 UID:b1f5e42f-ea8d-4876-abe0-1dc771a9c751 NetNS:/var/run/netns/c86b0c7f-7902-415d-afbf-89ffd4bc2a01 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc000b863d0}] Aliases:map[]}"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.433839216Z" level=info msg="Adding pod default_busybox to CNI network \"kindnet\" (type=ptp)"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.443441595Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:d47339f10fdd8b3de0a73bcc6477edfb1fc60626e0b67b7b6d882d3daa65e2e1 UID:b1f5e42f-ea8d-4876-abe0-1dc771a9c751 NetNS:/var/run/netns/c86b0c7f-7902-415d-afbf-89ffd4bc2a01 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc000b863d0}] Aliases:map[]}"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.44355354Z" level=info msg="Checking pod default_busybox for CNI network kindnet (type=ptp)"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.44422518Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.445017415Z" level=info msg="Ran pod sandbox d47339f10fdd8b3de0a73bcc6477edfb1fc60626e0b67b7b6d882d3daa65e2e1 with infra container: default/busybox/POD" id=9fa53b0e-7bb6-4782-ab73-43283fd567af name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.446110117Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=97904af8-1358-4daa-85c8-e6da04eb8401 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.446215652Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=97904af8-1358-4daa-85c8-e6da04eb8401 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.44624766Z" level=info msg="Neither image nor artfiact gcr.io/k8s-minikube/busybox:1.28.4-glibc found" id=97904af8-1358-4daa-85c8-e6da04eb8401 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.446795564Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=d8459da3-114c-42fb-9ce6-efe3d2015499 name=/runtime.v1.ImageService/PullImage
Nov 22 02:49:46 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:46.449577078Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28.4-glibc\""
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.137534272Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998" id=d8459da3-114c-42fb-9ce6-efe3d2015499 name=/runtime.v1.ImageService/PullImage
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.138398988Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=441736c0-7782-4372-af42-10798cd9c5b9 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.139664456Z" level=info msg="Creating container: default/busybox/busybox" id=bfd81674-7c70-40fe-b6cf-c7edd382eeb0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.139795721Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.143839531Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.144287769Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.17131068Z" level=info msg="Created container 5e00fb8255b3a474535f958511ad81eba949bf42a53be30a841c7e73de8a7a51: default/busybox/busybox" id=bfd81674-7c70-40fe-b6cf-c7edd382eeb0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.171780964Z" level=info msg="Starting container: 5e00fb8255b3a474535f958511ad81eba949bf42a53be30a841c7e73de8a7a51" id=5d14a267-e647-4a4f-a522-8b8296141802 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:49:47 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:47.173232088Z" level=info msg="Started container" PID=2218 containerID=5e00fb8255b3a474535f958511ad81eba949bf42a53be30a841c7e73de8a7a51 description=default/busybox/busybox id=5d14a267-e647-4a4f-a522-8b8296141802 name=/runtime.v1.RuntimeService/StartContainer sandboxID=d47339f10fdd8b3de0a73bcc6477edfb1fc60626e0b67b7b6d882d3daa65e2e1
Nov 22 02:49:54 old-k8s-version-169878 crio[768]: time="2025-11-22T02:49:54.208747344Z" level=error msg="Unhandled Error: unable to upgrade websocket connection: websocket server finished before becoming ready (logger=\"UnhandledError\")"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
5e00fb8255b3a gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 8 seconds ago Running busybox 0 d47339f10fdd8 busybox default
e94ed104a4c7c ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 12 seconds ago Running coredns 0 a77973c09d52b coredns-5dd5756b68-fkcs9 kube-system
5fe98deb1acc1 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 12 seconds ago Running storage-provisioner 0 092fcd9aedd54 storage-provisioner kube-system
5c47bb7d23ab6 docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11 24 seconds ago Running kindnet-cni 0 296ada28035d8 kindnet-ptwwj kube-system
b877cb3b6686a ea1030da44aa18666a7bf15fddd2a38c3143c3277159cb8bdd95f45c8ce62d7a 25 seconds ago Running kube-proxy 0 46f4ce080f104 kube-proxy-c7nnb kube-system
3684eecac12ea bb5e0dde9054c02d6badee88547be7e7bb7b7b818d277c8a61b4b29484bbff95 43 seconds ago Running kube-apiserver 0 c1adf0c3860f7 kube-apiserver-old-k8s-version-169878 kube-system
0bb649d504e9f f6f496300a2ae7a6727ccf3080d66d2fd22b6cfc271df5351c976c23a28bb157 43 seconds ago Running kube-scheduler 0 6128d7ac8fe3f kube-scheduler-old-k8s-version-169878 kube-system
d47111c212e61 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 43 seconds ago Running etcd 0 9f54a53068234 etcd-old-k8s-version-169878 kube-system
645e8830c2ede 4be79c38a4bab6e1252a35697500e8a0d9c5c7c771d9fcc1935c9a7f6cdf4c62 43 seconds ago Running kube-controller-manager 0 05e98ff5def66 kube-controller-manager-old-k8s-version-169878 kube-system
==> coredns [e94ed104a4c7cb6cfe3998893b3e6ad9c8e3a01b6887efc3a020eb2cdd42e981] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 8aa94104b4dae56b00431f7362ac05b997af2246775de35dc2eb361b0707b2fa7199f9ddfdba27fdef1331b76d09c41700f6cb5d00836dabab7c0df8e651283f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:34720 - 15797 "HINFO IN 3787079458532514640.2981055518068025968. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.094364099s
==> describe nodes <==
Name: old-k8s-version-169878
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-169878
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=old-k8s-version-169878
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_49_17_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:49:13 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-169878
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:49:47 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:49:47 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:49:47 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:49:47 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:49:47 +0000 Sat, 22 Nov 2025 02:49:42 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-169878
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 57df10e8-2d05-435a-9964-d44e1c0a4356
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.28.0
Kube-Proxy Version: v1.28.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9s
kube-system coredns-5dd5756b68-fkcs9 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 26s
kube-system etcd-old-k8s-version-169878 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 39s
kube-system kindnet-ptwwj 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 27s
kube-system kube-apiserver-old-k8s-version-169878 250m (3%) 0 (0%) 0 (0%) 0 (0%) 39s
kube-system kube-controller-manager-old-k8s-version-169878 200m (2%) 0 (0%) 0 (0%) 0 (0%) 39s
kube-system kube-proxy-c7nnb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 27s
kube-system kube-scheduler-old-k8s-version-169878 100m (1%) 0 (0%) 0 (0%) 0 (0%) 39s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 26s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 26s kube-proxy
Normal Starting 44s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 44s (x8 over 44s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 44s (x8 over 44s) kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 44s (x8 over 44s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal Starting 39s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 39s kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 39s kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 39s kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal RegisteredNode 27s node-controller Node old-k8s-version-169878 event: Registered Node old-k8s-version-169878 in Controller
Normal NodeReady 13s kubelet Node old-k8s-version-169878 status is now: NodeReady
==> dmesg <==
[ +0.000027] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[ +32.252685] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 2e b7 30 ed 94 64 06 97 2e fc 15 0a 08 00
[Nov22 02:48] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
==> etcd [d47111c212e61fadb3b7b22c52cd875c6166534ef1457a05e210d5a8806e2f9f] <==
{"level":"info","ts":"2025-11-22T02:49:11.94914Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed switched to configuration voters=(11459225503572592365)"}
{"level":"info","ts":"2025-11-22T02:49:11.949318Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","added-peer-id":"9f0758e1c58a86ed","added-peer-peer-urls":["https://192.168.85.2:2380"]}
{"level":"info","ts":"2025-11-22T02:49:11.950851Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2025-11-22T02:49:11.950994Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.85.2:2380"}
{"level":"info","ts":"2025-11-22T02:49:11.951363Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.85.2:2380"}
{"level":"info","ts":"2025-11-22T02:49:11.951183Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"9f0758e1c58a86ed","initial-advertise-peer-urls":["https://192.168.85.2:2380"],"listen-peer-urls":["https://192.168.85.2:2380"],"advertise-client-urls":["https://192.168.85.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.85.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2025-11-22T02:49:11.95121Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2025-11-22T02:49:12.339031Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
{"level":"info","ts":"2025-11-22T02:49:12.33913Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
{"level":"info","ts":"2025-11-22T02:49:12.339403Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
{"level":"info","ts":"2025-11-22T02:49:12.339512Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
{"level":"info","ts":"2025-11-22T02:49:12.339622Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
{"level":"info","ts":"2025-11-22T02:49:12.339879Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
{"level":"info","ts":"2025-11-22T02:49:12.340037Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
{"level":"info","ts":"2025-11-22T02:49:12.341148Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:old-k8s-version-169878 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
{"level":"info","ts":"2025-11-22T02:49:12.34141Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:49:12.341414Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:49:12.341481Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2025-11-22T02:49:12.341517Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2025-11-22T02:49:12.342148Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2025-11-22T02:49:12.34256Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
{"level":"info","ts":"2025-11-22T02:49:12.342773Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2025-11-22T02:49:12.34281Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2025-11-22T02:49:12.343235Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.85.2:2379"}
{"level":"info","ts":"2025-11-22T02:49:12.343031Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> kernel <==
02:49:56 up 1:32, 0 user, load average: 4.52, 3.38, 1.96
Linux old-k8s-version-169878 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [5c47bb7d23ab608e4ef49eb67a50f84fb6f4e7cbdf7547adc971027ca6cdfefe] <==
I1122 02:49:31.968939 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:49:31.969209 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:49:31.969399 1 main.go:148] setting mtu 1500 for CNI
I1122 02:49:31.969420 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:49:31.969445 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:49:32Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:49:32.172432 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:49:32.172488 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:49:32.172500 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:49:32.172631 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:49:32.472634 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:49:32.472663 1 metrics.go:72] Registering metrics
I1122 02:49:32.472757 1 controller.go:711] "Syncing nftables rules"
I1122 02:49:42.181229 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:49:42.181298 1 main.go:301] handling current node
I1122 02:49:52.175447 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:49:52.175512 1 main.go:301] handling current node
==> kube-apiserver [3684eecac12ea3739e03afec679c40bf4eb45be507ffe31f09a880ab72c58172] <==
I1122 02:49:13.663436 1 shared_informer.go:318] Caches are synced for configmaps
I1122 02:49:13.663547 1 apf_controller.go:377] Running API Priority and Fairness config worker
I1122 02:49:13.663564 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I1122 02:49:13.663692 1 cache.go:39] Caches are synced for AvailableConditionController controller
I1122 02:49:13.663770 1 shared_informer.go:318] Caches are synced for crd-autoregister
I1122 02:49:13.663838 1 aggregator.go:166] initial CRD sync complete...
I1122 02:49:13.663869 1 autoregister_controller.go:141] Starting autoregister controller
I1122 02:49:13.663877 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:49:13.663885 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:49:13.844277 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:49:14.548539 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:49:14.552218 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:49:14.552239 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:49:14.941824 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:49:14.975512 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:49:15.057629 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:49:15.064463 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I1122 02:49:15.065711 1 controller.go:624] quota admission added evaluator for: endpoints
I1122 02:49:15.069866 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:49:15.627861 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I1122 02:49:16.645934 1 controller.go:624] quota admission added evaluator for: deployments.apps
I1122 02:49:16.659369 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:49:16.669575 1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I1122 02:49:28.852761 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I1122 02:49:29.334729 1 controller.go:624] quota admission added evaluator for: replicasets.apps
==> kube-controller-manager [645e8830c2ededc4805ad5c84ce2260d3fbeabba0ca5fd7d662e3fa1cf1af615] <==
I1122 02:49:28.898200 1 node_lifecycle_controller.go:1029] "Controller detected that all Nodes are not-Ready. Entering master disruption mode"
I1122 02:49:28.975772 1 shared_informer.go:318] Caches are synced for HPA
I1122 02:49:28.986196 1 shared_informer.go:318] Caches are synced for resource quota
I1122 02:49:29.056248 1 shared_informer.go:318] Caches are synced for resource quota
I1122 02:49:29.072393 1 shared_informer.go:318] Caches are synced for cronjob
I1122 02:49:29.338154 1 event.go:307] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-5dd5756b68 to 2"
I1122 02:49:29.407060 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:49:29.425257 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:49:29.425295 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
I1122 02:49:29.437010 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-5dd5756b68-85ss6"
I1122 02:49:29.448082 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-5dd5756b68-fkcs9"
I1122 02:49:29.455277 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="117.179619ms"
I1122 02:49:29.466055 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="10.697473ms"
I1122 02:49:29.466273 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="121.795µs"
I1122 02:49:29.592146 1 event.go:307] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-5dd5756b68 to 1 from 2"
I1122 02:49:29.602074 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-5dd5756b68-85ss6"
I1122 02:49:29.609814 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="17.720561ms"
I1122 02:49:29.615153 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="5.281629ms"
I1122 02:49:29.615251 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="59.585µs"
I1122 02:49:42.771101 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="99.309µs"
I1122 02:49:42.788240 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="105.257µs"
I1122 02:49:43.805791 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="97.261µs"
I1122 02:49:43.831040 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="6.532389ms"
I1122 02:49:43.831177 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="62.23µs"
I1122 02:49:43.899557 1 node_lifecycle_controller.go:1048] "Controller detected that some Nodes are Ready. Exiting master disruption mode"
==> kube-proxy [b877cb3b6686aa83ddf057248b8160997200756dc49cc25596be608fce877100] <==
I1122 02:49:29.850500 1 server_others.go:69] "Using iptables proxy"
I1122 02:49:29.862861 1 node.go:141] Successfully retrieved node IP: 192.168.85.2
I1122 02:49:29.884302 1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:49:29.886769 1 server_others.go:152] "Using iptables Proxier"
I1122 02:49:29.886802 1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
I1122 02:49:29.886811 1 server_others.go:438] "Defaulting to no-op detect-local"
I1122 02:49:29.886847 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I1122 02:49:29.887240 1 server.go:846] "Version info" version="v1.28.0"
I1122 02:49:29.887260 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:49:29.887978 1 config.go:188] "Starting service config controller"
I1122 02:49:29.888015 1 shared_informer.go:311] Waiting for caches to sync for service config
I1122 02:49:29.888034 1 config.go:97] "Starting endpoint slice config controller"
I1122 02:49:29.888054 1 config.go:315] "Starting node config controller"
I1122 02:49:29.888056 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I1122 02:49:29.888061 1 shared_informer.go:311] Waiting for caches to sync for node config
I1122 02:49:29.988793 1 shared_informer.go:318] Caches are synced for endpoint slice config
I1122 02:49:29.988950 1 shared_informer.go:318] Caches are synced for service config
I1122 02:49:29.988971 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [0bb649d504e9f65f275132260486d50455a540c6233cabfc2e7d770e7e5f943a] <==
W1122 02:49:13.644973 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W1122 02:49:13.645041 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1122 02:49:13.645067 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1122 02:49:13.645074 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1122 02:49:13.644890 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W1122 02:49:13.644397 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1122 02:49:13.645156 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1122 02:49:13.644825 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W1122 02:49:13.644741 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E1122 02:49:13.645185 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W1122 02:49:13.645013 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1122 02:49:13.645204 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W1122 02:49:14.520663 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1122 02:49:14.520696 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W1122 02:49:14.578494 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1122 02:49:14.578534 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W1122 02:49:14.622681 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1122 02:49:14.622718 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W1122 02:49:14.622996 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E1122 02:49:14.623031 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W1122 02:49:14.626689 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1122 02:49:14.626729 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W1122 02:49:14.694741 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1122 02:49:14.694775 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
I1122 02:49:15.038822 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: I1122 02:49:28.892324 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ww2\" (UniqueName: \"kubernetes.io/projected/e24d6a8c-25a7-45e0-bf9c-6f1d99eded18-kube-api-access-42ww2\") pod \"kindnet-ptwwj\" (UID: \"e24d6a8c-25a7-45e0-bf9c-6f1d99eded18\") " pod="kube-system/kindnet-ptwwj"
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: I1122 02:49:28.892353 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69af4f1c-8e74-47be-946b-fc73abf50d39-lib-modules\") pod \"kube-proxy-c7nnb\" (UID: \"69af4f1c-8e74-47be-946b-fc73abf50d39\") " pod="kube-system/kube-proxy-c7nnb"
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: I1122 02:49:28.892385 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqbvk\" (UniqueName: \"kubernetes.io/projected/69af4f1c-8e74-47be-946b-fc73abf50d39-kube-api-access-rqbvk\") pod \"kube-proxy-c7nnb\" (UID: \"69af4f1c-8e74-47be-946b-fc73abf50d39\") " pod="kube-system/kube-proxy-c7nnb"
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: I1122 02:49:28.892438 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/e24d6a8c-25a7-45e0-bf9c-6f1d99eded18-xtables-lock\") pod \"kindnet-ptwwj\" (UID: \"e24d6a8c-25a7-45e0-bf9c-6f1d99eded18\") " pod="kube-system/kindnet-ptwwj"
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: I1122 02:49:28.892472 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/69af4f1c-8e74-47be-946b-fc73abf50d39-kube-proxy\") pod \"kube-proxy-c7nnb\" (UID: \"69af4f1c-8e74-47be-946b-fc73abf50d39\") " pod="kube-system/kube-proxy-c7nnb"
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.998329 1393 projected.go:292] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.998371 1393 projected.go:198] Error preparing data for projected volume kube-api-access-42ww2 for pod kube-system/kindnet-ptwwj: configmap "kube-root-ca.crt" not found
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.998453 1393 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e24d6a8c-25a7-45e0-bf9c-6f1d99eded18-kube-api-access-42ww2 podName:e24d6a8c-25a7-45e0-bf9c-6f1d99eded18 nodeName:}" failed. No retries permitted until 2025-11-22 02:49:29.498425441 +0000 UTC m=+12.884210058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42ww2" (UniqueName: "kubernetes.io/projected/e24d6a8c-25a7-45e0-bf9c-6f1d99eded18-kube-api-access-42ww2") pod "kindnet-ptwwj" (UID: "e24d6a8c-25a7-45e0-bf9c-6f1d99eded18") : configmap "kube-root-ca.crt" not found
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.999300 1393 projected.go:292] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.999330 1393 projected.go:198] Error preparing data for projected volume kube-api-access-rqbvk for pod kube-system/kube-proxy-c7nnb: configmap "kube-root-ca.crt" not found
Nov 22 02:49:28 old-k8s-version-169878 kubelet[1393]: E1122 02:49:28.999383 1393 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69af4f1c-8e74-47be-946b-fc73abf50d39-kube-api-access-rqbvk podName:69af4f1c-8e74-47be-946b-fc73abf50d39 nodeName:}" failed. No retries permitted until 2025-11-22 02:49:29.499365167 +0000 UTC m=+12.885149778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rqbvk" (UniqueName: "kubernetes.io/projected/69af4f1c-8e74-47be-946b-fc73abf50d39-kube-api-access-rqbvk") pod "kube-proxy-c7nnb" (UID: "69af4f1c-8e74-47be-946b-fc73abf50d39") : configmap "kube-root-ca.crt" not found
Nov 22 02:49:30 old-k8s-version-169878 kubelet[1393]: I1122 02:49:30.779228 1393 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-proxy-c7nnb" podStartSLOduration=2.779168711 podCreationTimestamp="2025-11-22 02:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:49:30.778638103 +0000 UTC m=+14.164422747" watchObservedRunningTime="2025-11-22 02:49:30.779168711 +0000 UTC m=+14.164953338"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.748959 1393 kubelet_node_status.go:493] "Fast updating node status as it just became ready"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.768173 1393 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kindnet-ptwwj" podStartSLOduration=12.876355099 podCreationTimestamp="2025-11-22 02:49:28 +0000 UTC" firstStartedPulling="2025-11-22 02:49:29.778494693 +0000 UTC m=+13.164279310" lastFinishedPulling="2025-11-22 02:49:31.670256935 +0000 UTC m=+15.056041561" observedRunningTime="2025-11-22 02:49:31.781273308 +0000 UTC m=+15.167057935" watchObservedRunningTime="2025-11-22 02:49:42.76811735 +0000 UTC m=+26.153901976"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.768438 1393 topology_manager.go:215] "Topology Admit Handler" podUID="5a92e00b-ff3b-42cc-abf1-b24411df7bb4" podNamespace="kube-system" podName="storage-provisioner"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.770286 1393 topology_manager.go:215] "Topology Admit Handler" podUID="234a7a20-53b3-4947-a441-5b20e73cf1e3" podNamespace="kube-system" podName="coredns-5dd5756b68-fkcs9"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.795214 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/5a92e00b-ff3b-42cc-abf1-b24411df7bb4-tmp\") pod \"storage-provisioner\" (UID: \"5a92e00b-ff3b-42cc-abf1-b24411df7bb4\") " pod="kube-system/storage-provisioner"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.795265 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k85f5\" (UniqueName: \"kubernetes.io/projected/234a7a20-53b3-4947-a441-5b20e73cf1e3-kube-api-access-k85f5\") pod \"coredns-5dd5756b68-fkcs9\" (UID: \"234a7a20-53b3-4947-a441-5b20e73cf1e3\") " pod="kube-system/coredns-5dd5756b68-fkcs9"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.795303 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cwn6\" (UniqueName: \"kubernetes.io/projected/5a92e00b-ff3b-42cc-abf1-b24411df7bb4-kube-api-access-5cwn6\") pod \"storage-provisioner\" (UID: \"5a92e00b-ff3b-42cc-abf1-b24411df7bb4\") " pod="kube-system/storage-provisioner"
Nov 22 02:49:42 old-k8s-version-169878 kubelet[1393]: I1122 02:49:42.795421 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/234a7a20-53b3-4947-a441-5b20e73cf1e3-config-volume\") pod \"coredns-5dd5756b68-fkcs9\" (UID: \"234a7a20-53b3-4947-a441-5b20e73cf1e3\") " pod="kube-system/coredns-5dd5756b68-fkcs9"
Nov 22 02:49:43 old-k8s-version-169878 kubelet[1393]: I1122 02:49:43.805679 1393 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/coredns-5dd5756b68-fkcs9" podStartSLOduration=14.805631257 podCreationTimestamp="2025-11-22 02:49:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:49:43.805467232 +0000 UTC m=+27.191251880" watchObservedRunningTime="2025-11-22 02:49:43.805631257 +0000 UTC m=+27.191415885"
Nov 22 02:49:43 old-k8s-version-169878 kubelet[1393]: I1122 02:49:43.815649 1393 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=14.815599824 podCreationTimestamp="2025-11-22 02:49:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:49:43.815106238 +0000 UTC m=+27.200890867" watchObservedRunningTime="2025-11-22 02:49:43.815599824 +0000 UTC m=+27.201384451"
Nov 22 02:49:46 old-k8s-version-169878 kubelet[1393]: I1122 02:49:46.127104 1393 topology_manager.go:215] "Topology Admit Handler" podUID="b1f5e42f-ea8d-4876-abe0-1dc771a9c751" podNamespace="default" podName="busybox"
Nov 22 02:49:46 old-k8s-version-169878 kubelet[1393]: I1122 02:49:46.216748 1393 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnhq\" (UniqueName: \"kubernetes.io/projected/b1f5e42f-ea8d-4876-abe0-1dc771a9c751-kube-api-access-2lnhq\") pod \"busybox\" (UID: \"b1f5e42f-ea8d-4876-abe0-1dc771a9c751\") " pod="default/busybox"
Nov 22 02:49:47 old-k8s-version-169878 kubelet[1393]: I1122 02:49:47.817263 1393 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/busybox" podStartSLOduration=1.12582995 podCreationTimestamp="2025-11-22 02:49:46 +0000 UTC" firstStartedPulling="2025-11-22 02:49:46.446431669 +0000 UTC m=+29.832216288" lastFinishedPulling="2025-11-22 02:49:47.13781885 +0000 UTC m=+30.523603469" observedRunningTime="2025-11-22 02:49:47.817171937 +0000 UTC m=+31.202956576" watchObservedRunningTime="2025-11-22 02:49:47.817217131 +0000 UTC m=+31.203001757"
==> storage-provisioner [5fe98deb1acc14210a49824f2846e93b69e5136c8e36452dd8c9cb9ab6b3d7a6] <==
I1122 02:49:43.250214 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:49:43.259254 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:49:43.259305 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1122 02:49:43.265087 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:49:43.265265 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_cc16c8af-6e3a-4d5f-b086-524eed9af7b3!
I1122 02:49:43.265539 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8a847876-9310-429d-b2a3-b558de50b707", APIVersion:"v1", ResourceVersion:"434", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-169878_cc16c8af-6e3a-4d5f-b086-524eed9af7b3 became leader
I1122 02:49:43.365859 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_cc16c8af-6e3a-4d5f-b086-524eed9af7b3!
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-169878 -n old-k8s-version-169878
helpers_test.go:269: (dbg) Run: kubectl --context old-k8s-version-169878 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (2.68s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 11 (292.746129ms)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:50:44Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:205: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 11
start_stop_delete_test.go:213: (dbg) Run: kubectl --context no-preload-346270 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:213: (dbg) Non-zero exit: kubectl --context no-preload-346270 describe deploy/metrics-server -n kube-system: exit status 1 (71.340069ms)
** stderr **
Error from server (NotFound): deployments.apps "metrics-server" not found
** /stderr **
start_stop_delete_test.go:215: failed to get info on auto-pause deployments. args "kubectl --context no-preload-346270 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:219: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/no-preload/serial/EnableAddonWhileActive]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/no-preload/serial/EnableAddonWhileActive]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect no-preload-346270
helpers_test.go:243: (dbg) docker inspect no-preload-346270:
-- stdout --
[
{
"Id": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"Created": "2025-11-22T02:49:44.656554358Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 297311,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:49:44.69110328Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hostname",
"HostsPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hosts",
"LogPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d-json.log",
"Name": "/no-preload-346270",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"no-preload-346270:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "no-preload-346270",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"LowerDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/merged",
"UpperDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/diff",
"WorkDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "no-preload-346270",
"Source": "/var/lib/docker/volumes/no-preload-346270/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "no-preload-346270",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "no-preload-346270",
"name.minikube.sigs.k8s.io": "no-preload-346270",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "2812d679f76221c8819818d86fddeeb08e09944668c1f564f50f349601d59bf1",
"SandboxKey": "/var/run/docker/netns/2812d679f762",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33093"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33094"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33097"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33095"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33096"
}
]
},
"Networks": {
"no-preload-346270": {
"IPAMConfig": {
"IPv4Address": "192.168.103.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "b056c157b0938097ab83f43dd906bd8cb89754351bc1a446e56b63614f473353",
"EndpointID": "e36915e0a8d4836ae2b0e784b924916c548038f2ac05160925103361c51ea4dc",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"MacAddress": "0e:d1:9a:7b:6f:cf",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"no-preload-346270",
"6c4d4f5318ee"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270
helpers_test.go:252: <<< TestStartStop/group/no-preload/serial/EnableAddonWhileActive FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/no-preload/serial/EnableAddonWhileActive]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25: (1.081678469s)
helpers_test.go:260: TestStartStop/group/no-preload/serial/EnableAddonWhileActive logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p bridge-430524 sudo journalctl -xeu kubelet --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/kubernetes/kubelet.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /var/lib/kubelet/config.yaml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status docker --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/docker/daemon.json │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo docker system info │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl status cri-docker --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat cri-docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cri-dockerd --version │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status containerd --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat containerd --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /lib/systemd/system/containerd.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/containerd/config.toml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo containerd config dump │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status crio --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:50:26
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:50:26.848347 315098 out.go:360] Setting OutFile to fd 1 ...
I1122 02:50:26.848640 315098 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:50:26.848650 315098 out.go:374] Setting ErrFile to fd 2...
I1122 02:50:26.848654 315098 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:50:26.848821 315098 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:50:26.849257 315098 out.go:368] Setting JSON to false
I1122 02:50:26.850551 315098 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5570,"bootTime":1763774257,"procs":320,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:50:26.850635 315098 start.go:143] virtualization: kvm guest
I1122 02:50:26.852472 315098 out.go:179] * [default-k8s-diff-port-714134] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:50:26.853579 315098 notify.go:221] Checking for updates...
I1122 02:50:26.853597 315098 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:50:26.854607 315098 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:50:26.856507 315098 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:50:26.857670 315098 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:50:26.858826 315098 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:50:26.859863 315098 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:50:26.861360 315098 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:26.861445 315098 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:26.861513 315098 config.go:182] Loaded profile config "old-k8s-version-169878": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:50:26.861592 315098 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:50:26.884507 315098 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:50:26.884592 315098 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:50:26.942382 315098 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:50:26.932937737 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:50:26.942485 315098 docker.go:319] overlay module found
I1122 02:50:26.943998 315098 out.go:179] * Using the docker driver based on user configuration
I1122 02:50:26.945094 315098 start.go:309] selected driver: docker
I1122 02:50:26.945109 315098 start.go:927] validating driver "docker" against <nil>
I1122 02:50:26.945120 315098 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:50:26.945738 315098 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:50:27.003451 315098 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:50:26.993578305 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:50:27.003702 315098 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 02:50:27.004011 315098 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:27.005439 315098 out.go:179] * Using Docker driver with root privileges
I1122 02:50:27.006575 315098 cni.go:84] Creating CNI manager for ""
I1122 02:50:27.006644 315098 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:27.006656 315098 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 02:50:27.006725 315098 start.go:353] cluster config:
{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SS
HAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:50:27.008021 315098 out.go:179] * Starting "default-k8s-diff-port-714134" primary control-plane node in "default-k8s-diff-port-714134" cluster
I1122 02:50:27.009048 315098 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:50:27.010103 315098 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:50:27.011139 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:27.011180 315098 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:50:27.011202 315098 cache.go:65] Caching tarball of preloaded images
I1122 02:50:27.011215 315098 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:50:27.011334 315098 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:50:27.011348 315098 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:50:27.011457 315098 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:50:27.011479 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json: {Name:mk704ce29f32d27f3ff4cb55748afe3b9293cc3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:27.031436 315098 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:50:27.031458 315098 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:50:27.031474 315098 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:50:27.031496 315098 start.go:360] acquireMachinesLock for default-k8s-diff-port-714134: {Name:mk7e1a12e2fa8aced0c98248f29bf8f0364ff72a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:50:27.031576 315098 start.go:364] duration metric: took 65.607µs to acquireMachinesLock for "default-k8s-diff-port-714134"
I1122 02:50:27.031596 315098 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default API
ServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:50:27.031650 315098 start.go:125] createHost starting for "" (driver="docker")
W1122 02:50:24.478498 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:26.976879 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
I1122 02:50:25.033378 307742 addons.go:530] duration metric: took 2.942014044s for enable addons: enabled=[storage-provisioner default-storageclass dashboard]
I1122 02:50:25.035530 307742 system_pods.go:59] 8 kube-system pods found
I1122 02:50:25.035567 307742 system_pods.go:61] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:25.035580 307742 system_pods.go:61] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:50:25.035591 307742 system_pods.go:61] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:50:25.035605 307742 system_pods.go:61] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:50:25.035615 307742 system_pods.go:61] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:50:25.035626 307742 system_pods.go:61] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:50:25.035637 307742 system_pods.go:61] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:50:25.035648 307742 system_pods.go:61] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:25.035661 307742 system_pods.go:74] duration metric: took 3.548505ms to wait for pod list to return data ...
I1122 02:50:25.035673 307742 default_sa.go:34] waiting for default service account to be created ...
I1122 02:50:25.037558 307742 default_sa.go:45] found service account: "default"
I1122 02:50:25.037576 307742 default_sa.go:55] duration metric: took 1.895851ms for default service account to be created ...
I1122 02:50:25.037584 307742 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:50:25.042102 307742 system_pods.go:86] 8 kube-system pods found
I1122 02:50:25.042129 307742 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:25.042139 307742 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:50:25.042149 307742 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:50:25.042157 307742 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:50:25.042169 307742 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:50:25.042188 307742 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:50:25.042199 307742 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:50:25.042207 307742 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:25.042219 307742 system_pods.go:126] duration metric: took 4.628246ms to wait for k8s-apps to be running ...
I1122 02:50:25.042227 307742 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:50:25.042271 307742 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:50:25.055827 307742 system_svc.go:56] duration metric: took 13.5969ms WaitForService to wait for kubelet
I1122 02:50:25.055849 307742 kubeadm.go:587] duration metric: took 2.963623312s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:25.055870 307742 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:50:25.057696 307742 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:50:25.057716 307742 node_conditions.go:123] node cpu capacity is 8
I1122 02:50:25.057728 307742 node_conditions.go:105] duration metric: took 1.852913ms to run NodePressure ...
I1122 02:50:25.057738 307742 start.go:242] waiting for startup goroutines ...
I1122 02:50:25.057755 307742 start.go:247] waiting for cluster config update ...
I1122 02:50:25.057773 307742 start.go:256] writing updated cluster config ...
I1122 02:50:25.058039 307742 ssh_runner.go:195] Run: rm -f paused
I1122 02:50:25.061583 307742 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:25.065438 307742 pod_ready.go:83] waiting for pod "coredns-5dd5756b68-fkcs9" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:50:27.071253 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:27.033313 315098 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1122 02:50:27.033524 315098 start.go:159] libmachine.API.Create for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:50:27.033559 315098 client.go:173] LocalClient.Create starting
I1122 02:50:27.033616 315098 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 02:50:27.033645 315098 main.go:143] libmachine: Decoding PEM data...
I1122 02:50:27.033661 315098 main.go:143] libmachine: Parsing certificate...
I1122 02:50:27.033730 315098 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 02:50:27.033751 315098 main.go:143] libmachine: Decoding PEM data...
I1122 02:50:27.033758 315098 main.go:143] libmachine: Parsing certificate...
I1122 02:50:27.034095 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:50:27.050483 315098 cli_runner.go:211] docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:50:27.050549 315098 network_create.go:284] running [docker network inspect default-k8s-diff-port-714134] to gather additional debugging logs...
I1122 02:50:27.050567 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134
W1122 02:50:27.067558 315098 cli_runner.go:211] docker network inspect default-k8s-diff-port-714134 returned with exit code 1
I1122 02:50:27.067598 315098 network_create.go:287] error running [docker network inspect default-k8s-diff-port-714134]: docker network inspect default-k8s-diff-port-714134: exit status 1
stdout:
[]
stderr:
Error response from daemon: network default-k8s-diff-port-714134 not found
I1122 02:50:27.067616 315098 network_create.go:289] output of [docker network inspect default-k8s-diff-port-714134]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network default-k8s-diff-port-714134 not found
** /stderr **
I1122 02:50:27.067755 315098 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:50:27.085758 315098 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:50:27.086582 315098 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9423c3ade39b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:8e:36:bc:4b:d9:05} reservation:<nil>}
I1122 02:50:27.087523 315098 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-49270bd849d0 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:2a:04:6a:68:04:12} reservation:<nil>}
I1122 02:50:27.088464 315098 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-96385b2a6169 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:a6:7a:19:52:83:96} reservation:<nil>}
I1122 02:50:27.089175 315098 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-37299b5114cb IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:76:db:27:16:0e:a6} reservation:<nil>}
I1122 02:50:27.090198 315098 network.go:206] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001f7f6d0}
I1122 02:50:27.090228 315098 network_create.go:124] attempt to create docker network default-k8s-diff-port-714134 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
I1122 02:50:27.090272 315098 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 default-k8s-diff-port-714134
I1122 02:50:27.138184 315098 network_create.go:108] docker network default-k8s-diff-port-714134 192.168.94.0/24 created
I1122 02:50:27.138214 315098 kic.go:121] calculated static IP "192.168.94.2" for the "default-k8s-diff-port-714134" container
I1122 02:50:27.138285 315098 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 02:50:27.155804 315098 cli_runner.go:164] Run: docker volume create default-k8s-diff-port-714134 --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --label created_by.minikube.sigs.k8s.io=true
I1122 02:50:27.174548 315098 oci.go:103] Successfully created a docker volume default-k8s-diff-port-714134
I1122 02:50:27.174629 315098 cli_runner.go:164] Run: docker run --rm --name default-k8s-diff-port-714134-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --entrypoint /usr/bin/test -v default-k8s-diff-port-714134:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 02:50:27.554984 315098 oci.go:107] Successfully prepared a docker volume default-k8s-diff-port-714134
I1122 02:50:27.555079 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:27.555107 315098 kic.go:194] Starting extracting preloaded images to volume ...
I1122 02:50:27.555181 315098 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-714134:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 02:50:31.647569 315098 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-714134:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.09234183s)
I1122 02:50:31.647617 315098 kic.go:203] duration metric: took 4.092504318s to extract preloaded images to volume ...
W1122 02:50:31.647696 315098 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:50:31.647737 315098 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:50:31.647790 315098 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:50:31.721746 315098 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname default-k8s-diff-port-714134 --name default-k8s-diff-port-714134 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --network default-k8s-diff-port-714134 --ip 192.168.94.2 --volume default-k8s-diff-port-714134:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8444 --publish=127.0.0.1::8444 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
W1122 02:50:28.978553 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:31.476276 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:33.476895 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:29.571113 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:31.600503 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:32.083987 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Running}}
I1122 02:50:32.106410 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.128590 315098 cli_runner.go:164] Run: docker exec default-k8s-diff-port-714134 stat /var/lib/dpkg/alternatives/iptables
I1122 02:50:32.182124 315098 oci.go:144] the created container "default-k8s-diff-port-714134" has a running status.
I1122 02:50:32.182180 315098 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa...
I1122 02:50:32.408102 315098 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:50:32.446843 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.470136 315098 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:50:32.470207 315098 kic_runner.go:114] Args: [docker exec --privileged default-k8s-diff-port-714134 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:50:32.529940 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.551517 315098 machine.go:94] provisionDockerMachine start ...
I1122 02:50:32.551616 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.574257 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.574587 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.574603 315098 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:50:32.716913 315098 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:50:32.716966 315098 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-714134"
I1122 02:50:32.717064 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.737826 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.738155 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.738174 315098 main.go:143] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-714134 && echo "default-k8s-diff-port-714134" | sudo tee /etc/hostname
I1122 02:50:32.885155 315098 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:50:32.885231 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.903931 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.904172 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.904192 315098 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-714134' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-714134/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-714134' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:50:33.037443 315098 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:50:33.037493 315098 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:50:33.037517 315098 ubuntu.go:190] setting up certificates
I1122 02:50:33.037541 315098 provision.go:84] configureAuth start
I1122 02:50:33.037609 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:33.059191 315098 provision.go:143] copyHostCerts
I1122 02:50:33.059272 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:50:33.059290 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:50:33.059382 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:50:33.059577 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:50:33.059603 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:50:33.059666 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:50:33.059773 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:50:33.059787 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:50:33.059837 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:50:33.059932 315098 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-714134 san=[127.0.0.1 192.168.94.2 default-k8s-diff-port-714134 localhost minikube]
I1122 02:50:33.243427 315098 provision.go:177] copyRemoteCerts
I1122 02:50:33.243500 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:50:33.243557 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.266613 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:33.369323 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:50:33.390458 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1122 02:50:33.410880 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 02:50:33.429722 315098 provision.go:87] duration metric: took 392.167443ms to configureAuth
I1122 02:50:33.429746 315098 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:50:33.429965 315098 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:33.430080 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.450371 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:33.450649 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:33.450668 315098 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:50:33.753998 315098 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:50:33.754025 315098 machine.go:97] duration metric: took 1.202485265s to provisionDockerMachine
I1122 02:50:33.754035 315098 client.go:176] duration metric: took 6.720468328s to LocalClient.Create
I1122 02:50:33.754053 315098 start.go:167] duration metric: took 6.720531764s to libmachine.API.Create "default-k8s-diff-port-714134"
I1122 02:50:33.754061 315098 start.go:293] postStartSetup for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:50:33.754070 315098 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:50:33.754131 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:50:33.754167 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.773779 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:33.886703 315098 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:50:33.892651 315098 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:50:33.892688 315098 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:50:33.892700 315098 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:50:33.892756 315098 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:50:33.892856 315098 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:50:33.893019 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:50:33.902469 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:50:33.926557 315098 start.go:296] duration metric: took 172.480679ms for postStartSetup
I1122 02:50:33.927002 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:33.955872 315098 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:50:33.957098 315098 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:50:33.957151 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.992754 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.100750 315098 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:50:34.104950 315098 start.go:128] duration metric: took 7.073286131s to createHost
I1122 02:50:34.104974 315098 start.go:83] releasing machines lock for "default-k8s-diff-port-714134", held for 7.073387142s
I1122 02:50:34.105032 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:34.122755 315098 ssh_runner.go:195] Run: cat /version.json
I1122 02:50:34.122795 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:34.122829 315098 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:50:34.122898 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:34.142933 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.142967 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.306053 315098 ssh_runner.go:195] Run: systemctl --version
I1122 02:50:34.312427 315098 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:50:34.345957 315098 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:50:34.350194 315098 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:50:34.350254 315098 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:50:34.374074 315098 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 02:50:34.374098 315098 start.go:496] detecting cgroup driver to use...
I1122 02:50:34.374131 315098 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:50:34.374172 315098 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:50:34.389120 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:50:34.400738 315098 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:50:34.400777 315098 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:50:34.416000 315098 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:50:34.431896 315098 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:50:34.515612 315098 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:50:34.604440 315098 docker.go:234] disabling docker service ...
I1122 02:50:34.604498 315098 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:50:34.621611 315098 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:50:34.633170 315098 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:50:34.715361 315098 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:50:34.792250 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:50:34.803629 315098 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:50:34.816784 315098 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:50:34.816842 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.826407 315098 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:50:34.826461 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.834550 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.842615 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.850463 315098 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:50:34.857737 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.865385 315098 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.877972 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.886563 315098 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:50:34.893346 315098 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:50:34.900147 315098 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:34.996506 315098 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:50:35.150709 315098 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:50:35.150780 315098 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:50:35.155372 315098 start.go:564] Will wait 60s for crictl version
I1122 02:50:35.155428 315098 ssh_runner.go:195] Run: which crictl
I1122 02:50:35.159552 315098 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:50:35.187317 315098 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:50:35.187396 315098 ssh_runner.go:195] Run: crio --version
I1122 02:50:35.218554 315098 ssh_runner.go:195] Run: crio --version
I1122 02:50:35.253000 315098 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:50:33.976848 296853 node_ready.go:49] node "no-preload-346270" is "Ready"
I1122 02:50:33.976979 296853 node_ready.go:38] duration metric: took 14.003711927s for node "no-preload-346270" to be "Ready" ...
I1122 02:50:33.977007 296853 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:50:33.977092 296853 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:50:33.995822 296853 api_server.go:72] duration metric: took 14.44805929s to wait for apiserver process to appear ...
I1122 02:50:33.995883 296853 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:50:33.995953 296853 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:50:34.010817 296853 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:50:34.012236 296853 api_server.go:141] control plane version: v1.34.1
I1122 02:50:34.012321 296853 api_server.go:131] duration metric: took 16.400016ms to wait for apiserver health ...
I1122 02:50:34.012356 296853 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:50:34.018455 296853 system_pods.go:59] 8 kube-system pods found
I1122 02:50:34.018492 296853 system_pods.go:61] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:34.018500 296853 system_pods.go:61] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running
I1122 02:50:34.018507 296853 system_pods.go:61] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running
I1122 02:50:34.018513 296853 system_pods.go:61] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running
I1122 02:50:34.018518 296853 system_pods.go:61] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running
I1122 02:50:34.018522 296853 system_pods.go:61] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running
I1122 02:50:34.018527 296853 system_pods.go:61] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running
I1122 02:50:34.018533 296853 system_pods.go:61] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:34.018542 296853 system_pods.go:74] duration metric: took 6.169554ms to wait for pod list to return data ...
I1122 02:50:34.018551 296853 default_sa.go:34] waiting for default service account to be created ...
I1122 02:50:34.032545 296853 default_sa.go:45] found service account: "default"
I1122 02:50:34.032639 296853 default_sa.go:55] duration metric: took 14.07788ms for default service account to be created ...
I1122 02:50:34.032667 296853 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:50:34.058015 296853 system_pods.go:86] 8 kube-system pods found
I1122 02:50:34.058056 296853 system_pods.go:89] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:34.058066 296853 system_pods.go:89] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running
I1122 02:50:34.058074 296853 system_pods.go:89] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running
I1122 02:50:34.058080 296853 system_pods.go:89] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running
I1122 02:50:34.058085 296853 system_pods.go:89] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running
I1122 02:50:34.058090 296853 system_pods.go:89] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running
I1122 02:50:34.058095 296853 system_pods.go:89] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running
I1122 02:50:34.058102 296853 system_pods.go:89] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:34.058112 296853 system_pods.go:126] duration metric: took 25.407725ms to wait for k8s-apps to be running ...
I1122 02:50:34.058123 296853 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:50:34.058174 296853 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:50:34.075387 296853 system_svc.go:56] duration metric: took 17.254408ms WaitForService to wait for kubelet
I1122 02:50:34.075489 296853 kubeadm.go:587] duration metric: took 14.527727905s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:34.075520 296853 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:50:34.078734 296853 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:50:34.078757 296853 node_conditions.go:123] node cpu capacity is 8
I1122 02:50:34.078770 296853 node_conditions.go:105] duration metric: took 3.244561ms to run NodePressure ...
I1122 02:50:34.078782 296853 start.go:242] waiting for startup goroutines ...
I1122 02:50:34.078788 296853 start.go:247] waiting for cluster config update ...
I1122 02:50:34.078798 296853 start.go:256] writing updated cluster config ...
I1122 02:50:34.079059 296853 ssh_runner.go:195] Run: rm -f paused
I1122 02:50:34.083090 296853 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:34.116386 296853 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.120678 296853 pod_ready.go:94] pod "coredns-66bc5c9577-6tsqs" is "Ready"
I1122 02:50:34.120704 296853 pod_ready.go:86] duration metric: took 4.295993ms for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.122544 296853 pod_ready.go:83] waiting for pod "etcd-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.126636 296853 pod_ready.go:94] pod "etcd-no-preload-346270" is "Ready"
I1122 02:50:34.126656 296853 pod_ready.go:86] duration metric: took 4.092164ms for pod "etcd-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.128563 296853 pod_ready.go:83] waiting for pod "kube-apiserver-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.132633 296853 pod_ready.go:94] pod "kube-apiserver-no-preload-346270" is "Ready"
I1122 02:50:34.132654 296853 pod_ready.go:86] duration metric: took 4.070577ms for pod "kube-apiserver-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.134519 296853 pod_ready.go:83] waiting for pod "kube-controller-manager-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.487626 296853 pod_ready.go:94] pod "kube-controller-manager-no-preload-346270" is "Ready"
I1122 02:50:34.487657 296853 pod_ready.go:86] duration metric: took 353.113808ms for pod "kube-controller-manager-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.688015 296853 pod_ready.go:83] waiting for pod "kube-proxy-lpft6" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.088775 296853 pod_ready.go:94] pod "kube-proxy-lpft6" is "Ready"
I1122 02:50:35.088810 296853 pod_ready.go:86] duration metric: took 400.769287ms for pod "kube-proxy-lpft6" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.288278 296853 pod_ready.go:83] waiting for pod "kube-scheduler-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.686926 296853 pod_ready.go:94] pod "kube-scheduler-no-preload-346270" is "Ready"
I1122 02:50:35.686957 296853 pod_ready.go:86] duration metric: took 398.647249ms for pod "kube-scheduler-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.686978 296853 pod_ready.go:40] duration metric: took 1.603854305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:35.729747 296853 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:50:35.731352 296853 out.go:179] * Done! kubectl is now configured to use "no-preload-346270" cluster and "default" namespace by default
I1122 02:50:35.254240 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:50:35.274227 315098 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:50:35.278760 315098 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:50:35.290677 315098 kubeadm.go:884] updating cluster {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false C
ustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:50:35.290795 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:35.290841 315098 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:50:35.326198 315098 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:50:35.326217 315098 crio.go:433] Images already preloaded, skipping extraction
I1122 02:50:35.326259 315098 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:50:35.355607 315098 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:50:35.355634 315098 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:50:35.355655 315098 kubeadm.go:935] updating node { 192.168.94.2 8444 v1.34.1 crio true true} ...
I1122 02:50:35.355776 315098 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-714134 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:50:35.355853 315098 ssh_runner.go:195] Run: crio config
I1122 02:50:35.406921 315098 cni.go:84] Creating CNI manager for ""
I1122 02:50:35.406952 315098 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:35.406975 315098 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:50:35.407009 315098 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8444 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-714134 NodeName:default-k8s-diff-port-714134 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:50:35.407166 315098 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-714134"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:50:35.407243 315098 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:50:35.416873 315098 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:50:35.416944 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:50:35.425451 315098 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
I1122 02:50:35.439884 315098 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:50:35.456060 315098 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
I1122 02:50:35.469007 315098 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:50:35.472413 315098 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:50:35.481551 315098 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:35.565834 315098 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:50:35.587973 315098 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134 for IP: 192.168.94.2
I1122 02:50:35.587992 315098 certs.go:195] generating shared ca certs ...
I1122 02:50:35.588007 315098 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.588133 315098 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:50:35.588171 315098 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:50:35.588180 315098 certs.go:257] generating profile certs ...
I1122 02:50:35.588227 315098 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key
I1122 02:50:35.588248 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt with IP's: []
I1122 02:50:35.846933 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt ...
I1122 02:50:35.846965 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt: {Name:mk1f906593a097ac0c7889e33db96c08bc1abaa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.847172 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key ...
I1122 02:50:35.847201 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key: {Name:mk1e9449b03475d3e6bed302c331cc8f7dd59fc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.847341 315098 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0
I1122 02:50:35.847368 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]
I1122 02:50:36.123277 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 ...
I1122 02:50:36.123310 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0: {Name:mkfbe594c33401dafe3e1860e3a84f3790532c43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.123502 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0 ...
I1122 02:50:36.123525 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0: {Name:mk7afc2c1f5540be31f7a77ec14865e7dc853126 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.123633 315098 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt
I1122 02:50:36.123759 315098 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key
I1122 02:50:36.123848 315098 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key
I1122 02:50:36.123871 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt with IP's: []
I1122 02:50:37.201521 306384 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 02:50:37.201604 306384 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:50:37.201736 306384 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:50:37.201806 306384 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:50:37.201851 306384 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:50:37.201966 306384 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:50:37.202041 306384 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:50:37.202127 306384 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:50:37.202228 306384 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:50:37.202315 306384 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:50:37.202389 306384 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:50:37.202467 306384 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:50:37.202536 306384 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:50:37.202646 306384 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:50:37.202786 306384 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:50:37.202940 306384 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 02:50:37.203039 306384 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:50:37.205009 306384 out.go:252] - Generating certificates and keys ...
I1122 02:50:37.205108 306384 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:50:37.205215 306384 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:50:37.205301 306384 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:50:37.205378 306384 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:50:37.205463 306384 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:50:37.205536 306384 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:50:37.205634 306384 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:50:37.205872 306384 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [embed-certs-153115 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:50:37.205983 306384 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:50:37.206134 306384 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-153115 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:50:37.206230 306384 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:50:37.206324 306384 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:50:37.206406 306384 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:50:37.206486 306384 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:50:37.206579 306384 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:50:37.206688 306384 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:50:37.206773 306384 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:50:37.206872 306384 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:50:37.206993 306384 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:50:37.207126 306384 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:50:37.207222 306384 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:50:37.208456 306384 out.go:252] - Booting up control plane ...
I1122 02:50:37.208575 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:50:37.208694 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:50:37.208783 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:50:37.208923 306384 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:50:37.209087 306384 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:50:37.209241 306384 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:50:37.209354 306384 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:50:37.209420 306384 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:50:37.209594 306384 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:50:37.209729 306384 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:50:37.209829 306384 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001734685s
I1122 02:50:37.209995 306384 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:50:37.210076 306384 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.76.2:8443/livez
I1122 02:50:37.210146 306384 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:50:37.210222 306384 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:50:37.210307 306384 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 4.258296456s
I1122 02:50:37.210365 306384 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 4.763991939s
I1122 02:50:37.210440 306384 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 6.50204239s
I1122 02:50:37.210538 306384 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:50:37.210653 306384 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:50:37.210718 306384 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:50:37.210930 306384 kubeadm.go:319] [mark-control-plane] Marking the node embed-certs-153115 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:50:37.211027 306384 kubeadm.go:319] [bootstrap-token] Using token: jbtdyo.vswtv1xc3ub2nx0v
I1122 02:50:37.212723 306384 out.go:252] - Configuring RBAC rules ...
I1122 02:50:37.212874 306384 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:50:37.213015 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:50:37.213175 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:50:37.213363 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:50:37.213518 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:50:37.213635 306384 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:50:37.213779 306384 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:50:37.213853 306384 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:50:37.213932 306384 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:50:37.213955 306384 kubeadm.go:319]
I1122 02:50:37.214010 306384 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:50:37.214016 306384 kubeadm.go:319]
I1122 02:50:37.214079 306384 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:50:37.214089 306384 kubeadm.go:319]
I1122 02:50:37.214110 306384 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:50:37.214170 306384 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:50:37.214244 306384 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:50:37.214252 306384 kubeadm.go:319]
I1122 02:50:37.214329 306384 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:50:37.214337 306384 kubeadm.go:319]
I1122 02:50:37.214409 306384 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:50:37.214422 306384 kubeadm.go:319]
I1122 02:50:37.214497 306384 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:50:37.214605 306384 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:50:37.214704 306384 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:50:37.214712 306384 kubeadm.go:319]
I1122 02:50:37.214820 306384 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:50:37.214946 306384 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:50:37.214955 306384 kubeadm.go:319]
I1122 02:50:37.215020 306384 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token jbtdyo.vswtv1xc3ub2nx0v \
I1122 02:50:37.215101 306384 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:50:37.215121 306384 kubeadm.go:319] --control-plane
I1122 02:50:37.215127 306384 kubeadm.go:319]
I1122 02:50:37.215199 306384 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:50:37.215205 306384 kubeadm.go:319]
I1122 02:50:37.215326 306384 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token jbtdyo.vswtv1xc3ub2nx0v \
I1122 02:50:37.215475 306384 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:50:37.215492 306384 cni.go:84] Creating CNI manager for ""
I1122 02:50:37.215500 306384 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:37.216772 306384 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1122 02:50:36.924143 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt ...
I1122 02:50:36.924172 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt: {Name:mkc3c73f8df9f9535b8d099d7fad2f9ef490f009 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.924353 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key ...
I1122 02:50:36.924378 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key: {Name:mk6f92f51b27b058afc991ee860de62e505e9ae0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.924583 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:50:36.924627 315098 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:50:36.924638 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:50:36.924658 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:50:36.924685 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:50:36.924711 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:50:36.924751 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:50:36.925318 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:50:36.943860 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:50:36.960531 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:50:36.977735 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:50:36.995972 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I1122 02:50:37.012470 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:50:37.029824 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:50:37.047235 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:50:37.066342 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:50:37.086866 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:50:37.105215 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:50:37.123141 315098 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:50:37.135982 315098 ssh_runner.go:195] Run: openssl version
I1122 02:50:37.141767 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:50:37.149794 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:50:37.153339 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:50:37.153391 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:50:37.198060 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:50:37.208318 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:50:37.218941 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:50:37.223111 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:50:37.223160 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:50:37.265934 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:50:37.275038 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:50:37.284145 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.288972 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.289032 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.343896 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:50:37.354325 315098 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:50:37.358509 315098 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 02:50:37.358579 315098 kubeadm.go:401] StartCluster: {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:50:37.358663 315098 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:50:37.358718 315098 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:50:37.390769 315098 cri.go:89] found id: ""
I1122 02:50:37.390846 315098 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:50:37.399636 315098 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:50:37.407604 315098 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:50:37.407663 315098 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:50:37.416197 315098 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:50:37.416217 315098 kubeadm.go:158] found existing configuration files:
I1122 02:50:37.416267 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I1122 02:50:37.424540 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 02:50:37.424589 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 02:50:37.431634 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I1122 02:50:37.439743 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 02:50:37.439792 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 02:50:37.447625 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I1122 02:50:37.456980 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 02:50:37.457027 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 02:50:37.465751 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I1122 02:50:37.474227 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 02:50:37.474281 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 02:50:37.483638 315098 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:50:37.541603 315098 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 02:50:37.541698 315098 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:50:37.565569 315098 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:50:37.565702 315098 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:50:37.565781 315098 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:50:37.565856 315098 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:50:37.565959 315098 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:50:37.566036 315098 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:50:37.566115 315098 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:50:37.566220 315098 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:50:37.566315 315098 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:50:37.566394 315098 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:50:37.566462 315098 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:50:37.635568 315098 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:50:37.635719 315098 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:50:37.635845 315098 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 02:50:37.643735 315098 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
W1122 02:50:34.077285 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:36.576793 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:37.646548 315098 out.go:252] - Generating certificates and keys ...
I1122 02:50:37.646642 315098 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:50:37.646750 315098 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:50:37.681248 315098 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:50:37.894625 315098 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:50:38.078061 315098 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:50:38.584096 315098 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:50:39.167604 315098 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:50:39.167812 315098 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [default-k8s-diff-port-714134 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:50:39.231532 315098 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:50:39.231762 315098 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [default-k8s-diff-port-714134 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:50:39.706435 315098 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:50:39.829450 315098 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:50:39.952199 315098 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:50:39.952355 315098 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:50:40.051806 315098 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:50:40.327311 315098 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:50:40.403992 315098 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:50:40.579209 315098 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:50:40.628571 315098 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:50:40.629475 315098 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:50:40.634518 315098 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:50:37.217895 306384 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:50:37.222753 306384 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:50:37.222771 306384 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:50:37.236573 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:50:37.468611 306384 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:50:37.468681 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:37.468706 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-153115 minikube.k8s.io/updated_at=2025_11_22T02_50_37_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=embed-certs-153115 minikube.k8s.io/primary=true
I1122 02:50:37.480017 306384 ops.go:34] apiserver oom_adj: -16
I1122 02:50:37.562112 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:38.063293 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:38.562801 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:39.062943 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:39.563157 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.062847 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.562348 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:41.062956 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.636275 315098 out.go:252] - Booting up control plane ...
I1122 02:50:40.636410 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:50:40.636518 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:50:40.639119 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:50:40.657512 315098 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:50:40.657659 315098 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:50:40.665890 315098 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:50:40.666373 315098 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:50:40.666439 315098 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:50:40.792561 315098 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:50:40.792760 315098 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:50:41.794239 315098 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001667172s
I1122 02:50:41.798595 315098 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:50:41.798763 315098 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.94.2:8444/livez
I1122 02:50:41.798949 315098 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:50:41.799144 315098 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:50:41.562782 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:42.062916 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:42.151927 306384 kubeadm.go:1114] duration metric: took 4.683313074s to wait for elevateKubeSystemPrivileges
I1122 02:50:42.151965 306384 kubeadm.go:403] duration metric: took 18.242666356s to StartCluster
I1122 02:50:42.151994 306384 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:42.152074 306384 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:50:42.154398 306384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:42.154688 306384 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:50:42.154848 306384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:50:42.155159 306384 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:42.155204 306384 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:50:42.155280 306384 addons.go:70] Setting storage-provisioner=true in profile "embed-certs-153115"
I1122 02:50:42.155297 306384 addons.go:239] Setting addon storage-provisioner=true in "embed-certs-153115"
I1122 02:50:42.155323 306384 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:50:42.155406 306384 addons.go:70] Setting default-storageclass=true in profile "embed-certs-153115"
I1122 02:50:42.155430 306384 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-153115"
I1122 02:50:42.155778 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.155872 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.156873 306384 out.go:179] * Verifying Kubernetes components...
I1122 02:50:42.158001 306384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:42.187371 306384 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:50:42.187728 306384 addons.go:239] Setting addon default-storageclass=true in "embed-certs-153115"
I1122 02:50:42.187775 306384 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:50:42.188288 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.188761 306384 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:42.188818 306384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:50:42.188895 306384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:50:42.218345 306384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:50:42.221718 306384 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:42.221754 306384 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:50:42.221811 306384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:50:42.251481 306384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:50:42.291289 306384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:50:42.319729 306384 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:50:42.348219 306384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:42.367705 306384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:42.817842 306384 start.go:977] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I1122 02:50:42.819393 306384 node_ready.go:35] waiting up to 6m0s for node "embed-certs-153115" to be "Ready" ...
I1122 02:50:43.006446 306384 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
W1122 02:50:39.072639 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:41.572193 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:43.575027 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
==> CRI-O <==
Nov 22 02:50:33 no-preload-346270 crio[771]: time="2025-11-22T02:50:33.935133109Z" level=info msg="Starting container: 03ce20a033d3376ee1969e6c2818f7774bd7503dfaeb0ef113c69d5eef715782" id=6128fd21-8bf3-4906-b9c3-9e3bc685538f name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:33 no-preload-346270 crio[771]: time="2025-11-22T02:50:33.937729295Z" level=info msg="Started container" PID=2915 containerID=03ce20a033d3376ee1969e6c2818f7774bd7503dfaeb0ef113c69d5eef715782 description=kube-system/coredns-66bc5c9577-6tsqs/coredns id=6128fd21-8bf3-4906-b9c3-9e3bc685538f name=/runtime.v1.RuntimeService/StartContainer sandboxID=4711f38414fa0b7113f77162cf4ab7d2ee04d804438458ea4f1895b4bb051488
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.180313028Z" level=info msg="Running pod sandbox: default/busybox/POD" id=846b6bed-6c6e-41b6-8e9a-8188c9b01d29 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.180389145Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.185165133Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:52ed4013eb69a40ff3d381c44e42288fbd3efa28ffe2a3863048ebcdbb5a691a UID:ac002b55-1114-4073-9f4b-aa618203638d NetNS:/var/run/netns/c8793856-4751-4b66-8201-1b972dad52e3 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00051ac20}] Aliases:map[]}"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.185189678Z" level=info msg="Adding pod default_busybox to CNI network \"kindnet\" (type=ptp)"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.195321874Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:52ed4013eb69a40ff3d381c44e42288fbd3efa28ffe2a3863048ebcdbb5a691a UID:ac002b55-1114-4073-9f4b-aa618203638d NetNS:/var/run/netns/c8793856-4751-4b66-8201-1b972dad52e3 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00051ac20}] Aliases:map[]}"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.195444587Z" level=info msg="Checking pod default_busybox for CNI network kindnet (type=ptp)"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.196216348Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.19737611Z" level=info msg="Ran pod sandbox 52ed4013eb69a40ff3d381c44e42288fbd3efa28ffe2a3863048ebcdbb5a691a with infra container: default/busybox/POD" id=846b6bed-6c6e-41b6-8e9a-8188c9b01d29 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.198569666Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=8f350aa2-4a26-4655-a7e0-056fbf9c3908 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.198690927Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=8f350aa2-4a26-4655-a7e0-056fbf9c3908 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.198724295Z" level=info msg="Neither image nor artfiact gcr.io/k8s-minikube/busybox:1.28.4-glibc found" id=8f350aa2-4a26-4655-a7e0-056fbf9c3908 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.199330665Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=5d18e10b-b963-45a4-abd2-42a2f2ef3732 name=/runtime.v1.ImageService/PullImage
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.202783976Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28.4-glibc\""
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.870461023Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998" id=5d18e10b-b963-45a4-abd2-42a2f2ef3732 name=/runtime.v1.ImageService/PullImage
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.871116069Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=4c48d2ca-24bc-420a-8bb0-03e05a4be753 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.872602788Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=f0c8b29a-6332-411a-a3dd-103bedc90e49 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.875621185Z" level=info msg="Creating container: default/busybox/busybox" id=a9b61f53-2bc4-451c-ade4-45fcb2b38529 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.875756144Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.880271765Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.88064432Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.904408659Z" level=info msg="Created container b0ef528f2fb4b7cdfcfb2c6d14841e016984131c3c9f25d8004186d05eb88ea6: default/busybox/busybox" id=a9b61f53-2bc4-451c-ade4-45fcb2b38529 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.905031948Z" level=info msg="Starting container: b0ef528f2fb4b7cdfcfb2c6d14841e016984131c3c9f25d8004186d05eb88ea6" id=cabeab9e-90a7-456a-9704-d65bc5fe3257 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:36 no-preload-346270 crio[771]: time="2025-11-22T02:50:36.907426746Z" level=info msg="Started container" PID=2988 containerID=b0ef528f2fb4b7cdfcfb2c6d14841e016984131c3c9f25d8004186d05eb88ea6 description=default/busybox/busybox id=cabeab9e-90a7-456a-9704-d65bc5fe3257 name=/runtime.v1.RuntimeService/StartContainer sandboxID=52ed4013eb69a40ff3d381c44e42288fbd3efa28ffe2a3863048ebcdbb5a691a
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
b0ef528f2fb4b gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 8 seconds ago Running busybox 0 52ed4013eb69a busybox default
03ce20a033d33 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 11 seconds ago Running coredns 0 4711f38414fa0 coredns-66bc5c9577-6tsqs kube-system
83fce9472e796 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 11 seconds ago Running storage-provisioner 0 0377a0a480eda storage-provisioner kube-system
07f52d8c212d4 docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11 22 seconds ago Running kindnet-cni 0 9fb78de3b6c37 kindnet-8r9j8 kube-system
b2d7f461eede0 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 25 seconds ago Running kube-proxy 0 fc69bcdb6d5c9 kube-proxy-lpft6 kube-system
a9ed9f70ec5b8 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 36 seconds ago Running kube-scheduler 0 4299922b919d5 kube-scheduler-no-preload-346270 kube-system
0a5b2190b15c2 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 36 seconds ago Running kube-controller-manager 0 6c47de496295a kube-controller-manager-no-preload-346270 kube-system
6882cf6a47e6f 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 36 seconds ago Running etcd 0 2e02b230e3ce0 etcd-no-preload-346270 kube-system
4cf2108a59c91 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 36 seconds ago Running kube-apiserver 0 6193d8f4a52af kube-apiserver-no-preload-346270 kube-system
==> coredns [03ce20a033d3376ee1969e6c2818f7774bd7503dfaeb0ef113c69d5eef715782] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 66f0a748f44f6317a6b122af3f457c9dd0ecaed8718ffbf95a69434523efd9ec4992e71f54c7edd5753646fe9af89ac2138b9c3ce14d4a0ba9d2372a55f120bb
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:58265 - 36707 "HINFO IN 5487476437467875438.931339706030812981. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.500039568s
==> describe nodes <==
Name: no-preload-346270
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=no-preload-346270
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=no-preload-346270
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_14_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:11 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: no-preload-346270
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:50:44 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:50:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:50:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:50:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:50:44 +0000 Sat, 22 Nov 2025 02:50:33 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.103.2
Hostname: no-preload-346270
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: af672df9-348e-4762-9b18-ecdbaf28da25
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 10s
kube-system coredns-66bc5c9577-6tsqs 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 26s
kube-system etcd-no-preload-346270 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 31s
kube-system kindnet-8r9j8 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 26s
kube-system kube-apiserver-no-preload-346270 250m (3%) 0 (0%) 0 (0%) 0 (0%) 31s
kube-system kube-controller-manager-no-preload-346270 200m (2%) 0 (0%) 0 (0%) 0 (0%) 31s
kube-system kube-proxy-lpft6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 26s
kube-system kube-scheduler-no-preload-346270 100m (1%) 0 (0%) 0 (0%) 0 (0%) 31s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 25s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 25s kube-proxy
Normal Starting 32s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 31s kubelet Node no-preload-346270 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 31s kubelet Node no-preload-346270 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 31s kubelet Node no-preload-346270 status is now: NodeHasSufficientPID
Normal RegisteredNode 27s node-controller Node no-preload-346270 event: Registered Node no-preload-346270 in Controller
Normal NodeReady 12s kubelet Node no-preload-346270 status is now: NodeReady
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [6882cf6a47e6fd9e66825b62efe44a757a7b4e437d58b489f19aa526d8f68919] <==
{"level":"warn","ts":"2025-11-22T02:50:10.768835Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46710","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.776101Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46730","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.783676Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46758","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.791025Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46782","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.808891Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46804","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.815622Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46826","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:10.822880Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:46854","server-name":"","error":"EOF"}
{"level":"info","ts":"2025-11-22T02:50:13.297931Z","caller":"traceutil/trace.go:172","msg":"trace[2568164] transaction","detail":"{read_only:false; response_revision:204; number_of_response:1; }","duration":"146.117945ms","start":"2025-11-22T02:50:13.151734Z","end":"2025-11-22T02:50:13.297852Z","steps":["trace[2568164] 'process raft request' (duration: 145.92476ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:13.564462Z","caller":"traceutil/trace.go:172","msg":"trace[434501078] transaction","detail":"{read_only:false; response_revision:213; number_of_response:1; }","duration":"106.665512ms","start":"2025-11-22T02:50:13.457779Z","end":"2025-11-22T02:50:13.564444Z","steps":["trace[434501078] 'process raft request' (duration: 106.641381ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:13.564479Z","caller":"traceutil/trace.go:172","msg":"trace[1320186602] transaction","detail":"{read_only:false; response_revision:211; number_of_response:1; }","duration":"150.379206ms","start":"2025-11-22T02:50:13.414065Z","end":"2025-11-22T02:50:13.564444Z","steps":["trace[1320186602] 'process raft request' (duration: 129.553599ms)","trace[1320186602] 'compare' (duration: 20.66836ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:13.564527Z","caller":"traceutil/trace.go:172","msg":"trace[584041320] transaction","detail":"{read_only:false; response_revision:212; number_of_response:1; }","duration":"106.778275ms","start":"2025-11-22T02:50:13.457720Z","end":"2025-11-22T02:50:13.564499Z","steps":["trace[584041320] 'process raft request' (duration: 106.667252ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:15.203285Z","caller":"traceutil/trace.go:172","msg":"trace[1470437929] transaction","detail":"{read_only:false; response_revision:276; number_of_response:1; }","duration":"111.604858ms","start":"2025-11-22T02:50:15.091661Z","end":"2025-11-22T02:50:15.203266Z","steps":["trace[1470437929] 'process raft request' (duration: 111.572481ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:15.203323Z","caller":"traceutil/trace.go:172","msg":"trace[1851353955] transaction","detail":"{read_only:false; response_revision:275; number_of_response:1; }","duration":"132.610544ms","start":"2025-11-22T02:50:15.070695Z","end":"2025-11-22T02:50:15.203306Z","steps":["trace[1851353955] 'process raft request' (duration: 91.829396ms)","trace[1851353955] 'compare' (duration: 40.614486ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:15.354016Z","caller":"traceutil/trace.go:172","msg":"trace[1202798276] linearizableReadLoop","detail":"{readStateIndex:285; appliedIndex:285; }","duration":"111.962211ms","start":"2025-11-22T02:50:15.242020Z","end":"2025-11-22T02:50:15.353983Z","steps":["trace[1202798276] 'read index received' (duration: 111.951974ms)","trace[1202798276] 'applied index is now lower than readState.Index' (duration: 9.113µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:15.380535Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"138.491858ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/resourcequota-controller\" limit:1 ","response":"range_response_count:1 size:214"}
{"level":"info","ts":"2025-11-22T02:50:15.380612Z","caller":"traceutil/trace.go:172","msg":"trace[249099962] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/resourcequota-controller; range_end:; response_count:1; response_revision:276; }","duration":"138.581756ms","start":"2025-11-22T02:50:15.242013Z","end":"2025-11-22T02:50:15.380595Z","steps":["trace[249099962] 'agreement among raft nodes before linearized reading' (duration: 112.047554ms)","trace[249099962] 'range keys from in-memory index tree' (duration: 26.40487ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:15.380674Z","caller":"traceutil/trace.go:172","msg":"trace[609488359] transaction","detail":"{read_only:false; response_revision:277; number_of_response:1; }","duration":"166.984294ms","start":"2025-11-22T02:50:15.213671Z","end":"2025-11-22T02:50:15.380656Z","steps":["trace[609488359] 'process raft request' (duration: 140.359908ms)","trace[609488359] 'compare' (duration: 26.503684ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:15.519557Z","caller":"traceutil/trace.go:172","msg":"trace[1200885446] linearizableReadLoop","detail":"{readStateIndex:286; appliedIndex:286; }","duration":"122.641245ms","start":"2025-11-22T02:50:15.396886Z","end":"2025-11-22T02:50:15.519527Z","steps":["trace[1200885446] 'read index received' (duration: 122.632049ms)","trace[1200885446] 'applied index is now lower than readState.Index' (duration: 7.704µs)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:15.522202Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"125.294059ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/namespace-controller\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:50:15.522257Z","caller":"traceutil/trace.go:172","msg":"trace[2103108418] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/namespace-controller; range_end:; response_count:0; response_revision:277; }","duration":"125.365045ms","start":"2025-11-22T02:50:15.396878Z","end":"2025-11-22T02:50:15.522243Z","steps":["trace[2103108418] 'agreement among raft nodes before linearized reading' (duration: 122.749131ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:15.522596Z","caller":"traceutil/trace.go:172","msg":"trace[2088826054] transaction","detail":"{read_only:false; response_revision:278; number_of_response:1; }","duration":"130.664432ms","start":"2025-11-22T02:50:15.391921Z","end":"2025-11-22T02:50:15.522586Z","steps":["trace[2088826054] 'process raft request' (duration: 127.651333ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:15.674869Z","caller":"traceutil/trace.go:172","msg":"trace[1902499027] transaction","detail":"{read_only:false; response_revision:280; number_of_response:1; }","duration":"141.377547ms","start":"2025-11-22T02:50:15.533472Z","end":"2025-11-22T02:50:15.674849Z","steps":["trace[1902499027] 'process raft request' (duration: 141.308448ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:15.674927Z","caller":"traceutil/trace.go:172","msg":"trace[1042247050] transaction","detail":"{read_only:false; response_revision:279; number_of_response:1; }","duration":"146.399884ms","start":"2025-11-22T02:50:15.528494Z","end":"2025-11-22T02:50:15.674894Z","steps":["trace[1042247050] 'process raft request' (duration: 110.156833ms)","trace[1042247050] 'compare' (duration: 35.932808ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:15.827003Z","caller":"traceutil/trace.go:172","msg":"trace[30564450] transaction","detail":"{read_only:false; response_revision:281; number_of_response:1; }","duration":"136.101955ms","start":"2025-11-22T02:50:15.690885Z","end":"2025-11-22T02:50:15.826987Z","steps":["trace[30564450] 'process raft request' (duration: 135.97847ms)"],"step_count":1}
{"level":"info","ts":"2025-11-22T02:50:16.404511Z","caller":"traceutil/trace.go:172","msg":"trace[2091393716] transaction","detail":"{read_only:false; response_revision:284; number_of_response:1; }","duration":"112.294578ms","start":"2025-11-22T02:50:16.292197Z","end":"2025-11-22T02:50:16.404492Z","steps":["trace[2091393716] 'process raft request' (duration: 112.169858ms)"],"step_count":1}
==> kernel <==
02:50:45 up 1:33, 0 user, load average: 6.72, 3.99, 2.24
Linux no-preload-346270 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [07f52d8c212d4e98b8f66b7517f3a3d31ed2b7fb99899ab60e380e9f48fa8258] <==
I1122 02:50:22.971269 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:50:22.971529 1 main.go:139] hostIP = 192.168.103.2
podIP = 192.168.103.2
I1122 02:50:22.971690 1 main.go:148] setting mtu 1500 for CNI
I1122 02:50:22.971709 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:50:22.971722 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:50:23Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:50:23.268113 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:50:23.269352 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:50:23.269373 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:50:23.269513 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:50:23.669602 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:50:23.669651 1 metrics.go:72] Registering metrics
I1122 02:50:23.669717 1 controller.go:711] "Syncing nftables rules"
I1122 02:50:33.179688 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:50:33.179781 1 main.go:301] handling current node
I1122 02:50:43.183010 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:50:43.183051 1 main.go:301] handling current node
==> kube-apiserver [4cf2108a59c918bab5e1f0f54ea2c5fe3b70bcec8a34461c4fa1340781cec2a2] <==
I1122 02:50:11.412979 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:50:11.417406 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:11.417941 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:50:11.418463 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:50:11.425527 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:11.425893 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:50:11.436446 1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
I1122 02:50:12.314101 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:50:12.319015 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:50:12.319030 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:50:12.841932 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:50:12.887839 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:50:13.147593 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:50:13.380355 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.103.2]
I1122 02:50:13.381887 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:50:13.383586 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:50:13.413619 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:50:13.935987 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:50:13.954059 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:50:13.970091 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:50:18.499672 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:18.505528 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:19.047247 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:50:19.097531 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
E1122 02:50:43.998674 1 conn.go:339] Error on socket receive: read tcp 192.168.103.2:8443->192.168.103.1:39082: use of closed network connection
==> kube-controller-manager [0a5b2190b15c289c6686d5c88bc0d91008bc41bfe315856181663116c6971c08] <==
I1122 02:50:18.341758 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:50:18.342353 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:50:18.343509 1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
I1122 02:50:18.343649 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:50:18.343753 1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
I1122 02:50:18.344694 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:50:18.344727 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:50:18.345815 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:50:18.345841 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:50:18.345965 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:50:18.346111 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:50:18.347200 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:50:18.348351 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:50:18.349534 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:50:18.349588 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:50:18.349662 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:50:18.349796 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:50:18.352924 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:50:18.361039 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:50:18.361205 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:50:18.361296 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="no-preload-346270"
I1122 02:50:18.361354 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:50:18.366543 1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
I1122 02:50:18.371834 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:50:38.365662 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [b2d7f461eede023ce9bd2b4507b95dedce894bd3ca161801c258e5c5f02199a4] <==
I1122 02:50:20.161277 1 server_linux.go:53] "Using iptables proxy"
I1122 02:50:20.236620 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:50:20.337499 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:50:20.337541 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.103.2"]
E1122 02:50:20.337653 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:50:20.363611 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:50:20.363761 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:50:20.371168 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:50:20.371631 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:50:20.371672 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:20.373505 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:50:20.373530 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:50:20.373558 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:50:20.373563 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:50:20.373559 1 config.go:200] "Starting service config controller"
I1122 02:50:20.373581 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:50:20.373644 1 config.go:309] "Starting node config controller"
I1122 02:50:20.373652 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:50:20.373659 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:50:20.473735 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:50:20.473766 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:50:20.473788 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [a9ed9f70ec5b850f84b242685f63433628ed32cf49cb7815868a773c9cf7e4d0] <==
E1122 02:50:11.381465 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:50:11.381556 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:50:11.381614 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:50:11.381646 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:50:11.381669 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:50:11.382070 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:50:11.382082 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:50:11.382422 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:50:11.382705 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:50:11.383096 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:50:11.383181 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:50:11.384223 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:50:11.384253 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:50:12.200158 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:50:12.226445 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:50:12.297489 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:50:12.303692 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:50:12.444067 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:50:12.460370 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:50:12.481084 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:50:12.578448 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:50:12.591864 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:50:12.602119 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:50:12.654441 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
I1122 02:50:15.077258 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:50:18 no-preload-346270 kubelet[2317]: I1122 02:50:18.320503 2317 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164056 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0bf01fd-546e-443d-88e5-cc692a85fd0e-lib-modules\") pod \"kube-proxy-lpft6\" (UID: \"f0bf01fd-546e-443d-88e5-cc692a85fd0e\") " pod="kube-system/kube-proxy-lpft6"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164113 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0619fa0d-b73c-464f-95c7-c91c3e277fd0-lib-modules\") pod \"kindnet-8r9j8\" (UID: \"0619fa0d-b73c-464f-95c7-c91c3e277fd0\") " pod="kube-system/kindnet-8r9j8"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164141 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/f0bf01fd-546e-443d-88e5-cc692a85fd0e-kube-proxy\") pod \"kube-proxy-lpft6\" (UID: \"f0bf01fd-546e-443d-88e5-cc692a85fd0e\") " pod="kube-system/kube-proxy-lpft6"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164162 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/f0bf01fd-546e-443d-88e5-cc692a85fd0e-xtables-lock\") pod \"kube-proxy-lpft6\" (UID: \"f0bf01fd-546e-443d-88e5-cc692a85fd0e\") " pod="kube-system/kube-proxy-lpft6"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164187 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpds9\" (UniqueName: \"kubernetes.io/projected/f0bf01fd-546e-443d-88e5-cc692a85fd0e-kube-api-access-bpds9\") pod \"kube-proxy-lpft6\" (UID: \"f0bf01fd-546e-443d-88e5-cc692a85fd0e\") " pod="kube-system/kube-proxy-lpft6"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164213 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/0619fa0d-b73c-464f-95c7-c91c3e277fd0-cni-cfg\") pod \"kindnet-8r9j8\" (UID: \"0619fa0d-b73c-464f-95c7-c91c3e277fd0\") " pod="kube-system/kindnet-8r9j8"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164242 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/0619fa0d-b73c-464f-95c7-c91c3e277fd0-xtables-lock\") pod \"kindnet-8r9j8\" (UID: \"0619fa0d-b73c-464f-95c7-c91c3e277fd0\") " pod="kube-system/kindnet-8r9j8"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: I1122 02:50:19.164262 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksdx\" (UniqueName: \"kubernetes.io/projected/0619fa0d-b73c-464f-95c7-c91c3e277fd0-kube-api-access-pksdx\") pod \"kindnet-8r9j8\" (UID: \"0619fa0d-b73c-464f-95c7-c91c3e277fd0\") " pod="kube-system/kindnet-8r9j8"
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.270975 2317 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.271015 2317 projected.go:196] Error preparing data for projected volume kube-api-access-pksdx for pod kube-system/kindnet-8r9j8: configmap "kube-root-ca.crt" not found
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.271108 2317 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0619fa0d-b73c-464f-95c7-c91c3e277fd0-kube-api-access-pksdx podName:0619fa0d-b73c-464f-95c7-c91c3e277fd0 nodeName:}" failed. No retries permitted until 2025-11-22 02:50:19.771078557 +0000 UTC m=+5.949365669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pksdx" (UniqueName: "kubernetes.io/projected/0619fa0d-b73c-464f-95c7-c91c3e277fd0-kube-api-access-pksdx") pod "kindnet-8r9j8" (UID: "0619fa0d-b73c-464f-95c7-c91c3e277fd0") : configmap "kube-root-ca.crt" not found
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.271419 2317 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.271452 2317 projected.go:196] Error preparing data for projected volume kube-api-access-bpds9 for pod kube-system/kube-proxy-lpft6: configmap "kube-root-ca.crt" not found
Nov 22 02:50:19 no-preload-346270 kubelet[2317]: E1122 02:50:19.271520 2317 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0bf01fd-546e-443d-88e5-cc692a85fd0e-kube-api-access-bpds9 podName:f0bf01fd-546e-443d-88e5-cc692a85fd0e nodeName:}" failed. No retries permitted until 2025-11-22 02:50:19.771505213 +0000 UTC m=+5.949792307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bpds9" (UniqueName: "kubernetes.io/projected/f0bf01fd-546e-443d-88e5-cc692a85fd0e-kube-api-access-bpds9") pod "kube-proxy-lpft6" (UID: "f0bf01fd-546e-443d-88e5-cc692a85fd0e") : configmap "kube-root-ca.crt" not found
Nov 22 02:50:23 no-preload-346270 kubelet[2317]: I1122 02:50:23.029520 2317 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-lpft6" podStartSLOduration=4.029497551 podStartE2EDuration="4.029497551s" podCreationTimestamp="2025-11-22 02:50:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:21.035218791 +0000 UTC m=+7.213505903" watchObservedRunningTime="2025-11-22 02:50:23.029497551 +0000 UTC m=+9.207784665"
Nov 22 02:50:25 no-preload-346270 kubelet[2317]: I1122 02:50:25.527535 2317 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-8r9j8" podStartSLOduration=3.919499201 podStartE2EDuration="6.527514109s" podCreationTimestamp="2025-11-22 02:50:19 +0000 UTC" firstStartedPulling="2025-11-22 02:50:20.046644045 +0000 UTC m=+6.224931155" lastFinishedPulling="2025-11-22 02:50:22.654658966 +0000 UTC m=+8.832946063" observedRunningTime="2025-11-22 02:50:23.029812703 +0000 UTC m=+9.208099810" watchObservedRunningTime="2025-11-22 02:50:25.527514109 +0000 UTC m=+11.705801222"
Nov 22 02:50:33 no-preload-346270 kubelet[2317]: I1122 02:50:33.544329 2317 kubelet_node_status.go:439] "Fast updating node status as it just became ready"
Nov 22 02:50:33 no-preload-346270 kubelet[2317]: I1122 02:50:33.661812 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d8b5acd-6ff5-401d-b10b-b0215610f89f-config-volume\") pod \"coredns-66bc5c9577-6tsqs\" (UID: \"1d8b5acd-6ff5-401d-b10b-b0215610f89f\") " pod="kube-system/coredns-66bc5c9577-6tsqs"
Nov 22 02:50:33 no-preload-346270 kubelet[2317]: I1122 02:50:33.661852 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28p9q\" (UniqueName: \"kubernetes.io/projected/1d8b5acd-6ff5-401d-b10b-b0215610f89f-kube-api-access-28p9q\") pod \"coredns-66bc5c9577-6tsqs\" (UID: \"1d8b5acd-6ff5-401d-b10b-b0215610f89f\") " pod="kube-system/coredns-66bc5c9577-6tsqs"
Nov 22 02:50:33 no-preload-346270 kubelet[2317]: I1122 02:50:33.661876 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/5193d7c1-5d53-41ed-9565-77394f13c055-tmp\") pod \"storage-provisioner\" (UID: \"5193d7c1-5d53-41ed-9565-77394f13c055\") " pod="kube-system/storage-provisioner"
Nov 22 02:50:33 no-preload-346270 kubelet[2317]: I1122 02:50:33.661890 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwhdx\" (UniqueName: \"kubernetes.io/projected/5193d7c1-5d53-41ed-9565-77394f13c055-kube-api-access-fwhdx\") pod \"storage-provisioner\" (UID: \"5193d7c1-5d53-41ed-9565-77394f13c055\") " pod="kube-system/storage-provisioner"
Nov 22 02:50:34 no-preload-346270 kubelet[2317]: I1122 02:50:34.057455 2317 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-66bc5c9577-6tsqs" podStartSLOduration=15.057437947 podStartE2EDuration="15.057437947s" podCreationTimestamp="2025-11-22 02:50:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:34.057358334 +0000 UTC m=+20.235645449" watchObservedRunningTime="2025-11-22 02:50:34.057437947 +0000 UTC m=+20.235725057"
Nov 22 02:50:34 no-preload-346270 kubelet[2317]: I1122 02:50:34.083736 2317 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=14.08371442 podStartE2EDuration="14.08371442s" podCreationTimestamp="2025-11-22 02:50:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:34.083647248 +0000 UTC m=+20.261934358" watchObservedRunningTime="2025-11-22 02:50:34.08371442 +0000 UTC m=+20.262001533"
Nov 22 02:50:35 no-preload-346270 kubelet[2317]: I1122 02:50:35.978240 2317 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5stg8\" (UniqueName: \"kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8\") pod \"busybox\" (UID: \"ac002b55-1114-4073-9f4b-aa618203638d\") " pod="default/busybox"
==> storage-provisioner [83fce9472e7963d0d698bfbc98a06e841f76c1b9c85c2ed3b4b8bf601ce2e920] <==
I1122 02:50:33.937285 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:50:33.981171 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:50:33.981229 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:50:33.995687 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:34.015414 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:50:34.015574 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:50:34.015788 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_no-preload-346270_1c5dc36a-427b-4a77-9ba1-16d913ca9383!
I1122 02:50:34.017048 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"06e06c79-3e66-4bb5-bae4-81392e4b06e3", APIVersion:"v1", ResourceVersion:"412", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' no-preload-346270_1c5dc36a-427b-4a77-9ba1-16d913ca9383 became leader
W1122 02:50:34.029892 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:34.039088 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:50:34.115938 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_no-preload-346270_1c5dc36a-427b-4a77-9ba1-16d913ca9383!
W1122 02:50:36.043190 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:36.047292 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:38.051175 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:38.056375 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:40.059874 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:40.064449 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:42.068513 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:42.073448 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:44.079238 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:44.085308 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-346270 -n no-preload-346270
helpers_test.go:269: (dbg) Run: kubectl --context no-preload-346270 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/no-preload/serial/EnableAddonWhileActive FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (2.32s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 11 (232.464607ms)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:03Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:205: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 11
start_stop_delete_test.go:213: (dbg) Run: kubectl --context embed-certs-153115 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:213: (dbg) Non-zero exit: kubectl --context embed-certs-153115 describe deploy/metrics-server -n kube-system: exit status 1 (56.800551ms)
** stderr **
Error from server (NotFound): deployments.apps "metrics-server" not found
** /stderr **
start_stop_delete_test.go:215: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-153115 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:219: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonWhileActive]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonWhileActive]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect embed-certs-153115
helpers_test.go:243: (dbg) docker inspect embed-certs-153115:
-- stdout --
[
{
"Id": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"Created": "2025-11-22T02:50:16.676230577Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 309252,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:50:16.713276066Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hostname",
"HostsPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hosts",
"LogPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06-json.log",
"Name": "/embed-certs-153115",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"embed-certs-153115:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "embed-certs-153115",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"LowerDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/merged",
"UpperDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/diff",
"WorkDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "embed-certs-153115",
"Source": "/var/lib/docker/volumes/embed-certs-153115/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "embed-certs-153115",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "embed-certs-153115",
"name.minikube.sigs.k8s.io": "embed-certs-153115",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "81401f61c1a0c8ad099f105d65b98324ac8a8026c9673499fba752ae13c39879",
"SandboxKey": "/var/run/docker/netns/81401f61c1a0",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33103"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33104"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33107"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33105"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33106"
}
]
},
"Networks": {
"embed-certs-153115": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "96385b2a616941eaa4a4f540716b0a7c31f3fc2f2233964a08277eb14959d0b5",
"EndpointID": "492484b170a948a0c7db3b78959ffb46716eabb957ce1f77ba1a07d70ecbd80d",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"MacAddress": "fe:b5:30:3a:d9:0a",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"embed-certs-153115",
"6f7324ecba93"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:252: <<< TestStartStop/group/embed-certs/serial/EnableAddonWhileActive FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonWhileActive]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-153115 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-153115 logs -n 25: (1.058025921s)
helpers_test.go:260: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p bridge-430524 sudo cat /var/lib/kubelet/config.yaml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status docker --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/docker/daemon.json │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo docker system info │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl status cri-docker --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat cri-docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cri-dockerd --version │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status containerd --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat containerd --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /lib/systemd/system/containerd.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/containerd/config.toml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo containerd config dump │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status crio --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:50:26
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:50:26.848347 315098 out.go:360] Setting OutFile to fd 1 ...
I1122 02:50:26.848640 315098 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:50:26.848650 315098 out.go:374] Setting ErrFile to fd 2...
I1122 02:50:26.848654 315098 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:50:26.848821 315098 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:50:26.849257 315098 out.go:368] Setting JSON to false
I1122 02:50:26.850551 315098 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5570,"bootTime":1763774257,"procs":320,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:50:26.850635 315098 start.go:143] virtualization: kvm guest
I1122 02:50:26.852472 315098 out.go:179] * [default-k8s-diff-port-714134] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:50:26.853579 315098 notify.go:221] Checking for updates...
I1122 02:50:26.853597 315098 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:50:26.854607 315098 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:50:26.856507 315098 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:50:26.857670 315098 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:50:26.858826 315098 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:50:26.859863 315098 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:50:26.861360 315098 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:26.861445 315098 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:26.861513 315098 config.go:182] Loaded profile config "old-k8s-version-169878": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:50:26.861592 315098 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:50:26.884507 315098 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:50:26.884592 315098 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:50:26.942382 315098 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:50:26.932937737 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:50:26.942485 315098 docker.go:319] overlay module found
I1122 02:50:26.943998 315098 out.go:179] * Using the docker driver based on user configuration
I1122 02:50:26.945094 315098 start.go:309] selected driver: docker
I1122 02:50:26.945109 315098 start.go:927] validating driver "docker" against <nil>
I1122 02:50:26.945120 315098 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:50:26.945738 315098 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:50:27.003451 315098 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:50:26.993578305 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:50:27.003702 315098 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 02:50:27.004011 315098 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:27.005439 315098 out.go:179] * Using Docker driver with root privileges
I1122 02:50:27.006575 315098 cni.go:84] Creating CNI manager for ""
I1122 02:50:27.006644 315098 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:27.006656 315098 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1122 02:50:27.006725 315098 start.go:353] cluster config:
{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SS
HAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:50:27.008021 315098 out.go:179] * Starting "default-k8s-diff-port-714134" primary control-plane node in "default-k8s-diff-port-714134" cluster
I1122 02:50:27.009048 315098 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:50:27.010103 315098 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:50:27.011139 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:27.011180 315098 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:50:27.011202 315098 cache.go:65] Caching tarball of preloaded images
I1122 02:50:27.011215 315098 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:50:27.011334 315098 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:50:27.011348 315098 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:50:27.011457 315098 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:50:27.011479 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json: {Name:mk704ce29f32d27f3ff4cb55748afe3b9293cc3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:27.031436 315098 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:50:27.031458 315098 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:50:27.031474 315098 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:50:27.031496 315098 start.go:360] acquireMachinesLock for default-k8s-diff-port-714134: {Name:mk7e1a12e2fa8aced0c98248f29bf8f0364ff72a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:50:27.031576 315098 start.go:364] duration metric: took 65.607µs to acquireMachinesLock for "default-k8s-diff-port-714134"
I1122 02:50:27.031596 315098 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default API
ServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:50:27.031650 315098 start.go:125] createHost starting for "" (driver="docker")
W1122 02:50:24.478498 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:26.976879 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
I1122 02:50:25.033378 307742 addons.go:530] duration metric: took 2.942014044s for enable addons: enabled=[storage-provisioner default-storageclass dashboard]
I1122 02:50:25.035530 307742 system_pods.go:59] 8 kube-system pods found
I1122 02:50:25.035567 307742 system_pods.go:61] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:25.035580 307742 system_pods.go:61] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:50:25.035591 307742 system_pods.go:61] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:50:25.035605 307742 system_pods.go:61] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:50:25.035615 307742 system_pods.go:61] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:50:25.035626 307742 system_pods.go:61] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:50:25.035637 307742 system_pods.go:61] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:50:25.035648 307742 system_pods.go:61] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:25.035661 307742 system_pods.go:74] duration metric: took 3.548505ms to wait for pod list to return data ...
I1122 02:50:25.035673 307742 default_sa.go:34] waiting for default service account to be created ...
I1122 02:50:25.037558 307742 default_sa.go:45] found service account: "default"
I1122 02:50:25.037576 307742 default_sa.go:55] duration metric: took 1.895851ms for default service account to be created ...
I1122 02:50:25.037584 307742 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:50:25.042102 307742 system_pods.go:86] 8 kube-system pods found
I1122 02:50:25.042129 307742 system_pods.go:89] "coredns-5dd5756b68-fkcs9" [234a7a20-53b3-4947-a441-5b20e73cf1e3] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:25.042139 307742 system_pods.go:89] "etcd-old-k8s-version-169878" [e2e2b01d-24dc-4e19-a71c-77c9fe460312] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:50:25.042149 307742 system_pods.go:89] "kindnet-ptwwj" [e24d6a8c-25a7-45e0-bf9c-6f1d99eded18] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:50:25.042157 307742 system_pods.go:89] "kube-apiserver-old-k8s-version-169878" [ad08d488-3f8a-4c31-a841-8002697a815b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:50:25.042169 307742 system_pods.go:89] "kube-controller-manager-old-k8s-version-169878" [5db13b54-aa01-4b4e-bb66-a88ca1b6b3ec] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:50:25.042188 307742 system_pods.go:89] "kube-proxy-c7nnb" [69af4f1c-8e74-47be-946b-fc73abf50d39] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:50:25.042199 307742 system_pods.go:89] "kube-scheduler-old-k8s-version-169878" [07137f2d-fb93-495d-8fc0-cf5e9fff419a] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:50:25.042207 307742 system_pods.go:89] "storage-provisioner" [5a92e00b-ff3b-42cc-abf1-b24411df7bb4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:25.042219 307742 system_pods.go:126] duration metric: took 4.628246ms to wait for k8s-apps to be running ...
I1122 02:50:25.042227 307742 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:50:25.042271 307742 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:50:25.055827 307742 system_svc.go:56] duration metric: took 13.5969ms WaitForService to wait for kubelet
I1122 02:50:25.055849 307742 kubeadm.go:587] duration metric: took 2.963623312s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:25.055870 307742 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:50:25.057696 307742 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:50:25.057716 307742 node_conditions.go:123] node cpu capacity is 8
I1122 02:50:25.057728 307742 node_conditions.go:105] duration metric: took 1.852913ms to run NodePressure ...
I1122 02:50:25.057738 307742 start.go:242] waiting for startup goroutines ...
I1122 02:50:25.057755 307742 start.go:247] waiting for cluster config update ...
I1122 02:50:25.057773 307742 start.go:256] writing updated cluster config ...
I1122 02:50:25.058039 307742 ssh_runner.go:195] Run: rm -f paused
I1122 02:50:25.061583 307742 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:25.065438 307742 pod_ready.go:83] waiting for pod "coredns-5dd5756b68-fkcs9" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:50:27.071253 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:27.033313 315098 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1122 02:50:27.033524 315098 start.go:159] libmachine.API.Create for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:50:27.033559 315098 client.go:173] LocalClient.Create starting
I1122 02:50:27.033616 315098 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem
I1122 02:50:27.033645 315098 main.go:143] libmachine: Decoding PEM data...
I1122 02:50:27.033661 315098 main.go:143] libmachine: Parsing certificate...
I1122 02:50:27.033730 315098 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem
I1122 02:50:27.033751 315098 main.go:143] libmachine: Decoding PEM data...
I1122 02:50:27.033758 315098 main.go:143] libmachine: Parsing certificate...
I1122 02:50:27.034095 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:50:27.050483 315098 cli_runner.go:211] docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:50:27.050549 315098 network_create.go:284] running [docker network inspect default-k8s-diff-port-714134] to gather additional debugging logs...
I1122 02:50:27.050567 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134
W1122 02:50:27.067558 315098 cli_runner.go:211] docker network inspect default-k8s-diff-port-714134 returned with exit code 1
I1122 02:50:27.067598 315098 network_create.go:287] error running [docker network inspect default-k8s-diff-port-714134]: docker network inspect default-k8s-diff-port-714134: exit status 1
stdout:
[]
stderr:
Error response from daemon: network default-k8s-diff-port-714134 not found
I1122 02:50:27.067616 315098 network_create.go:289] output of [docker network inspect default-k8s-diff-port-714134]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network default-k8s-diff-port-714134 not found
** /stderr **
I1122 02:50:27.067755 315098 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:50:27.085758 315098 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:50:27.086582 315098 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9423c3ade39b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:8e:36:bc:4b:d9:05} reservation:<nil>}
I1122 02:50:27.087523 315098 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-49270bd849d0 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:2a:04:6a:68:04:12} reservation:<nil>}
I1122 02:50:27.088464 315098 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-96385b2a6169 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:a6:7a:19:52:83:96} reservation:<nil>}
I1122 02:50:27.089175 315098 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-37299b5114cb IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:76:db:27:16:0e:a6} reservation:<nil>}
I1122 02:50:27.090198 315098 network.go:206] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001f7f6d0}
I1122 02:50:27.090228 315098 network_create.go:124] attempt to create docker network default-k8s-diff-port-714134 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
I1122 02:50:27.090272 315098 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 default-k8s-diff-port-714134
I1122 02:50:27.138184 315098 network_create.go:108] docker network default-k8s-diff-port-714134 192.168.94.0/24 created
I1122 02:50:27.138214 315098 kic.go:121] calculated static IP "192.168.94.2" for the "default-k8s-diff-port-714134" container
I1122 02:50:27.138285 315098 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1122 02:50:27.155804 315098 cli_runner.go:164] Run: docker volume create default-k8s-diff-port-714134 --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --label created_by.minikube.sigs.k8s.io=true
I1122 02:50:27.174548 315098 oci.go:103] Successfully created a docker volume default-k8s-diff-port-714134
I1122 02:50:27.174629 315098 cli_runner.go:164] Run: docker run --rm --name default-k8s-diff-port-714134-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --entrypoint /usr/bin/test -v default-k8s-diff-port-714134:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -d /var/lib
I1122 02:50:27.554984 315098 oci.go:107] Successfully prepared a docker volume default-k8s-diff-port-714134
I1122 02:50:27.555079 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:27.555107 315098 kic.go:194] Starting extracting preloaded images to volume ...
I1122 02:50:27.555181 315098 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-714134:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir
I1122 02:50:31.647569 315098 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-714134:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a -I lz4 -xf /preloaded.tar -C /extractDir: (4.09234183s)
I1122 02:50:31.647617 315098 kic.go:203] duration metric: took 4.092504318s to extract preloaded images to volume ...
W1122 02:50:31.647696 315098 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1122 02:50:31.647737 315098 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1122 02:50:31.647790 315098 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1122 02:50:31.721746 315098 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname default-k8s-diff-port-714134 --name default-k8s-diff-port-714134 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=default-k8s-diff-port-714134 --network default-k8s-diff-port-714134 --ip 192.168.94.2 --volume default-k8s-diff-port-714134:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8444 --publish=127.0.0.1::8444 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a
W1122 02:50:28.978553 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:31.476276 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:33.476895 296853 node_ready.go:57] node "no-preload-346270" has "Ready":"False" status (will retry)
W1122 02:50:29.571113 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:31.600503 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:32.083987 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Running}}
I1122 02:50:32.106410 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.128590 315098 cli_runner.go:164] Run: docker exec default-k8s-diff-port-714134 stat /var/lib/dpkg/alternatives/iptables
I1122 02:50:32.182124 315098 oci.go:144] the created container "default-k8s-diff-port-714134" has a running status.
I1122 02:50:32.182180 315098 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa...
I1122 02:50:32.408102 315098 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1122 02:50:32.446843 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.470136 315098 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1122 02:50:32.470207 315098 kic_runner.go:114] Args: [docker exec --privileged default-k8s-diff-port-714134 chown docker:docker /home/docker/.ssh/authorized_keys]
I1122 02:50:32.529940 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:32.551517 315098 machine.go:94] provisionDockerMachine start ...
I1122 02:50:32.551616 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.574257 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.574587 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.574603 315098 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:50:32.716913 315098 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:50:32.716966 315098 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-714134"
I1122 02:50:32.717064 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.737826 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.738155 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.738174 315098 main.go:143] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-714134 && echo "default-k8s-diff-port-714134" | sudo tee /etc/hostname
I1122 02:50:32.885155 315098 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:50:32.885231 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:32.903931 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:32.904172 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:32.904192 315098 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-714134' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-714134/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-714134' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:50:33.037443 315098 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:50:33.037493 315098 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:50:33.037517 315098 ubuntu.go:190] setting up certificates
I1122 02:50:33.037541 315098 provision.go:84] configureAuth start
I1122 02:50:33.037609 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:33.059191 315098 provision.go:143] copyHostCerts
I1122 02:50:33.059272 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:50:33.059290 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:50:33.059382 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:50:33.059577 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:50:33.059603 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:50:33.059666 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:50:33.059773 315098 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:50:33.059787 315098 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:50:33.059837 315098 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:50:33.059932 315098 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-714134 san=[127.0.0.1 192.168.94.2 default-k8s-diff-port-714134 localhost minikube]
I1122 02:50:33.243427 315098 provision.go:177] copyRemoteCerts
I1122 02:50:33.243500 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:50:33.243557 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.266613 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:33.369323 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:50:33.390458 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1122 02:50:33.410880 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1122 02:50:33.429722 315098 provision.go:87] duration metric: took 392.167443ms to configureAuth
I1122 02:50:33.429746 315098 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:50:33.429965 315098 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:33.430080 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.450371 315098 main.go:143] libmachine: Using SSH client type: native
I1122 02:50:33.450649 315098 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33108 <nil> <nil>}
I1122 02:50:33.450668 315098 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:50:33.753998 315098 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:50:33.754025 315098 machine.go:97] duration metric: took 1.202485265s to provisionDockerMachine
I1122 02:50:33.754035 315098 client.go:176] duration metric: took 6.720468328s to LocalClient.Create
I1122 02:50:33.754053 315098 start.go:167] duration metric: took 6.720531764s to libmachine.API.Create "default-k8s-diff-port-714134"
I1122 02:50:33.754061 315098 start.go:293] postStartSetup for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:50:33.754070 315098 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:50:33.754131 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:50:33.754167 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.773779 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:33.886703 315098 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:50:33.892651 315098 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:50:33.892688 315098 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:50:33.892700 315098 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:50:33.892756 315098 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:50:33.892856 315098 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:50:33.893019 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:50:33.902469 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:50:33.926557 315098 start.go:296] duration metric: took 172.480679ms for postStartSetup
I1122 02:50:33.927002 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:33.955872 315098 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:50:33.957098 315098 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:50:33.957151 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:33.992754 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.100750 315098 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:50:34.104950 315098 start.go:128] duration metric: took 7.073286131s to createHost
I1122 02:50:34.104974 315098 start.go:83] releasing machines lock for "default-k8s-diff-port-714134", held for 7.073387142s
I1122 02:50:34.105032 315098 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:50:34.122755 315098 ssh_runner.go:195] Run: cat /version.json
I1122 02:50:34.122795 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:34.122829 315098 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:50:34.122898 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:34.142933 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.142967 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:34.306053 315098 ssh_runner.go:195] Run: systemctl --version
I1122 02:50:34.312427 315098 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:50:34.345957 315098 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:50:34.350194 315098 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:50:34.350254 315098 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:50:34.374074 315098 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1122 02:50:34.374098 315098 start.go:496] detecting cgroup driver to use...
I1122 02:50:34.374131 315098 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:50:34.374172 315098 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:50:34.389120 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:50:34.400738 315098 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:50:34.400777 315098 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:50:34.416000 315098 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:50:34.431896 315098 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:50:34.515612 315098 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:50:34.604440 315098 docker.go:234] disabling docker service ...
I1122 02:50:34.604498 315098 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:50:34.621611 315098 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:50:34.633170 315098 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:50:34.715361 315098 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:50:34.792250 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:50:34.803629 315098 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:50:34.816784 315098 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:50:34.816842 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.826407 315098 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:50:34.826461 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.834550 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.842615 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.850463 315098 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:50:34.857737 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.865385 315098 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.877972 315098 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:50:34.886563 315098 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:50:34.893346 315098 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:50:34.900147 315098 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:34.996506 315098 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:50:35.150709 315098 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:50:35.150780 315098 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:50:35.155372 315098 start.go:564] Will wait 60s for crictl version
I1122 02:50:35.155428 315098 ssh_runner.go:195] Run: which crictl
I1122 02:50:35.159552 315098 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:50:35.187317 315098 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:50:35.187396 315098 ssh_runner.go:195] Run: crio --version
I1122 02:50:35.218554 315098 ssh_runner.go:195] Run: crio --version
I1122 02:50:35.253000 315098 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:50:33.976848 296853 node_ready.go:49] node "no-preload-346270" is "Ready"
I1122 02:50:33.976979 296853 node_ready.go:38] duration metric: took 14.003711927s for node "no-preload-346270" to be "Ready" ...
I1122 02:50:33.977007 296853 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:50:33.977092 296853 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:50:33.995822 296853 api_server.go:72] duration metric: took 14.44805929s to wait for apiserver process to appear ...
I1122 02:50:33.995883 296853 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:50:33.995953 296853 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:50:34.010817 296853 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:50:34.012236 296853 api_server.go:141] control plane version: v1.34.1
I1122 02:50:34.012321 296853 api_server.go:131] duration metric: took 16.400016ms to wait for apiserver health ...
I1122 02:50:34.012356 296853 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:50:34.018455 296853 system_pods.go:59] 8 kube-system pods found
I1122 02:50:34.018492 296853 system_pods.go:61] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:34.018500 296853 system_pods.go:61] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running
I1122 02:50:34.018507 296853 system_pods.go:61] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running
I1122 02:50:34.018513 296853 system_pods.go:61] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running
I1122 02:50:34.018518 296853 system_pods.go:61] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running
I1122 02:50:34.018522 296853 system_pods.go:61] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running
I1122 02:50:34.018527 296853 system_pods.go:61] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running
I1122 02:50:34.018533 296853 system_pods.go:61] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:34.018542 296853 system_pods.go:74] duration metric: took 6.169554ms to wait for pod list to return data ...
I1122 02:50:34.018551 296853 default_sa.go:34] waiting for default service account to be created ...
I1122 02:50:34.032545 296853 default_sa.go:45] found service account: "default"
I1122 02:50:34.032639 296853 default_sa.go:55] duration metric: took 14.07788ms for default service account to be created ...
I1122 02:50:34.032667 296853 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:50:34.058015 296853 system_pods.go:86] 8 kube-system pods found
I1122 02:50:34.058056 296853 system_pods.go:89] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:34.058066 296853 system_pods.go:89] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running
I1122 02:50:34.058074 296853 system_pods.go:89] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running
I1122 02:50:34.058080 296853 system_pods.go:89] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running
I1122 02:50:34.058085 296853 system_pods.go:89] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running
I1122 02:50:34.058090 296853 system_pods.go:89] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running
I1122 02:50:34.058095 296853 system_pods.go:89] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running
I1122 02:50:34.058102 296853 system_pods.go:89] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:34.058112 296853 system_pods.go:126] duration metric: took 25.407725ms to wait for k8s-apps to be running ...
I1122 02:50:34.058123 296853 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:50:34.058174 296853 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:50:34.075387 296853 system_svc.go:56] duration metric: took 17.254408ms WaitForService to wait for kubelet
I1122 02:50:34.075489 296853 kubeadm.go:587] duration metric: took 14.527727905s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:34.075520 296853 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:50:34.078734 296853 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:50:34.078757 296853 node_conditions.go:123] node cpu capacity is 8
I1122 02:50:34.078770 296853 node_conditions.go:105] duration metric: took 3.244561ms to run NodePressure ...
I1122 02:50:34.078782 296853 start.go:242] waiting for startup goroutines ...
I1122 02:50:34.078788 296853 start.go:247] waiting for cluster config update ...
I1122 02:50:34.078798 296853 start.go:256] writing updated cluster config ...
I1122 02:50:34.079059 296853 ssh_runner.go:195] Run: rm -f paused
I1122 02:50:34.083090 296853 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:34.116386 296853 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.120678 296853 pod_ready.go:94] pod "coredns-66bc5c9577-6tsqs" is "Ready"
I1122 02:50:34.120704 296853 pod_ready.go:86] duration metric: took 4.295993ms for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.122544 296853 pod_ready.go:83] waiting for pod "etcd-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.126636 296853 pod_ready.go:94] pod "etcd-no-preload-346270" is "Ready"
I1122 02:50:34.126656 296853 pod_ready.go:86] duration metric: took 4.092164ms for pod "etcd-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.128563 296853 pod_ready.go:83] waiting for pod "kube-apiserver-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.132633 296853 pod_ready.go:94] pod "kube-apiserver-no-preload-346270" is "Ready"
I1122 02:50:34.132654 296853 pod_ready.go:86] duration metric: took 4.070577ms for pod "kube-apiserver-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.134519 296853 pod_ready.go:83] waiting for pod "kube-controller-manager-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.487626 296853 pod_ready.go:94] pod "kube-controller-manager-no-preload-346270" is "Ready"
I1122 02:50:34.487657 296853 pod_ready.go:86] duration metric: took 353.113808ms for pod "kube-controller-manager-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:34.688015 296853 pod_ready.go:83] waiting for pod "kube-proxy-lpft6" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.088775 296853 pod_ready.go:94] pod "kube-proxy-lpft6" is "Ready"
I1122 02:50:35.088810 296853 pod_ready.go:86] duration metric: took 400.769287ms for pod "kube-proxy-lpft6" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.288278 296853 pod_ready.go:83] waiting for pod "kube-scheduler-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.686926 296853 pod_ready.go:94] pod "kube-scheduler-no-preload-346270" is "Ready"
I1122 02:50:35.686957 296853 pod_ready.go:86] duration metric: took 398.647249ms for pod "kube-scheduler-no-preload-346270" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:35.686978 296853 pod_ready.go:40] duration metric: took 1.603854305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:35.729747 296853 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:50:35.731352 296853 out.go:179] * Done! kubectl is now configured to use "no-preload-346270" cluster and "default" namespace by default
I1122 02:50:35.254240 315098 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:50:35.274227 315098 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:50:35.278760 315098 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:50:35.290677 315098 kubeadm.go:884] updating cluster {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false C
ustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:50:35.290795 315098 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:50:35.290841 315098 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:50:35.326198 315098 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:50:35.326217 315098 crio.go:433] Images already preloaded, skipping extraction
I1122 02:50:35.326259 315098 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:50:35.355607 315098 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:50:35.355634 315098 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:50:35.355655 315098 kubeadm.go:935] updating node { 192.168.94.2 8444 v1.34.1 crio true true} ...
I1122 02:50:35.355776 315098 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-714134 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:50:35.355853 315098 ssh_runner.go:195] Run: crio config
I1122 02:50:35.406921 315098 cni.go:84] Creating CNI manager for ""
I1122 02:50:35.406952 315098 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:35.406975 315098 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:50:35.407009 315098 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8444 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-714134 NodeName:default-k8s-diff-port-714134 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:50:35.407166 315098 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-714134"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:50:35.407243 315098 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:50:35.416873 315098 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:50:35.416944 315098 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:50:35.425451 315098 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
I1122 02:50:35.439884 315098 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:50:35.456060 315098 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
I1122 02:50:35.469007 315098 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:50:35.472413 315098 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:50:35.481551 315098 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:35.565834 315098 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:50:35.587973 315098 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134 for IP: 192.168.94.2
I1122 02:50:35.587992 315098 certs.go:195] generating shared ca certs ...
I1122 02:50:35.588007 315098 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.588133 315098 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:50:35.588171 315098 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:50:35.588180 315098 certs.go:257] generating profile certs ...
I1122 02:50:35.588227 315098 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key
I1122 02:50:35.588248 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt with IP's: []
I1122 02:50:35.846933 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt ...
I1122 02:50:35.846965 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.crt: {Name:mk1f906593a097ac0c7889e33db96c08bc1abaa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.847172 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key ...
I1122 02:50:35.847201 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key: {Name:mk1e9449b03475d3e6bed302c331cc8f7dd59fc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:35.847341 315098 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0
I1122 02:50:35.847368 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]
I1122 02:50:36.123277 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 ...
I1122 02:50:36.123310 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0: {Name:mkfbe594c33401dafe3e1860e3a84f3790532c43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.123502 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0 ...
I1122 02:50:36.123525 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0: {Name:mk7afc2c1f5540be31f7a77ec14865e7dc853126 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.123633 315098 certs.go:382] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt.3f67d7f0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt
I1122 02:50:36.123759 315098 certs.go:386] copying /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key
I1122 02:50:36.123848 315098 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key
I1122 02:50:36.123871 315098 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt with IP's: []
I1122 02:50:37.201521 306384 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 02:50:37.201604 306384 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:50:37.201736 306384 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:50:37.201806 306384 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:50:37.201851 306384 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:50:37.201966 306384 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:50:37.202041 306384 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:50:37.202127 306384 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:50:37.202228 306384 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:50:37.202315 306384 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:50:37.202389 306384 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:50:37.202467 306384 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:50:37.202536 306384 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:50:37.202646 306384 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:50:37.202786 306384 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:50:37.202940 306384 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 02:50:37.203039 306384 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1122 02:50:37.205009 306384 out.go:252] - Generating certificates and keys ...
I1122 02:50:37.205108 306384 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:50:37.205215 306384 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:50:37.205301 306384 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:50:37.205378 306384 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:50:37.205463 306384 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:50:37.205536 306384 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:50:37.205634 306384 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:50:37.205872 306384 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [embed-certs-153115 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:50:37.205983 306384 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:50:37.206134 306384 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-153115 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1122 02:50:37.206230 306384 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:50:37.206324 306384 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:50:37.206406 306384 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:50:37.206486 306384 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:50:37.206579 306384 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:50:37.206688 306384 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:50:37.206773 306384 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:50:37.206872 306384 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:50:37.206993 306384 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:50:37.207126 306384 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:50:37.207222 306384 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:50:37.208456 306384 out.go:252] - Booting up control plane ...
I1122 02:50:37.208575 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:50:37.208694 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:50:37.208783 306384 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:50:37.208923 306384 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:50:37.209087 306384 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:50:37.209241 306384 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:50:37.209354 306384 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:50:37.209420 306384 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:50:37.209594 306384 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:50:37.209729 306384 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:50:37.209829 306384 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001734685s
I1122 02:50:37.209995 306384 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:50:37.210076 306384 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.76.2:8443/livez
I1122 02:50:37.210146 306384 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:50:37.210222 306384 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:50:37.210307 306384 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 4.258296456s
I1122 02:50:37.210365 306384 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 4.763991939s
I1122 02:50:37.210440 306384 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 6.50204239s
I1122 02:50:37.210538 306384 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:50:37.210653 306384 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:50:37.210718 306384 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:50:37.210930 306384 kubeadm.go:319] [mark-control-plane] Marking the node embed-certs-153115 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:50:37.211027 306384 kubeadm.go:319] [bootstrap-token] Using token: jbtdyo.vswtv1xc3ub2nx0v
I1122 02:50:37.212723 306384 out.go:252] - Configuring RBAC rules ...
I1122 02:50:37.212874 306384 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:50:37.213015 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:50:37.213175 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:50:37.213363 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:50:37.213518 306384 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:50:37.213635 306384 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:50:37.213779 306384 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:50:37.213853 306384 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:50:37.213932 306384 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:50:37.213955 306384 kubeadm.go:319]
I1122 02:50:37.214010 306384 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:50:37.214016 306384 kubeadm.go:319]
I1122 02:50:37.214079 306384 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:50:37.214089 306384 kubeadm.go:319]
I1122 02:50:37.214110 306384 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:50:37.214170 306384 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:50:37.214244 306384 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:50:37.214252 306384 kubeadm.go:319]
I1122 02:50:37.214329 306384 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:50:37.214337 306384 kubeadm.go:319]
I1122 02:50:37.214409 306384 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:50:37.214422 306384 kubeadm.go:319]
I1122 02:50:37.214497 306384 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:50:37.214605 306384 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:50:37.214704 306384 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:50:37.214712 306384 kubeadm.go:319]
I1122 02:50:37.214820 306384 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:50:37.214946 306384 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:50:37.214955 306384 kubeadm.go:319]
I1122 02:50:37.215020 306384 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token jbtdyo.vswtv1xc3ub2nx0v \
I1122 02:50:37.215101 306384 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:50:37.215121 306384 kubeadm.go:319] --control-plane
I1122 02:50:37.215127 306384 kubeadm.go:319]
I1122 02:50:37.215199 306384 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:50:37.215205 306384 kubeadm.go:319]
I1122 02:50:37.215326 306384 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token jbtdyo.vswtv1xc3ub2nx0v \
I1122 02:50:37.215475 306384 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:50:37.215492 306384 cni.go:84] Creating CNI manager for ""
I1122 02:50:37.215500 306384 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:37.216772 306384 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1122 02:50:36.924143 315098 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt ...
I1122 02:50:36.924172 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt: {Name:mkc3c73f8df9f9535b8d099d7fad2f9ef490f009 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.924353 315098 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key ...
I1122 02:50:36.924378 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key: {Name:mk6f92f51b27b058afc991ee860de62e505e9ae0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:36.924583 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:50:36.924627 315098 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:50:36.924638 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:50:36.924658 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:50:36.924685 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:50:36.924711 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:50:36.924751 315098 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:50:36.925318 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:50:36.943860 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:50:36.960531 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:50:36.977735 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:50:36.995972 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I1122 02:50:37.012470 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:50:37.029824 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:50:37.047235 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:50:37.066342 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:50:37.086866 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:50:37.105215 315098 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:50:37.123141 315098 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:50:37.135982 315098 ssh_runner.go:195] Run: openssl version
I1122 02:50:37.141767 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:50:37.149794 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:50:37.153339 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:50:37.153391 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:50:37.198060 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:50:37.208318 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:50:37.218941 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:50:37.223111 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:50:37.223160 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:50:37.265934 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:50:37.275038 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:50:37.284145 315098 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.288972 315098 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.289032 315098 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:50:37.343896 315098 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:50:37.354325 315098 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:50:37.358509 315098 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1122 02:50:37.358579 315098 kubeadm.go:401] StartCluster: {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:50:37.358663 315098 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:50:37.358718 315098 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:50:37.390769 315098 cri.go:89] found id: ""
I1122 02:50:37.390846 315098 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:50:37.399636 315098 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1122 02:50:37.407604 315098 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1122 02:50:37.407663 315098 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1122 02:50:37.416197 315098 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1122 02:50:37.416217 315098 kubeadm.go:158] found existing configuration files:
I1122 02:50:37.416267 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I1122 02:50:37.424540 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1122 02:50:37.424589 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1122 02:50:37.431634 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I1122 02:50:37.439743 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1122 02:50:37.439792 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1122 02:50:37.447625 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I1122 02:50:37.456980 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1122 02:50:37.457027 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1122 02:50:37.465751 315098 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I1122 02:50:37.474227 315098 kubeadm.go:164] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1122 02:50:37.474281 315098 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1122 02:50:37.483638 315098 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1122 02:50:37.541603 315098 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1122 02:50:37.541698 315098 kubeadm.go:319] [preflight] Running pre-flight checks
I1122 02:50:37.565569 315098 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1122 02:50:37.565702 315098 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1044-gcp[0m
I1122 02:50:37.565781 315098 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1122 02:50:37.565856 315098 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1122 02:50:37.565959 315098 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1122 02:50:37.566036 315098 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1122 02:50:37.566115 315098 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1122 02:50:37.566220 315098 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1122 02:50:37.566315 315098 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1122 02:50:37.566394 315098 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1122 02:50:37.566462 315098 kubeadm.go:319] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1122 02:50:37.635568 315098 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1122 02:50:37.635719 315098 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1122 02:50:37.635845 315098 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1122 02:50:37.643735 315098 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
W1122 02:50:34.077285 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:36.576793 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:37.646548 315098 out.go:252] - Generating certificates and keys ...
I1122 02:50:37.646642 315098 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:50:37.646750 315098 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:50:37.681248 315098 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:50:37.894625 315098 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:50:38.078061 315098 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:50:38.584096 315098 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:50:39.167604 315098 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:50:39.167812 315098 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [default-k8s-diff-port-714134 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:50:39.231532 315098 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:50:39.231762 315098 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [default-k8s-diff-port-714134 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I1122 02:50:39.706435 315098 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:50:39.829450 315098 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:50:39.952199 315098 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:50:39.952355 315098 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:50:40.051806 315098 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:50:40.327311 315098 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:50:40.403992 315098 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:50:40.579209 315098 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:50:40.628571 315098 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:50:40.629475 315098 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:50:40.634518 315098 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:50:37.217895 306384 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:50:37.222753 306384 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:50:37.222771 306384 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:50:37.236573 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:50:37.468611 306384 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:50:37.468681 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:37.468706 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-153115 minikube.k8s.io/updated_at=2025_11_22T02_50_37_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=embed-certs-153115 minikube.k8s.io/primary=true
I1122 02:50:37.480017 306384 ops.go:34] apiserver oom_adj: -16
I1122 02:50:37.562112 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:38.063293 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:38.562801 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:39.062943 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:39.563157 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.062847 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.562348 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:41.062956 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:40.636275 315098 out.go:252] - Booting up control plane ...
I1122 02:50:40.636410 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:50:40.636518 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:50:40.639119 315098 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:50:40.657512 315098 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:50:40.657659 315098 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:50:40.665890 315098 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:50:40.666373 315098 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:50:40.666439 315098 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:50:40.792561 315098 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:50:40.792760 315098 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:50:41.794239 315098 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001667172s
I1122 02:50:41.798595 315098 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:50:41.798763 315098 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.94.2:8444/livez
I1122 02:50:41.798949 315098 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:50:41.799144 315098 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:50:41.562782 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:42.062916 306384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:42.151927 306384 kubeadm.go:1114] duration metric: took 4.683313074s to wait for elevateKubeSystemPrivileges
I1122 02:50:42.151965 306384 kubeadm.go:403] duration metric: took 18.242666356s to StartCluster
I1122 02:50:42.151994 306384 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:42.152074 306384 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:50:42.154398 306384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:42.154688 306384 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:50:42.154848 306384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:50:42.155159 306384 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:42.155204 306384 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:50:42.155280 306384 addons.go:70] Setting storage-provisioner=true in profile "embed-certs-153115"
I1122 02:50:42.155297 306384 addons.go:239] Setting addon storage-provisioner=true in "embed-certs-153115"
I1122 02:50:42.155323 306384 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:50:42.155406 306384 addons.go:70] Setting default-storageclass=true in profile "embed-certs-153115"
I1122 02:50:42.155430 306384 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-153115"
I1122 02:50:42.155778 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.155872 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.156873 306384 out.go:179] * Verifying Kubernetes components...
I1122 02:50:42.158001 306384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:42.187371 306384 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:50:42.187728 306384 addons.go:239] Setting addon default-storageclass=true in "embed-certs-153115"
I1122 02:50:42.187775 306384 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:50:42.188288 306384 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:50:42.188761 306384 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:42.188818 306384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:50:42.188895 306384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:50:42.218345 306384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:50:42.221718 306384 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:42.221754 306384 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:50:42.221811 306384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:50:42.251481 306384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:50:42.291289 306384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:50:42.319729 306384 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:50:42.348219 306384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:42.367705 306384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:42.817842 306384 start.go:977] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I1122 02:50:42.819393 306384 node_ready.go:35] waiting up to 6m0s for node "embed-certs-153115" to be "Ready" ...
I1122 02:50:43.006446 306384 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
W1122 02:50:39.072639 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:41.572193 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:43.575027 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:43.008211 306384 addons.go:530] duration metric: took 852.999666ms for enable addons: enabled=[storage-provisioner default-storageclass]
I1122 02:50:43.323671 306384 kapi.go:214] "coredns" deployment in "kube-system" namespace and "embed-certs-153115" context rescaled to 1 replicas
W1122 02:50:44.823565 306384 node_ready.go:57] node "embed-certs-153115" has "Ready":"False" status (will retry)
I1122 02:50:45.382262 315098 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 3.583471416s
I1122 02:50:46.150161 315098 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 4.351579995s
I1122 02:50:46.800365 315098 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 5.001634142s
I1122 02:50:46.812625 315098 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:50:46.821544 315098 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:50:46.831080 315098 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:50:46.831399 315098 kubeadm.go:319] [mark-control-plane] Marking the node default-k8s-diff-port-714134 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:50:46.838995 315098 kubeadm.go:319] [bootstrap-token] Using token: q10fjo.rwpew4zoa2bjpfgh
I1122 02:50:46.840163 315098 out.go:252] - Configuring RBAC rules ...
I1122 02:50:46.840328 315098 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:50:46.843152 315098 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:50:46.848672 315098 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:50:46.851024 315098 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:50:46.853306 315098 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:50:46.855622 315098 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:50:47.206285 315098 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:50:47.620674 315098 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:50:48.206202 315098 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:50:48.206974 315098 kubeadm.go:319]
I1122 02:50:48.207037 315098 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:50:48.207045 315098 kubeadm.go:319]
I1122 02:50:48.207147 315098 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:50:48.207165 315098 kubeadm.go:319]
I1122 02:50:48.207211 315098 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:50:48.207288 315098 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:50:48.207363 315098 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:50:48.207372 315098 kubeadm.go:319]
I1122 02:50:48.207452 315098 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:50:48.207461 315098 kubeadm.go:319]
I1122 02:50:48.207529 315098 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:50:48.207538 315098 kubeadm.go:319]
I1122 02:50:48.207633 315098 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:50:48.207764 315098 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:50:48.207872 315098 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:50:48.207883 315098 kubeadm.go:319]
I1122 02:50:48.208024 315098 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:50:48.208141 315098 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:50:48.208153 315098 kubeadm.go:319]
I1122 02:50:48.208274 315098 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8444 --token q10fjo.rwpew4zoa2bjpfgh \
I1122 02:50:48.208445 315098 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:50:48.208491 315098 kubeadm.go:319] --control-plane
I1122 02:50:48.208505 315098 kubeadm.go:319]
I1122 02:50:48.208640 315098 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:50:48.208650 315098 kubeadm.go:319]
I1122 02:50:48.208766 315098 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8444 --token q10fjo.rwpew4zoa2bjpfgh \
I1122 02:50:48.208947 315098 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:50:48.211191 315098 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:50:48.211341 315098 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:50:48.211374 315098 cni.go:84] Creating CNI manager for ""
I1122 02:50:48.211384 315098 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:50:48.213275 315098 out.go:179] * Configuring CNI (Container Networking Interface) ...
W1122 02:50:46.071342 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:48.571327 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:47.323021 306384 node_ready.go:57] node "embed-certs-153115" has "Ready":"False" status (will retry)
W1122 02:50:49.822088 306384 node_ready.go:57] node "embed-certs-153115" has "Ready":"False" status (will retry)
I1122 02:50:48.214246 315098 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:50:48.218444 315098 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:50:48.218460 315098 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:50:48.231478 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:50:48.499601 315098 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:50:48.499702 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:48.499727 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes default-k8s-diff-port-714134 minikube.k8s.io/updated_at=2025_11_22T02_50_48_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=default-k8s-diff-port-714134 minikube.k8s.io/primary=true
I1122 02:50:48.510135 315098 ops.go:34] apiserver oom_adj: -16
I1122 02:50:48.571804 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:49.072177 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:49.572765 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:50.072086 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:50.572588 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:51.072805 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:51.572717 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:52.072198 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:52.572220 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:53.072027 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:53.572847 315098 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:50:53.670353 315098 kubeadm.go:1114] duration metric: took 5.170725706s to wait for elevateKubeSystemPrivileges
I1122 02:50:53.670407 315098 kubeadm.go:403] duration metric: took 16.311820832s to StartCluster
I1122 02:50:53.670430 315098 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:53.670506 315098 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:50:53.672634 315098 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:50:53.672862 315098 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:50:53.672869 315098 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:50:53.672961 315098 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:50:53.673059 315098 addons.go:70] Setting storage-provisioner=true in profile "default-k8s-diff-port-714134"
I1122 02:50:53.673076 315098 addons.go:70] Setting default-storageclass=true in profile "default-k8s-diff-port-714134"
I1122 02:50:53.673116 315098 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-714134"
I1122 02:50:53.673126 315098 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:50:53.673080 315098 addons.go:239] Setting addon storage-provisioner=true in "default-k8s-diff-port-714134"
I1122 02:50:53.673215 315098 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:50:53.673511 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:53.673588 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:53.709849 315098 addons.go:239] Setting addon default-storageclass=true in "default-k8s-diff-port-714134"
I1122 02:50:53.709932 315098 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:50:53.709939 315098 out.go:179] * Verifying Kubernetes components...
I1122 02:50:53.709953 315098 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
W1122 02:50:51.071969 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:53.072198 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:50:53.710509 315098 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:50:53.716751 315098 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:50:53.716863 315098 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:53.716879 315098 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:50:53.716973 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:53.735331 315098 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:53.735359 315098 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:50:53.735419 315098 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:50:53.744833 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:53.761325 315098 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33108 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:50:53.765826 315098 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.94.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:50:53.871409 315098 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:50:53.871797 315098 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:50:53.876817 315098 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:50:53.966241 315098 start.go:977] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS's ConfigMap
I1122 02:50:53.968044 315098 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:50:54.198356 315098 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
W1122 02:50:51.822154 306384 node_ready.go:57] node "embed-certs-153115" has "Ready":"False" status (will retry)
I1122 02:50:53.823354 306384 node_ready.go:49] node "embed-certs-153115" is "Ready"
I1122 02:50:53.823384 306384 node_ready.go:38] duration metric: took 11.003962845s for node "embed-certs-153115" to be "Ready" ...
I1122 02:50:53.823403 306384 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:50:53.823452 306384 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:50:53.835385 306384 api_server.go:72] duration metric: took 11.680658574s to wait for apiserver process to appear ...
I1122 02:50:53.835414 306384 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:50:53.835435 306384 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:50:53.839601 306384 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1122 02:50:53.840830 306384 api_server.go:141] control plane version: v1.34.1
I1122 02:50:53.840858 306384 api_server.go:131] duration metric: took 5.436957ms to wait for apiserver health ...
I1122 02:50:53.840868 306384 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:50:53.846846 306384 system_pods.go:59] 8 kube-system pods found
I1122 02:50:53.846890 306384 system_pods.go:61] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:53.846899 306384 system_pods.go:61] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running
I1122 02:50:53.846932 306384 system_pods.go:61] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running
I1122 02:50:53.846939 306384 system_pods.go:61] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running
I1122 02:50:53.846945 306384 system_pods.go:61] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running
I1122 02:50:53.846950 306384 system_pods.go:61] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running
I1122 02:50:53.846954 306384 system_pods.go:61] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running
I1122 02:50:53.846962 306384 system_pods.go:61] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:53.846969 306384 system_pods.go:74] duration metric: took 6.0936ms to wait for pod list to return data ...
I1122 02:50:53.846978 306384 default_sa.go:34] waiting for default service account to be created ...
I1122 02:50:53.849865 306384 default_sa.go:45] found service account: "default"
I1122 02:50:53.849883 306384 default_sa.go:55] duration metric: took 2.8993ms for default service account to be created ...
I1122 02:50:53.849891 306384 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:50:53.852512 306384 system_pods.go:86] 8 kube-system pods found
I1122 02:50:53.852542 306384 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:53.852550 306384 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running
I1122 02:50:53.852557 306384 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running
I1122 02:50:53.852563 306384 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running
I1122 02:50:53.852568 306384 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running
I1122 02:50:53.852573 306384 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running
I1122 02:50:53.852578 306384 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running
I1122 02:50:53.852585 306384 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:53.852607 306384 retry.go:31] will retry after 220.998481ms: missing components: kube-dns
I1122 02:50:54.077918 306384 system_pods.go:86] 8 kube-system pods found
I1122 02:50:54.077961 306384 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:54.077974 306384 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running
I1122 02:50:54.077982 306384 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running
I1122 02:50:54.077988 306384 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running
I1122 02:50:54.077995 306384 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running
I1122 02:50:54.077999 306384 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running
I1122 02:50:54.078005 306384 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running
I1122 02:50:54.078015 306384 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:54.078035 306384 retry.go:31] will retry after 290.071078ms: missing components: kube-dns
I1122 02:50:54.372518 306384 system_pods.go:86] 8 kube-system pods found
I1122 02:50:54.372562 306384 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:50:54.372572 306384 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running
I1122 02:50:54.372581 306384 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running
I1122 02:50:54.372587 306384 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running
I1122 02:50:54.372593 306384 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running
I1122 02:50:54.372598 306384 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running
I1122 02:50:54.372604 306384 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running
I1122 02:50:54.372612 306384 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:50:54.372641 306384 retry.go:31] will retry after 335.313879ms: missing components: kube-dns
I1122 02:50:54.711695 306384 system_pods.go:86] 8 kube-system pods found
I1122 02:50:54.711726 306384 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running
I1122 02:50:54.711731 306384 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running
I1122 02:50:54.711737 306384 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running
I1122 02:50:54.711740 306384 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running
I1122 02:50:54.711745 306384 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running
I1122 02:50:54.711748 306384 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running
I1122 02:50:54.711752 306384 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running
I1122 02:50:54.711755 306384 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running
I1122 02:50:54.711764 306384 system_pods.go:126] duration metric: took 861.867764ms to wait for k8s-apps to be running ...
I1122 02:50:54.711771 306384 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:50:54.711814 306384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:50:54.725290 306384 system_svc.go:56] duration metric: took 13.509306ms WaitForService to wait for kubelet
I1122 02:50:54.725314 306384 kubeadm.go:587] duration metric: took 12.570592479s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:50:54.725336 306384 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:50:54.727844 306384 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:50:54.727870 306384 node_conditions.go:123] node cpu capacity is 8
I1122 02:50:54.727883 306384 node_conditions.go:105] duration metric: took 2.541289ms to run NodePressure ...
I1122 02:50:54.727898 306384 start.go:242] waiting for startup goroutines ...
I1122 02:50:54.727939 306384 start.go:247] waiting for cluster config update ...
I1122 02:50:54.727958 306384 start.go:256] writing updated cluster config ...
I1122 02:50:54.728231 306384 ssh_runner.go:195] Run: rm -f paused
I1122 02:50:54.731827 306384 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:54.811774 306384 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.815820 306384 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:50:54.815843 306384 pod_ready.go:86] duration metric: took 4.045447ms for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.817632 306384 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.820879 306384 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:50:54.820898 306384 pod_ready.go:86] duration metric: took 3.24826ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.822580 306384 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.826010 306384 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:50:54.826027 306384 pod_ready.go:86] duration metric: took 3.432634ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:54.827631 306384 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:55.135840 306384 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:50:55.135869 306384 pod_ready.go:86] duration metric: took 308.221369ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:55.335992 306384 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:55.735411 306384 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:50:55.735435 306384 pod_ready.go:86] duration metric: took 399.419445ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:55.936688 306384 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:56.335888 306384 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:50:56.335928 306384 pod_ready.go:86] duration metric: took 399.211474ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:50:56.335940 306384 pod_ready.go:40] duration metric: took 1.604090183s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:50:56.379259 306384 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:50:56.380863 306384 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
I1122 02:50:54.199233 315098 addons.go:530] duration metric: took 526.274257ms for enable addons: enabled=[storage-provisioner default-storageclass]
I1122 02:50:54.473044 315098 kapi.go:214] "coredns" deployment in "kube-system" namespace and "default-k8s-diff-port-714134" context rescaled to 1 replicas
W1122 02:50:55.970853 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
W1122 02:50:55.570397 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
W1122 02:50:58.070483 307742 pod_ready.go:104] pod "coredns-5dd5756b68-fkcs9" is not "Ready", error: <nil>
I1122 02:51:00.070559 307742 pod_ready.go:94] pod "coredns-5dd5756b68-fkcs9" is "Ready"
I1122 02:51:00.070587 307742 pod_ready.go:86] duration metric: took 35.005131319s for pod "coredns-5dd5756b68-fkcs9" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.073357 307742 pod_ready.go:83] waiting for pod "etcd-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.076898 307742 pod_ready.go:94] pod "etcd-old-k8s-version-169878" is "Ready"
I1122 02:51:00.076947 307742 pod_ready.go:86] duration metric: took 3.568312ms for pod "etcd-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.079409 307742 pod_ready.go:83] waiting for pod "kube-apiserver-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.083340 307742 pod_ready.go:94] pod "kube-apiserver-old-k8s-version-169878" is "Ready"
I1122 02:51:00.083362 307742 pod_ready.go:86] duration metric: took 3.934995ms for pod "kube-apiserver-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.085873 307742 pod_ready.go:83] waiting for pod "kube-controller-manager-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.268103 307742 pod_ready.go:94] pod "kube-controller-manager-old-k8s-version-169878" is "Ready"
I1122 02:51:00.268127 307742 pod_ready.go:86] duration metric: took 182.23514ms for pod "kube-controller-manager-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.470103 307742 pod_ready.go:83] waiting for pod "kube-proxy-c7nnb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:00.868520 307742 pod_ready.go:94] pod "kube-proxy-c7nnb" is "Ready"
I1122 02:51:00.868544 307742 pod_ready.go:86] duration metric: took 398.418638ms for pod "kube-proxy-c7nnb" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:01.069152 307742 pod_ready.go:83] waiting for pod "kube-scheduler-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:01.468866 307742 pod_ready.go:94] pod "kube-scheduler-old-k8s-version-169878" is "Ready"
I1122 02:51:01.468891 307742 pod_ready.go:86] duration metric: took 399.710117ms for pod "kube-scheduler-old-k8s-version-169878" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:01.468913 307742 pod_ready.go:40] duration metric: took 36.407293333s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:01.512237 307742 start.go:625] kubectl: 1.34.2, cluster: 1.28.0 (minor skew: 6)
I1122 02:51:01.513770 307742 out.go:203]
W1122 02:51:01.514840 307742 out.go:285] ! /usr/local/bin/kubectl is version 1.34.2, which may have incompatibilities with Kubernetes 1.28.0.
I1122 02:51:01.515813 307742 out.go:179] - Want kubectl v1.28.0? Try 'minikube kubectl -- get pods -A'
I1122 02:51:01.516920 307742 out.go:179] * Done! kubectl is now configured to use "old-k8s-version-169878" cluster and "default" namespace by default
W1122 02:50:58.470866 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
W1122 02:51:00.471270 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
==> CRI-O <==
Nov 22 02:50:54 embed-certs-153115 crio[772]: time="2025-11-22T02:50:54.132628242Z" level=info msg="Starting container: eec75ccff1d4c9de6b0249ebbe7a207204ecc4c286115310d91f2bcb33c9ef02" id=2ec38884-400c-43a4-a602-698f1d6f0b4c name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:54 embed-certs-153115 crio[772]: time="2025-11-22T02:50:54.134596046Z" level=info msg="Started container" PID=1876 containerID=eec75ccff1d4c9de6b0249ebbe7a207204ecc4c286115310d91f2bcb33c9ef02 description=kube-system/coredns-66bc5c9577-bq64j/coredns id=2ec38884-400c-43a4-a602-698f1d6f0b4c name=/runtime.v1.RuntimeService/StartContainer sandboxID=b50c9c3c71c7476b4937e87ca2dff85db4e2c008c4146f660b19245115838e6f
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.826703631Z" level=info msg="Running pod sandbox: default/busybox/POD" id=ce28020b-0375-4058-a51f-5c5e0589fc69 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.826784003Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.831984776Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:1842e7ab7bc0637af607ca4205941afd956e2b1254dcb76110216d2fe8fc442d UID:3d98398f-9fa2-4e7d-99fb-dd974733447e NetNS:/var/run/netns/9f474466-6569-440f-9374-5f5d65119a65 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00008a700}] Aliases:map[]}"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.832011267Z" level=info msg="Adding pod default_busybox to CNI network \"kindnet\" (type=ptp)"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.840889485Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:1842e7ab7bc0637af607ca4205941afd956e2b1254dcb76110216d2fe8fc442d UID:3d98398f-9fa2-4e7d-99fb-dd974733447e NetNS:/var/run/netns/9f474466-6569-440f-9374-5f5d65119a65 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00008a700}] Aliases:map[]}"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.841052382Z" level=info msg="Checking pod default_busybox for CNI network kindnet (type=ptp)"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.841675004Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.842483335Z" level=info msg="Ran pod sandbox 1842e7ab7bc0637af607ca4205941afd956e2b1254dcb76110216d2fe8fc442d with infra container: default/busybox/POD" id=ce28020b-0375-4058-a51f-5c5e0589fc69 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.843646079Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=ffd412da-6626-40d2-ac30-f2e257a1d605 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.843747965Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=ffd412da-6626-40d2-ac30-f2e257a1d605 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.843782803Z" level=info msg="Neither image nor artfiact gcr.io/k8s-minikube/busybox:1.28.4-glibc found" id=ffd412da-6626-40d2-ac30-f2e257a1d605 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.844508363Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=870c589c-fad0-4ec2-9a4f-375744a99c3b name=/runtime.v1.ImageService/PullImage
Nov 22 02:50:56 embed-certs-153115 crio[772]: time="2025-11-22T02:50:56.845919858Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28.4-glibc\""
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.50064263Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998" id=870c589c-fad0-4ec2-9a4f-375744a99c3b name=/runtime.v1.ImageService/PullImage
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.501270249Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=0856f0b1-9270-4e3e-90bb-c75e3b085984 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.502480955Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=85a2c3dd-41c4-4627-bf69-9bd67f30ab0b name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.505361719Z" level=info msg="Creating container: default/busybox/busybox" id=bb2ca08f-43d4-4957-bded-331e5b703d65 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.505483459Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.509098692Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.509568985Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.54285985Z" level=info msg="Created container 647dca1516c866f1106d6d009ba60878ebcb121bf14f84175511fe90942991ae: default/busybox/busybox" id=bb2ca08f-43d4-4957-bded-331e5b703d65 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.543361881Z" level=info msg="Starting container: 647dca1516c866f1106d6d009ba60878ebcb121bf14f84175511fe90942991ae" id=a5956d64-81c2-4b84-a660-3d0f0c73ea63 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:57 embed-certs-153115 crio[772]: time="2025-11-22T02:50:57.544823478Z" level=info msg="Started container" PID=1939 containerID=647dca1516c866f1106d6d009ba60878ebcb121bf14f84175511fe90942991ae description=default/busybox/busybox id=a5956d64-81c2-4b84-a660-3d0f0c73ea63 name=/runtime.v1.RuntimeService/StartContainer sandboxID=1842e7ab7bc0637af607ca4205941afd956e2b1254dcb76110216d2fe8fc442d
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
647dca1516c86 gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 7 seconds ago Running busybox 0 1842e7ab7bc06 busybox default
eec75ccff1d4c 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 10 seconds ago Running coredns 0 b50c9c3c71c74 coredns-66bc5c9577-bq64j kube-system
df12888a8b3cd 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 10 seconds ago Running storage-provisioner 0 22c8ed6e63167 storage-provisioner kube-system
22fe81dbaef07 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 21 seconds ago Running kindnet-cni 0 815b600bb3ca3 kindnet-hpnj7 kube-system
13576022875de fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 21 seconds ago Running kube-proxy 0 7ff464954c32c kube-proxy-vw5ph kube-system
355d94abc29c9 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 33 seconds ago Running etcd 0 8d0ecf08f7af3 etcd-embed-certs-153115 kube-system
3785dfe933b43 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 33 seconds ago Running kube-scheduler 0 fe6e605de766d kube-scheduler-embed-certs-153115 kube-system
78722d2fd15b0 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 33 seconds ago Running kube-controller-manager 0 e8b04e18adb28 kube-controller-manager-embed-certs-153115 kube-system
2ab61867b8328 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 33 seconds ago Running kube-apiserver 0 f6b6eb57bcbee kube-apiserver-embed-certs-153115 kube-system
==> coredns [eec75ccff1d4c9de6b0249ebbe7a207204ecc4c286115310d91f2bcb33c9ef02] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 3e2243e8b9e7116f563b83b1933f477a68ba9ad4a829ed5d7e54629fb2ce53528b9bc6023030be20be434ad805fd246296dd428c64e9bbef3a70f22b8621f560
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:39801 - 56468 "HINFO IN 193445330174096655.7184091057492406935. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.456526007s
==> describe nodes <==
Name: embed-certs-153115
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=embed-certs-153115
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=embed-certs-153115
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_37_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: embed-certs-153115
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:50:56 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:50:53 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:50:53 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:50:53 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:50:53 +0000 Sat, 22 Nov 2025 02:50:53 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: embed-certs-153115
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 7f0db3f8-f77b-42a1-a17a-928d51866ba3
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8s
kube-system coredns-66bc5c9577-bq64j 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 22s
kube-system etcd-embed-certs-153115 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 28s
kube-system kindnet-hpnj7 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 23s
kube-system kube-apiserver-embed-certs-153115 250m (3%) 0 (0%) 0 (0%) 0 (0%) 28s
kube-system kube-controller-manager-embed-certs-153115 200m (2%) 0 (0%) 0 (0%) 0 (0%) 28s
kube-system kube-proxy-vw5ph 0 (0%) 0 (0%) 0 (0%) 0 (0%) 23s
kube-system kube-scheduler-embed-certs-153115 100m (1%) 0 (0%) 0 (0%) 0 (0%) 28s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 22s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 21s kube-proxy
Normal Starting 28s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 28s kubelet Node embed-certs-153115 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 28s kubelet Node embed-certs-153115 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 28s kubelet Node embed-certs-153115 status is now: NodeHasSufficientPID
Normal RegisteredNode 24s node-controller Node embed-certs-153115 event: Registered Node embed-certs-153115 in Controller
Normal NodeReady 11s kubelet Node embed-certs-153115 status is now: NodeReady
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [355d94abc29c98d44328835b195101cc4bea42113235fa75e5e3abcc4e53aa67] <==
{"level":"warn","ts":"2025-11-22T02:50:33.342414Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55980","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.349216Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:55992","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.356548Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56012","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.364044Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56016","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.370620Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56048","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.377071Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56076","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.384112Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56104","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.391105Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56120","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.398460Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56132","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.406196Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56152","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.417383Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56174","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.431578Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56204","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.439433Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56218","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.446268Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56236","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.462313Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56260","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.469155Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56264","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.476879Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56278","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:33.527066Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56294","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:42.451765Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"110.510531ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/kube-system/coredns-66bc5c9577\" limit:1 ","response":"range_response_count:1 size:4101"}
{"level":"info","ts":"2025-11-22T02:50:42.451865Z","caller":"traceutil/trace.go:172","msg":"trace[808944436] range","detail":"{range_begin:/registry/replicasets/kube-system/coredns-66bc5c9577; range_end:; response_count:1; response_revision:352; }","duration":"110.62866ms","start":"2025-11-22T02:50:42.341218Z","end":"2025-11-22T02:50:42.451847Z","steps":["trace[808944436] 'agreement among raft nodes before linearized reading' (duration: 91.82276ms)","trace[808944436] 'range keys from in-memory index tree' (duration: 18.652674ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:42.453247Z","caller":"traceutil/trace.go:172","msg":"trace[1174748970] transaction","detail":"{read_only:false; response_revision:353; number_of_response:1; }","duration":"112.458423ms","start":"2025-11-22T02:50:42.340764Z","end":"2025-11-22T02:50:42.453223Z","steps":["trace[1174748970] 'process raft request' (duration: 92.343967ms)","trace[1174748970] 'compare' (duration: 18.502809ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:42.811549Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"174.188375ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/storage-provisioner\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-11-22T02:50:42.811616Z","caller":"traceutil/trace.go:172","msg":"trace[1175926663] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/storage-provisioner; range_end:; response_count:0; response_revision:354; }","duration":"174.275053ms","start":"2025-11-22T02:50:42.637324Z","end":"2025-11-22T02:50:42.811599Z","steps":["trace[1175926663] 'agreement among raft nodes before linearized reading' (duration: 41.879098ms)","trace[1175926663] 'range keys from in-memory index tree' (duration: 132.269035ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:42.812203Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"132.372359ms","expected-duration":"100ms","prefix":"","request":"header:<ID:15638356808750852237 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/configmaps/kube-system/coredns\" mod_revision:233 > success:<request_put:<key:\"/registry/configmaps/kube-system/coredns\" value_size:782 >> failure:<request_range:<key:\"/registry/configmaps/kube-system/coredns\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:42.812298Z","caller":"traceutil/trace.go:172","msg":"trace[1493767971] transaction","detail":"{read_only:false; response_revision:355; number_of_response:1; }","duration":"233.283231ms","start":"2025-11-22T02:50:42.579001Z","end":"2025-11-22T02:50:42.812285Z","steps":["trace[1493767971] 'process raft request' (duration: 100.239483ms)","trace[1493767971] 'compare' (duration: 132.25083ms)"],"step_count":2}
==> kernel <==
02:51:05 up 1:33, 0 user, load average: 5.66, 3.93, 2.26
Linux embed-certs-153115 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [22fe81dbaef07a5a765a28ef7e3b494a64cb272d1a3c1b695b237a8d0c068b17] <==
I1122 02:50:43.226455 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:50:43.226883 1 main.go:139] hostIP = 192.168.76.2
podIP = 192.168.76.2
I1122 02:50:43.227102 1 main.go:148] setting mtu 1500 for CNI
I1122 02:50:43.227123 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:50:43.227150 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:50:43Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:50:43.438398 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:50:43.438425 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:50:43.438439 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:50:43.438585 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:50:43.938988 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:50:43.939034 1 metrics.go:72] Registering metrics
I1122 02:50:43.939121 1 controller.go:711] "Syncing nftables rules"
I1122 02:50:53.438882 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I1122 02:50:53.438998 1 main.go:301] handling current node
I1122 02:51:03.439142 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I1122 02:51:03.439193 1 main.go:301] handling current node
==> kube-apiserver [2ab61867b8328e339ddef53804651527f88a6c91b030319fc2be6fb4fdedd369] <==
E1122 02:50:34.092149 1 controller.go:148] "Unhandled Error" err="while syncing ConfigMap \"kube-system/kube-apiserver-legacy-service-account-token-tracking\", err: namespaces \"kube-system\" not found" logger="UnhandledError"
I1122 02:50:34.145422 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:50:34.145758 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:34.147219 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:50:34.151855 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:34.152919 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:50:34.263197 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:50:34.945373 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:50:34.948943 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:50:34.948960 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:50:35.394162 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:50:35.429773 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:50:35.549267 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:50:35.554876 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I1122 02:50:35.555891 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:50:35.559857 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:50:35.975800 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:50:36.600304 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:50:36.608565 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:50:36.616649 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:50:40.977708 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:50:41.877757 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1122 02:50:42.030479 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:42.034297 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
E1122 02:51:03.606234 1 conn.go:339] Error on socket receive: read tcp 192.168.76.2:8443->192.168.76.1:51334: use of closed network connection
==> kube-controller-manager [78722d2fd15b0a036e69b66c69d5b6f7fb706a4ae25d9c00fbbfa1f20353ac1b] <==
I1122 02:50:40.973812 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:50:40.973897 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="embed-certs-153115"
I1122 02:50:40.974025 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:50:40.973980 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:50:40.974000 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:50:40.974012 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:50:40.974249 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:50:40.973955 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:50:40.974094 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:50:40.974104 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:50:40.974281 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:50:40.974078 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:50:40.974301 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:50:40.974304 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:50:40.974572 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:50:40.974774 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:50:40.974793 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:50:40.974803 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:50:40.976376 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:50:40.979511 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:50:40.979513 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:50:40.980486 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:50:40.986898 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:50:40.999347 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:50:55.976529 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [13576022875de3e132bb5b6227899308c8e7dd9d10ea21ed6637b04a4df459d2] <==
I1122 02:50:43.041469 1 server_linux.go:53] "Using iptables proxy"
I1122 02:50:43.121249 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:50:43.221478 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:50:43.221572 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.76.2"]
E1122 02:50:43.221679 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:50:43.247257 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:50:43.247363 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:50:43.254749 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:50:43.255233 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:50:43.255260 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:43.256826 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:50:43.256890 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:50:43.257346 1 config.go:200] "Starting service config controller"
I1122 02:50:43.257851 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:50:43.260988 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:50:43.260897 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:50:43.258457 1 config.go:309] "Starting node config controller"
I1122 02:50:43.261071 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:50:43.261078 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:50:43.357570 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:50:43.361839 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:50:43.362053 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [3785dfe933b43bad743ab3fe64616d4c2a1b28da8cf100f546257f412e761118] <==
E1122 02:50:34.047861 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:50:34.048733 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:50:34.049042 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:50:34.049489 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:50:34.049124 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:50:34.049184 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:50:34.049219 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:50:34.049265 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:50:34.049285 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:50:34.049287 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:50:34.049345 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:50:34.049361 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:50:34.049395 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:50:34.049472 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:50:34.049124 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:50:34.049509 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:50:34.870955 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:50:34.918415 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:50:34.967131 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:50:35.110816 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:50:35.157139 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:50:35.237322 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:50:35.239287 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:50:35.429229 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
I1122 02:50:38.343786 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:50:40 embed-certs-153115 kubelet[1340]: I1122 02:50:40.970199 1340 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953394 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/2ccf409a-3708-4cf1-834d-d74d3d1895dd-cni-cfg\") pod \"kindnet-hpnj7\" (UID: \"2ccf409a-3708-4cf1-834d-d74d3d1895dd\") " pod="kube-system/kindnet-hpnj7"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953439 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-xtables-lock\") pod \"kube-proxy-vw5ph\" (UID: \"fd3757e0-7e12-4db9-a74e-8a12d177ecb0\") " pod="kube-system/kube-proxy-vw5ph"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953462 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-lib-modules\") pod \"kube-proxy-vw5ph\" (UID: \"fd3757e0-7e12-4db9-a74e-8a12d177ecb0\") " pod="kube-system/kube-proxy-vw5ph"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953490 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpflt\" (UniqueName: \"kubernetes.io/projected/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-kube-api-access-xpflt\") pod \"kube-proxy-vw5ph\" (UID: \"fd3757e0-7e12-4db9-a74e-8a12d177ecb0\") " pod="kube-system/kube-proxy-vw5ph"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953527 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/2ccf409a-3708-4cf1-834d-d74d3d1895dd-xtables-lock\") pod \"kindnet-hpnj7\" (UID: \"2ccf409a-3708-4cf1-834d-d74d3d1895dd\") " pod="kube-system/kindnet-hpnj7"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.953549 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ccf409a-3708-4cf1-834d-d74d3d1895dd-lib-modules\") pod \"kindnet-hpnj7\" (UID: \"2ccf409a-3708-4cf1-834d-d74d3d1895dd\") " pod="kube-system/kindnet-hpnj7"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.954065 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhsc2\" (UniqueName: \"kubernetes.io/projected/2ccf409a-3708-4cf1-834d-d74d3d1895dd-kube-api-access-mhsc2\") pod \"kindnet-hpnj7\" (UID: \"2ccf409a-3708-4cf1-834d-d74d3d1895dd\") " pod="kube-system/kindnet-hpnj7"
Nov 22 02:50:41 embed-certs-153115 kubelet[1340]: I1122 02:50:41.954127 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-kube-proxy\") pod \"kube-proxy-vw5ph\" (UID: \"fd3757e0-7e12-4db9-a74e-8a12d177ecb0\") " pod="kube-system/kube-proxy-vw5ph"
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061292 1340 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061318 1340 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061332 1340 projected.go:196] Error preparing data for projected volume kube-api-access-mhsc2 for pod kube-system/kindnet-hpnj7: configmap "kube-root-ca.crt" not found
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061336 1340 projected.go:196] Error preparing data for projected volume kube-api-access-xpflt for pod kube-system/kube-proxy-vw5ph: configmap "kube-root-ca.crt" not found
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061423 1340 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ccf409a-3708-4cf1-834d-d74d3d1895dd-kube-api-access-mhsc2 podName:2ccf409a-3708-4cf1-834d-d74d3d1895dd nodeName:}" failed. No retries permitted until 2025-11-22 02:50:42.561393938 +0000 UTC m=+6.217613043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhsc2" (UniqueName: "kubernetes.io/projected/2ccf409a-3708-4cf1-834d-d74d3d1895dd-kube-api-access-mhsc2") pod "kindnet-hpnj7" (UID: "2ccf409a-3708-4cf1-834d-d74d3d1895dd") : configmap "kube-root-ca.crt" not found
Nov 22 02:50:42 embed-certs-153115 kubelet[1340]: E1122 02:50:42.061445 1340 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-kube-api-access-xpflt podName:fd3757e0-7e12-4db9-a74e-8a12d177ecb0 nodeName:}" failed. No retries permitted until 2025-11-22 02:50:42.561436422 +0000 UTC m=+6.217655513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xpflt" (UniqueName: "kubernetes.io/projected/fd3757e0-7e12-4db9-a74e-8a12d177ecb0-kube-api-access-xpflt") pod "kube-proxy-vw5ph" (UID: "fd3757e0-7e12-4db9-a74e-8a12d177ecb0") : configmap "kube-root-ca.crt" not found
Nov 22 02:50:43 embed-certs-153115 kubelet[1340]: I1122 02:50:43.502869 1340 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-vw5ph" podStartSLOduration=2.502846851 podStartE2EDuration="2.502846851s" podCreationTimestamp="2025-11-22 02:50:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:43.485292107 +0000 UTC m=+7.141511213" watchObservedRunningTime="2025-11-22 02:50:43.502846851 +0000 UTC m=+7.159065941"
Nov 22 02:50:43 embed-certs-153115 kubelet[1340]: I1122 02:50:43.503219 1340 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-hpnj7" podStartSLOduration=2.503202196 podStartE2EDuration="2.503202196s" podCreationTimestamp="2025-11-22 02:50:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:43.502243511 +0000 UTC m=+7.158462606" watchObservedRunningTime="2025-11-22 02:50:43.503202196 +0000 UTC m=+7.159421299"
Nov 22 02:50:53 embed-certs-153115 kubelet[1340]: I1122 02:50:53.548640 1340 kubelet_node_status.go:439] "Fast updating node status as it just became ready"
Nov 22 02:50:53 embed-certs-153115 kubelet[1340]: I1122 02:50:53.738437 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/d2533f69-8428-47af-9e33-0a6aeb136e11-tmp\") pod \"storage-provisioner\" (UID: \"d2533f69-8428-47af-9e33-0a6aeb136e11\") " pod="kube-system/storage-provisioner"
Nov 22 02:50:53 embed-certs-153115 kubelet[1340]: I1122 02:50:53.738496 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88zp\" (UniqueName: \"kubernetes.io/projected/d2533f69-8428-47af-9e33-0a6aeb136e11-kube-api-access-j88zp\") pod \"storage-provisioner\" (UID: \"d2533f69-8428-47af-9e33-0a6aeb136e11\") " pod="kube-system/storage-provisioner"
Nov 22 02:50:53 embed-certs-153115 kubelet[1340]: I1122 02:50:53.839564 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48137095-0f96-4219-bffa-33209e851046-config-volume\") pod \"coredns-66bc5c9577-bq64j\" (UID: \"48137095-0f96-4219-bffa-33209e851046\") " pod="kube-system/coredns-66bc5c9577-bq64j"
Nov 22 02:50:53 embed-certs-153115 kubelet[1340]: I1122 02:50:53.839626 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ptc\" (UniqueName: \"kubernetes.io/projected/48137095-0f96-4219-bffa-33209e851046-kube-api-access-w5ptc\") pod \"coredns-66bc5c9577-bq64j\" (UID: \"48137095-0f96-4219-bffa-33209e851046\") " pod="kube-system/coredns-66bc5c9577-bq64j"
Nov 22 02:50:54 embed-certs-153115 kubelet[1340]: I1122 02:50:54.510996 1340 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=12.510973842 podStartE2EDuration="12.510973842s" podCreationTimestamp="2025-11-22 02:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:54.510853503 +0000 UTC m=+18.167072606" watchObservedRunningTime="2025-11-22 02:50:54.510973842 +0000 UTC m=+18.167192946"
Nov 22 02:50:56 embed-certs-153115 kubelet[1340]: I1122 02:50:56.519894 1340 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-66bc5c9577-bq64j" podStartSLOduration=14.519871289 podStartE2EDuration="14.519871289s" podCreationTimestamp="2025-11-22 02:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:54.52282651 +0000 UTC m=+18.179045613" watchObservedRunningTime="2025-11-22 02:50:56.519871289 +0000 UTC m=+20.176090395"
Nov 22 02:50:56 embed-certs-153115 kubelet[1340]: I1122 02:50:56.556506 1340 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcb9f\" (UniqueName: \"kubernetes.io/projected/3d98398f-9fa2-4e7d-99fb-dd974733447e-kube-api-access-qcb9f\") pod \"busybox\" (UID: \"3d98398f-9fa2-4e7d-99fb-dd974733447e\") " pod="default/busybox"
==> storage-provisioner [df12888a8b3cd3b6e6070512246b7d79a0a3e109ad6980c9e619ca179108c115] <==
I1122 02:50:54.098853 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:50:54.106169 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:50:54.106214 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:50:54.108203 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:54.112898 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:50:54.113070 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:50:54.113169 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"84de6baa-3d26-4bd0-914f-b52013e021b0", APIVersion:"v1", ResourceVersion:"408", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-153115_d2822a80-ef56-4044-b932-06d4e1869b93 became leader
I1122 02:50:54.113255 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_d2822a80-ef56-4044-b932-06d4e1869b93!
W1122 02:50:54.115507 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:54.120078 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:50:54.213962 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_d2822a80-ef56-4044-b932-06d4e1869b93!
W1122 02:50:56.122900 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:56.127306 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:58.130150 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:50:58.134783 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:00.137421 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:00.142361 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:02.145203 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:02.148922 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:04.152668 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:04.156965 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:269: (dbg) Run: kubectl --context embed-certs-153115 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/embed-certs/serial/EnableAddonWhileActive FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (2.18s)
=== RUN TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p old-k8s-version-169878 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p old-k8s-version-169878 --alsologtostderr -v=1: exit status 80 (2.37684189s)
-- stdout --
* Pausing node old-k8s-version-169878 ...
-- /stdout --
** stderr **
I1122 02:51:13.267890 323656 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:13.268033 323656 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:13.268043 323656 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:13.268050 323656 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:13.268302 323656 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:13.268537 323656 out.go:368] Setting JSON to false
I1122 02:51:13.268589 323656 mustload.go:66] Loading cluster: old-k8s-version-169878
I1122 02:51:13.269017 323656 config.go:182] Loaded profile config "old-k8s-version-169878": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.0
I1122 02:51:13.269626 323656 cli_runner.go:164] Run: docker container inspect old-k8s-version-169878 --format={{.State.Status}}
I1122 02:51:13.291442 323656 host.go:66] Checking if "old-k8s-version-169878" exists ...
I1122 02:51:13.291771 323656 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:13.366733 323656 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:85 OomKillDisable:false NGoroutines:88 SystemTime:2025-11-22 02:51:13.353703712 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:13.367613 323656 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:old-k8s-version-169878 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=
true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:51:13.369436 323656 out.go:179] * Pausing node old-k8s-version-169878 ...
I1122 02:51:13.370342 323656 host.go:66] Checking if "old-k8s-version-169878" exists ...
I1122 02:51:13.370673 323656 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:13.370733 323656 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-169878
I1122 02:51:13.392003 323656 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/old-k8s-version-169878/id_rsa Username:docker}
I1122 02:51:13.492964 323656 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:13.506810 323656 pause.go:52] kubelet running: true
I1122 02:51:13.506873 323656 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:13.751315 323656 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:13.751480 323656 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:13.840997 323656 cri.go:89] found id: "a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57"
I1122 02:51:13.841043 323656 cri.go:89] found id: "7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b"
I1122 02:51:13.841051 323656 cri.go:89] found id: "26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7"
I1122 02:51:13.841056 323656 cri.go:89] found id: "571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
I1122 02:51:13.841061 323656 cri.go:89] found id: "76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d"
I1122 02:51:13.841066 323656 cri.go:89] found id: "b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570"
I1122 02:51:13.841068 323656 cri.go:89] found id: "82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468"
I1122 02:51:13.841071 323656 cri.go:89] found id: "b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f"
I1122 02:51:13.841073 323656 cri.go:89] found id: "ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f"
I1122 02:51:13.841088 323656 cri.go:89] found id: "b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
I1122 02:51:13.841094 323656 cri.go:89] found id: "ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4"
I1122 02:51:13.841096 323656 cri.go:89] found id: ""
I1122 02:51:13.841140 323656 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:13.854377 323656 retry.go:31] will retry after 299.383555ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:13Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:14.154960 323656 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:14.168741 323656 pause.go:52] kubelet running: false
I1122 02:51:14.168802 323656 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:14.306682 323656 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:14.306766 323656 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:14.368649 323656 cri.go:89] found id: "a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57"
I1122 02:51:14.368670 323656 cri.go:89] found id: "7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b"
I1122 02:51:14.368674 323656 cri.go:89] found id: "26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7"
I1122 02:51:14.368677 323656 cri.go:89] found id: "571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
I1122 02:51:14.368680 323656 cri.go:89] found id: "76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d"
I1122 02:51:14.368684 323656 cri.go:89] found id: "b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570"
I1122 02:51:14.368686 323656 cri.go:89] found id: "82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468"
I1122 02:51:14.368689 323656 cri.go:89] found id: "b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f"
I1122 02:51:14.368692 323656 cri.go:89] found id: "ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f"
I1122 02:51:14.368701 323656 cri.go:89] found id: "b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
I1122 02:51:14.368706 323656 cri.go:89] found id: "ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4"
I1122 02:51:14.368709 323656 cri.go:89] found id: ""
I1122 02:51:14.368772 323656 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:14.380303 323656 retry.go:31] will retry after 234.920411ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:14Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:14.615757 323656 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:14.633961 323656 pause.go:52] kubelet running: false
I1122 02:51:14.634056 323656 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:14.816250 323656 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:14.816448 323656 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:14.910052 323656 cri.go:89] found id: "a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57"
I1122 02:51:14.910106 323656 cri.go:89] found id: "7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b"
I1122 02:51:14.910116 323656 cri.go:89] found id: "26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7"
I1122 02:51:14.910122 323656 cri.go:89] found id: "571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
I1122 02:51:14.910131 323656 cri.go:89] found id: "76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d"
I1122 02:51:14.910136 323656 cri.go:89] found id: "b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570"
I1122 02:51:14.910140 323656 cri.go:89] found id: "82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468"
I1122 02:51:14.910144 323656 cri.go:89] found id: "b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f"
I1122 02:51:14.910150 323656 cri.go:89] found id: "ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f"
I1122 02:51:14.910171 323656 cri.go:89] found id: "b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
I1122 02:51:14.910176 323656 cri.go:89] found id: "ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4"
I1122 02:51:14.910181 323656 cri.go:89] found id: ""
I1122 02:51:14.910246 323656 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:14.925150 323656 retry.go:31] will retry after 388.742704ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:14Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:15.314791 323656 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:15.329854 323656 pause.go:52] kubelet running: false
I1122 02:51:15.329965 323656 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:15.487097 323656 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:15.487174 323656 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:15.559315 323656 cri.go:89] found id: "a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57"
I1122 02:51:15.559342 323656 cri.go:89] found id: "7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b"
I1122 02:51:15.559348 323656 cri.go:89] found id: "26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7"
I1122 02:51:15.559353 323656 cri.go:89] found id: "571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
I1122 02:51:15.559358 323656 cri.go:89] found id: "76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d"
I1122 02:51:15.559363 323656 cri.go:89] found id: "b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570"
I1122 02:51:15.559367 323656 cri.go:89] found id: "82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468"
I1122 02:51:15.559371 323656 cri.go:89] found id: "b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f"
I1122 02:51:15.559375 323656 cri.go:89] found id: "ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f"
I1122 02:51:15.559395 323656 cri.go:89] found id: "b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
I1122 02:51:15.559399 323656 cri.go:89] found id: "ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4"
I1122 02:51:15.559404 323656 cri.go:89] found id: ""
I1122 02:51:15.559450 323656 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:15.573021 323656 out.go:203]
W1122 02:51:15.574021 323656 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:15Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:15Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:51:15.574037 323656 out.go:285] *
*
W1122 02:51:15.578130 323656 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:51:15.579299 323656 out.go:203]
** /stderr **
start_stop_delete_test.go:309: out/minikube-linux-amd64 pause -p old-k8s-version-169878 --alsologtostderr -v=1 failed: exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect old-k8s-version-169878
helpers_test.go:243: (dbg) docker inspect old-k8s-version-169878:
-- stdout --
[
{
"Id": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"Created": "2025-11-22T02:49:00.053065108Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 308037,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:50:14.33789729Z",
"FinishedAt": "2025-11-22T02:50:12.610253057Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hostname",
"HostsPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hosts",
"LogPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf-json.log",
"Name": "/old-k8s-version-169878",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-169878:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "old-k8s-version-169878",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"LowerDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/merged",
"UpperDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/diff",
"WorkDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-169878",
"Source": "/var/lib/docker/volumes/old-k8s-version-169878/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-169878",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-169878",
"name.minikube.sigs.k8s.io": "old-k8s-version-169878",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "463c0a6d27dd294b76c984fd9f93ffd8af361368f66bcfdd4ada0016b1c97d4b",
"SandboxKey": "/var/run/docker/netns/463c0a6d27dd",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33098"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33099"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33102"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33100"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33101"
}
]
},
"Networks": {
"old-k8s-version-169878": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "37299b5114cb0b65275d517d846c220687c34d27de79f0f10d855139d763153d",
"EndpointID": "b3306ca77ad483f3bec708b8e9a6b5edcc535b7438f78290196add08026a1c32",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "86:6e:6d:98:77:9b",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-169878",
"44c48c4768af"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878: exit status 2 (339.865688ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25: (1.180414811s)
helpers_test.go:260: TestStartStop/group/old-k8s-version/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p bridge-430524 sudo systemctl cat cri-docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cri-dockerd --version │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status containerd --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat containerd --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /lib/systemd/system/containerd.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/containerd/config.toml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo containerd config dump │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status crio --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:05
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:05.292401 321423 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:05.292667 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292678 321423 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:05.292681 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292854 321423 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:05.293268 321423 out.go:368] Setting JSON to false
I1122 02:51:05.294543 321423 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5608,"bootTime":1763774257,"procs":316,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:05.294619 321423 start.go:143] virtualization: kvm guest
I1122 02:51:05.298223 321423 out.go:179] * [no-preload-346270] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:05.299715 321423 notify.go:221] Checking for updates...
I1122 02:51:05.300188 321423 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:05.301353 321423 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:05.302343 321423 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:05.303355 321423 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:05.304816 321423 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:05.306003 321423 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:05.307779 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:05.308378 321423 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:05.342814 321423 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:05.342926 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.408579 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.397212874 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.408691 321423 docker.go:319] overlay module found
I1122 02:51:05.410366 321423 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:05.411604 321423 start.go:309] selected driver: docker
I1122 02:51:05.411620 321423 start.go:927] validating driver "docker" against &{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.411720 321423 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:05.412352 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.479062 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.468487111 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.479387 321423 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.479425 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:05.479488 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:05.479545 321423 start.go:353] cluster config:
{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.481151 321423 out.go:179] * Starting "no-preload-346270" primary control-plane node in "no-preload-346270" cluster
I1122 02:51:05.482190 321423 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:05.483749 321423 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:05.484664 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:05.484750 321423 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:05.484777 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.484964 321423 cache.go:107] acquiring lock: {Name:mk9fd95b82b8a0ed47b4c79f858a382e519ed06e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.484985 321423 cache.go:107] acquiring lock: {Name:mk4d199bf40a6d6ba931e5e3bad6703ee1d4331a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485046 321423 cache.go:107] acquiring lock: {Name:mk3054179b69a4ecffba6a1633407784706f4e81 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485081 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1122 02:51:05.485084 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 exists
I1122 02:51:05.485096 321423 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 147.057µs
I1122 02:51:05.485110 321423 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1" took 150.821µs
I1122 02:51:05.485119 321423 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1122 02:51:05.485124 321423 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 succeeded
I1122 02:51:05.485108 321423 cache.go:107] acquiring lock: {Name:mk650b39e13f205b236b21e6fa6a8094ff95570c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485097 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 exists
I1122 02:51:05.485112 321423 cache.go:107] acquiring lock: {Name:mkc2dd19224be48dd2b652c2ba743eee0462ec74 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485153 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 exists
I1122 02:51:05.485161 321423 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1" took 55.025µs
I1122 02:51:05.485170 321423 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 succeeded
I1122 02:51:05.485140 321423 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1" took 101.513µs
I1122 02:51:05.485159 321423 cache.go:107] acquiring lock: {Name:mk9d6260ac85fdcae594a014de4c63c0ef47e012 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485135 321423 cache.go:107] acquiring lock: {Name:mk4e022e496bff3a4a0a326b942b57b39fa644a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485197 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 exists
I1122 02:51:05.485220 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 exists
I1122 02:51:05.485218 321423 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1" took 127.649µs
I1122 02:51:05.485230 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 exists
I1122 02:51:05.485235 321423 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 succeeded
I1122 02:51:05.485185 321423 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 succeeded
I1122 02:51:05.485239 321423 cache.go:96] cache image "registry.k8s.io/pause:3.10.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1" took 106.694µs
I1122 02:51:05.485233 321423 cache.go:96] cache image "registry.k8s.io/etcd:3.6.4-0" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0" took 79.549µs
I1122 02:51:05.485247 321423 cache.go:80] save to tar file registry.k8s.io/pause:3.10.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 succeeded
I1122 02:51:05.485251 321423 cache.go:80] save to tar file registry.k8s.io/etcd:3.6.4-0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 succeeded
I1122 02:51:05.485161 321423 cache.go:107] acquiring lock: {Name:mk4196ba38e7d41483a23902afbddf94052a6ebe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485331 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 exists
I1122 02:51:05.485341 321423 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.12.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1" took 183.677µs
I1122 02:51:05.485354 321423 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.12.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 succeeded
I1122 02:51:05.485369 321423 cache.go:87] Successfully saved all images to host disk.
I1122 02:51:05.507064 321423 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:05.507087 321423 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:05.507109 321423 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:05.507137 321423 start.go:360] acquireMachinesLock for no-preload-346270: {Name:mkdc74b684c3fde528391b5ed567e203df475597 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.507200 321423 start.go:364] duration metric: took 43.77µs to acquireMachinesLock for "no-preload-346270"
I1122 02:51:05.507222 321423 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:05.507233 321423 fix.go:54] fixHost starting:
I1122 02:51:05.507494 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.529630 321423 fix.go:112] recreateIfNeeded on no-preload-346270: state=Stopped err=<nil>
W1122 02:51:05.529657 321423 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:02.471600 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
I1122 02:51:04.971022 315098 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:04.971052 315098 node_ready.go:38] duration metric: took 11.00298075s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:04.971069 315098 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:04.971121 315098 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:04.984450 315098 api_server.go:72] duration metric: took 11.311544446s to wait for apiserver process to appear ...
I1122 02:51:04.984479 315098 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:04.984501 315098 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:04.989715 315098 api_server.go:279] https://192.168.94.2:8444/healthz returned 200:
ok
I1122 02:51:04.990867 315098 api_server.go:141] control plane version: v1.34.1
I1122 02:51:04.990896 315098 api_server.go:131] duration metric: took 6.408983ms to wait for apiserver health ...
I1122 02:51:04.990935 315098 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:04.996740 315098 system_pods.go:59] 8 kube-system pods found
I1122 02:51:04.996785 315098 system_pods.go:61] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:04.996793 315098 system_pods.go:61] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:04.996806 315098 system_pods.go:61] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:04.996812 315098 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:04.996821 315098 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:04.996827 315098 system_pods.go:61] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:04.996834 315098 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:04.996840 315098 system_pods.go:61] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:04.996852 315098 system_pods.go:74] duration metric: took 5.908484ms to wait for pod list to return data ...
I1122 02:51:04.996866 315098 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:04.999454 315098 default_sa.go:45] found service account: "default"
I1122 02:51:04.999480 315098 default_sa.go:55] duration metric: took 2.607343ms for default service account to be created ...
I1122 02:51:04.999490 315098 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:05.002424 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.002458 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.002466 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.002478 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.002483 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.002489 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.002497 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.002502 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.002510 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.002527 315098 retry.go:31] will retry after 292.812059ms: missing components: kube-dns
I1122 02:51:05.300370 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.300409 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.300423 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.300436 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.300441 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.300450 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.300455 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.300460 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.300473 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.300509 315098 retry.go:31] will retry after 302.068749ms: missing components: kube-dns
I1122 02:51:05.608920 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.608952 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running
I1122 02:51:05.608962 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.608970 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.608976 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.608981 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.608986 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.608991 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.608996 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running
I1122 02:51:05.609006 315098 system_pods.go:126] duration metric: took 609.508843ms to wait for k8s-apps to be running ...
I1122 02:51:05.609016 315098 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:05.609060 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:05.622415 315098 system_svc.go:56] duration metric: took 13.394002ms WaitForService to wait for kubelet
I1122 02:51:05.622441 315098 kubeadm.go:587] duration metric: took 11.949540634s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.622465 315098 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:05.625578 315098 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:05.625607 315098 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:05.625627 315098 node_conditions.go:105] duration metric: took 3.155603ms to run NodePressure ...
I1122 02:51:05.625647 315098 start.go:242] waiting for startup goroutines ...
I1122 02:51:05.625660 315098 start.go:247] waiting for cluster config update ...
I1122 02:51:05.625677 315098 start.go:256] writing updated cluster config ...
I1122 02:51:05.625998 315098 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:05.629769 315098 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:05.634023 315098 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.639844 315098 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:51:05.639870 315098 pod_ready.go:86] duration metric: took 5.820698ms for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.642079 315098 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.646975 315098 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.646997 315098 pod_ready.go:86] duration metric: took 4.896289ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.650547 315098 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.656360 315098 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.656379 315098 pod_ready.go:86] duration metric: took 5.809428ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.658496 315098 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.034642 315098 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:06.034672 315098 pod_ready.go:86] duration metric: took 376.141388ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.235032 315098 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.634430 315098 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:51:06.634459 315098 pod_ready.go:86] duration metric: took 399.402834ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.834285 315098 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234497 315098 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:07.234529 315098 pod_ready.go:86] duration metric: took 400.219434ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234544 315098 pod_ready.go:40] duration metric: took 1.604742884s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:07.279768 315098 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:51:07.281342 315098 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
I1122 02:51:05.532532 321423 out.go:252] * Restarting existing docker container for "no-preload-346270" ...
I1122 02:51:05.532620 321423 cli_runner.go:164] Run: docker start no-preload-346270
I1122 02:51:05.816791 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.839930 321423 kic.go:430] container "no-preload-346270" state is running.
I1122 02:51:05.840366 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:05.860411 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.860662 321423 machine.go:94] provisionDockerMachine start ...
I1122 02:51:05.860741 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:05.880986 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:05.881268 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:05.881285 321423 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:05.882003 321423 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59850->127.0.0.1:33113: read: connection reset by peer
I1122 02:51:09.012278 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.012306 321423 ubuntu.go:182] provisioning hostname "no-preload-346270"
I1122 02:51:09.012365 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.029857 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.030223 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.030245 321423 main.go:143] libmachine: About to run SSH command:
sudo hostname no-preload-346270 && echo "no-preload-346270" | sudo tee /etc/hostname
I1122 02:51:09.169532 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.169634 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.187316 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.187555 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.187572 321423 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-346270' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-346270/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-346270' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:09.314808 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:09.314832 321423 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:09.314870 321423 ubuntu.go:190] setting up certificates
I1122 02:51:09.314884 321423 provision.go:84] configureAuth start
I1122 02:51:09.314968 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:09.333329 321423 provision.go:143] copyHostCerts
I1122 02:51:09.333396 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:09.333416 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:09.333497 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:09.333624 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:09.333638 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:09.333680 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:09.333781 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:09.333791 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:09.333828 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:09.333936 321423 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.no-preload-346270 san=[127.0.0.1 192.168.103.2 localhost minikube no-preload-346270]
I1122 02:51:09.380976 321423 provision.go:177] copyRemoteCerts
I1122 02:51:09.381023 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:09.381066 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.397774 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.491675 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:09.508429 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:51:09.525294 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:09.541666 321423 provision.go:87] duration metric: took 226.765786ms to configureAuth
I1122 02:51:09.541693 321423 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:09.541850 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:09.541987 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.559289 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.559516 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.559533 321423 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:09.861098 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:09.861128 321423 machine.go:97] duration metric: took 4.000446711s to provisionDockerMachine
I1122 02:51:09.861143 321423 start.go:293] postStartSetup for "no-preload-346270" (driver="docker")
I1122 02:51:09.861157 321423 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:09.861239 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:09.861284 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.880641 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.974101 321423 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:09.977444 321423 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:09.977475 321423 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:09.977488 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:09.977550 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:09.977649 321423 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:09.977772 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:09.985350 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:10.001752 321423 start.go:296] duration metric: took 140.596737ms for postStartSetup
I1122 02:51:10.001816 321423 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:10.001866 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.019452 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.109262 321423 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:10.113505 321423 fix.go:56] duration metric: took 4.606268175s for fixHost
I1122 02:51:10.113529 321423 start.go:83] releasing machines lock for "no-preload-346270", held for 4.606314821s
I1122 02:51:10.113590 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:10.130892 321423 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:10.130986 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.130993 321423 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:10.131044 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.148095 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.149275 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.237443 321423 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:10.288257 321423 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:10.322333 321423 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:10.326765 321423 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:10.326823 321423 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:10.334507 321423 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:10.334526 321423 start.go:496] detecting cgroup driver to use...
I1122 02:51:10.334559 321423 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:10.334612 321423 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:10.348194 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:10.359369 321423 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:10.359412 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:10.372620 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:10.384054 321423 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:10.463037 321423 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:10.545999 321423 docker.go:234] disabling docker service ...
I1122 02:51:10.546079 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:10.559066 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:10.570379 321423 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:10.648951 321423 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:10.726849 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:10.738572 321423 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:10.751757 321423 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:10.751813 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.760039 321423 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:10.760092 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.768370 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.776550 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.784678 321423 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:10.792267 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.800303 321423 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.808119 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.815945 321423 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:10.822682 321423 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:10.829812 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:10.909932 321423 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:11.047820 321423 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:11.047885 321423 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:11.051613 321423 start.go:564] Will wait 60s for crictl version
I1122 02:51:11.051669 321423 ssh_runner.go:195] Run: which crictl
I1122 02:51:11.055210 321423 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:11.081035 321423 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:11.081123 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.111141 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.140655 321423 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:11.141675 321423 cli_runner.go:164] Run: docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:11.161301 321423 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:51:11.165226 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.174797 321423 kubeadm.go:884] updating cluster {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:11.174956 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:11.175032 321423 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:11.204999 321423 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:11.205018 321423 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:11.205025 321423 kubeadm.go:935] updating node { 192.168.103.2 8443 v1.34.1 crio true true} ...
I1122 02:51:11.205128 321423 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-346270 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:11.205212 321423 ssh_runner.go:195] Run: crio config
I1122 02:51:11.248739 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:11.248761 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:11.248779 321423 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:11.248799 321423 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-346270 NodeName:no-preload-346270 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:11.250422 321423 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-346270"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.103.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:11.250742 321423 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:11.258573 321423 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:11.258616 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:11.265773 321423 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:11.277486 321423 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:11.289322 321423 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2216 bytes)
I1122 02:51:11.301167 321423 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:11.304669 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.314168 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:11.392747 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:11.414847 321423 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270 for IP: 192.168.103.2
I1122 02:51:11.414869 321423 certs.go:195] generating shared ca certs ...
I1122 02:51:11.414885 321423 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:11.415077 321423 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:11.415137 321423 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:11.415151 321423 certs.go:257] generating profile certs ...
I1122 02:51:11.415274 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/client.key
I1122 02:51:11.415348 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key.0aee8636
I1122 02:51:11.415420 321423 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key
I1122 02:51:11.415575 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:11.415618 321423 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:11.415632 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:11.415666 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:11.415698 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:11.415728 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:11.415782 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:11.416629 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:11.434099 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:11.452019 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:11.470785 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:11.493447 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:51:11.511840 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:11.528280 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:11.544534 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:11.560450 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:11.576652 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:11.592823 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:11.609677 321423 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:11.621229 321423 ssh_runner.go:195] Run: openssl version
I1122 02:51:11.627023 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:11.634796 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638198 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638247 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:11.673061 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:11.680196 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:11.688179 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691459 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691519 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.724729 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:11.732016 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:11.739896 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743358 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743390 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:11.779449 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:11.787202 321423 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:11.790931 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:11.825925 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:11.864004 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:11.897650 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:11.943987 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:11.991846 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:12.034579 321423 kubeadm.go:401] StartCluster: {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:12.034687 321423 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:12.034785 321423 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:12.070615 321423 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:12.070637 321423 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:12.070641 321423 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:12.070644 321423 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:12.070647 321423 cri.go:89] found id: ""
I1122 02:51:12.070686 321423 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:12.087235 321423 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:12Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:12.087306 321423 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:12.095436 321423 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:12.095461 321423 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:12.095502 321423 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:12.104006 321423 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:12.105338 321423 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-346270" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.106304 321423 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-346270" cluster setting kubeconfig missing "no-preload-346270" context setting]
I1122 02:51:12.107661 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.110159 321423 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:12.118041 321423 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.103.2
I1122 02:51:12.118077 321423 kubeadm.go:602] duration metric: took 22.610162ms to restartPrimaryControlPlane
I1122 02:51:12.118087 321423 kubeadm.go:403] duration metric: took 83.520469ms to StartCluster
I1122 02:51:12.118102 321423 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.118181 321423 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.120719 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.120932 321423 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:12.121053 321423 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:12.121149 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:12.121156 321423 addons.go:70] Setting storage-provisioner=true in profile "no-preload-346270"
I1122 02:51:12.121174 321423 addons.go:239] Setting addon storage-provisioner=true in "no-preload-346270"
W1122 02:51:12.121183 321423 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:12.121192 321423 addons.go:70] Setting default-storageclass=true in profile "no-preload-346270"
I1122 02:51:12.121206 321423 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "no-preload-346270"
I1122 02:51:12.121211 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121194 321423 addons.go:70] Setting dashboard=true in profile "no-preload-346270"
I1122 02:51:12.121234 321423 addons.go:239] Setting addon dashboard=true in "no-preload-346270"
W1122 02:51:12.121244 321423 addons.go:248] addon dashboard should already be in state true
I1122 02:51:12.121275 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121546 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121684 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121778 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.122684 321423 out.go:179] * Verifying Kubernetes components...
I1122 02:51:12.123731 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:12.147021 321423 addons.go:239] Setting addon default-storageclass=true in "no-preload-346270"
W1122 02:51:12.147091 321423 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:12.147131 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.147594 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.148252 321423 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:12.148252 321423 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:12.150224 321423 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.150242 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:12.150283 321423 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:12.150303 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.154020 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:12.154040 321423 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:12.154093 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.185355 321423 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.185384 321423 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:12.185448 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.186269 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.189464 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.214937 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.262215 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:12.274680 321423 node_ready.go:35] waiting up to 6m0s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:12.292510 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.300072 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:12.300091 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:12.315478 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:12.315499 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:12.321137 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.329365 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:12.329386 321423 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:12.343422 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:12.343436 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:12.356469 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:12.356528 321423 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:12.370188 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:12.370206 321423 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:12.383364 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:12.383385 321423 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:12.395140 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:12.395162 321423 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:12.407073 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:12.407091 321423 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:12.419200 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:13.706639 321423 node_ready.go:49] node "no-preload-346270" is "Ready"
I1122 02:51:13.706675 321423 node_ready.go:38] duration metric: took 1.431966817s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:13.706693 321423 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:13.706749 321423 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:14.227510 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.934969246s)
I1122 02:51:14.227590 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.906419176s)
I1122 02:51:14.227696 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.808462104s)
I1122 02:51:14.227749 321423 api_server.go:72] duration metric: took 2.106789491s to wait for apiserver process to appear ...
I1122 02:51:14.227772 321423 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:14.227797 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.232614 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.232635 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:14.233003 321423 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-346270 addons enable metrics-server
I1122 02:51:14.234413 321423 out.go:179] * Enabled addons: storage-provisioner, default-storageclass, dashboard
I1122 02:51:14.235431 321423 addons.go:530] duration metric: took 2.114388744s for enable addons: enabled=[storage-provisioner default-storageclass dashboard]
I1122 02:51:14.728204 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.732646 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.732670 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:15.228038 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:15.233046 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:51:15.234234 321423 api_server.go:141] control plane version: v1.34.1
I1122 02:51:15.234257 321423 api_server.go:131] duration metric: took 1.006474684s to wait for apiserver health ...
I1122 02:51:15.234265 321423 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:15.238124 321423 system_pods.go:59] 8 kube-system pods found
I1122 02:51:15.238151 321423 system_pods.go:61] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.238164 321423 system_pods.go:61] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.238187 321423 system_pods.go:61] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.238195 321423 system_pods.go:61] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.238203 321423 system_pods.go:61] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.238208 321423 system_pods.go:61] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.238215 321423 system_pods.go:61] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.238221 321423 system_pods.go:61] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.238229 321423 system_pods.go:74] duration metric: took 3.958929ms to wait for pod list to return data ...
I1122 02:51:15.238238 321423 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:15.240951 321423 default_sa.go:45] found service account: "default"
I1122 02:51:15.240971 321423 default_sa.go:55] duration metric: took 2.726862ms for default service account to be created ...
I1122 02:51:15.240981 321423 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:15.243750 321423 system_pods.go:86] 8 kube-system pods found
I1122 02:51:15.243773 321423 system_pods.go:89] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.243780 321423 system_pods.go:89] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.243789 321423 system_pods.go:89] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.243799 321423 system_pods.go:89] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.243807 321423 system_pods.go:89] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.243815 321423 system_pods.go:89] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.243824 321423 system_pods.go:89] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.243843 321423 system_pods.go:89] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.243853 321423 system_pods.go:126] duration metric: took 2.861267ms to wait for k8s-apps to be running ...
I1122 02:51:15.243866 321423 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:15.243945 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:15.258191 321423 system_svc.go:56] duration metric: took 14.317675ms WaitForService to wait for kubelet
I1122 02:51:15.258215 321423 kubeadm.go:587] duration metric: took 3.137259179s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:15.258229 321423 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:15.260690 321423 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:15.260711 321423 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:15.260725 321423 node_conditions.go:105] duration metric: took 2.491685ms to run NodePressure ...
I1122 02:51:15.260746 321423 start.go:242] waiting for startup goroutines ...
I1122 02:51:15.260760 321423 start.go:247] waiting for cluster config update ...
I1122 02:51:15.260778 321423 start.go:256] writing updated cluster config ...
I1122 02:51:15.261089 321423 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:15.264635 321423 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:15.268532 321423 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
==> CRI-O <==
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.92127268Z" level=info msg="Created container ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4: kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8/kubernetes-dashboard" id=42dff456-b9cb-408c-b031-11ff48162724 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.922248453Z" level=info msg="Starting container: ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4" id=5516f910-1ce4-43f6-87b4-ebe6179650d9 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.92477391Z" level=info msg="Started container" PID=1735 containerID=ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4 description=kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8/kubernetes-dashboard id=5516f910-1ce4-43f6-87b4-ebe6179650d9 name=/runtime.v1.RuntimeService/StartContainer sandboxID=f94a2585bc50cb3ebb8626001871a4d532ffcd646151fc0ea370e53dea14fa76
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.175061364Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=90772dfb-a4c5-48ca-88ce-0a768b74a33a name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.175995933Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=fe2a5830-e4f6-4eaa-bf4d-15a7584e1099 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.177058511Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=1c96d043-8e4f-4791-bdf6-b3e30f8d6803 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.177179986Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.18161767Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.181803838Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/0d3a90672308e31c0319338ceb9e43f5d681c103417fc9b6e2b9af427b438d42/merged/etc/passwd: no such file or directory"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.181839183Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/0d3a90672308e31c0319338ceb9e43f5d681c103417fc9b6e2b9af427b438d42/merged/etc/group: no such file or directory"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.182145909Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.207281273Z" level=info msg="Created container a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57: kube-system/storage-provisioner/storage-provisioner" id=1c96d043-8e4f-4791-bdf6-b3e30f8d6803 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.207757299Z" level=info msg="Starting container: a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57" id=5d48b732-91b2-46d3-be85-3d20a9c8e9f0 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.209507459Z" level=info msg="Started container" PID=1759 containerID=a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57 description=kube-system/storage-provisioner/storage-provisioner id=5d48b732-91b2-46d3-be85-3d20a9c8e9f0 name=/runtime.v1.RuntimeService/StartContainer sandboxID=b4a1da1a3b203a6e2fa5b9257e2b0338d202a8da2bf68be85f3a6a794875d51e
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.063525841Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=6632c1c7-5c42-4b38-82a6-3c70b9235a17 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.064327018Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=188bd952-2e1c-49de-b8c5-50d9d4d5c819 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.065204411Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=12df8b67-e992-4b39-8b48-156de2469e8f name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.065342593Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.070534774Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.071085582Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.095544338Z" level=info msg="Created container b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=12df8b67-e992-4b39-8b48-156de2469e8f name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.095992239Z" level=info msg="Starting container: b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314" id=f3855b67-e79b-4562-8564-9b106ea24195 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.097586964Z" level=info msg="Started container" PID=1795 containerID=b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314 description=kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper id=f3855b67-e79b-4562-8564-9b106ea24195 name=/runtime.v1.RuntimeService/StartContainer sandboxID=28dcacd17b306cd76ff62607992c15cd475c5c02906d7a0e55bbbff2e62daa2a
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.194203743Z" level=info msg="Removing container: fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e" id=14474f9b-3550-4497-b3b5-b605196a756c name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.202586912Z" level=info msg="Removed container fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=14474f9b-3550-4497-b3b5-b605196a756c name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
b69855642e801 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 14 seconds ago Exited dashboard-metrics-scraper 2 28dcacd17b306 dashboard-metrics-scraper-5f989dc9cf-5t77w kubernetes-dashboard
a47b31eceb737 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 21 seconds ago Running storage-provisioner 1 b4a1da1a3b203 storage-provisioner kube-system
ebd36dba3f464 docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 32 seconds ago Running kubernetes-dashboard 0 f94a2585bc50c kubernetes-dashboard-8694d4445c-mr7x8 kubernetes-dashboard
e55d006f4fb79 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 52 seconds ago Running busybox 1 7c306a7c40910 busybox default
7fc7ba9d097d7 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 52 seconds ago Running coredns 0 145bed249f8f5 coredns-5dd5756b68-fkcs9 kube-system
26f76332ea264 ea1030da44aa18666a7bf15fddd2a38c3143c3277159cb8bdd95f45c8ce62d7a 52 seconds ago Running kube-proxy 0 f3c7477d0b56e kube-proxy-c7nnb kube-system
571a714d8715e 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 52 seconds ago Exited storage-provisioner 0 b4a1da1a3b203 storage-provisioner kube-system
76030ce734602 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 52 seconds ago Running kindnet-cni 0 025af843c9001 kindnet-ptwwj kube-system
b96fc7cf548ba f6f496300a2ae7a6727ccf3080d66d2fd22b6cfc271df5351c976c23a28bb157 55 seconds ago Running kube-scheduler 0 56ab9bee4993e kube-scheduler-old-k8s-version-169878 kube-system
82d373551c054 bb5e0dde9054c02d6badee88547be7e7bb7b7b818d277c8a61b4b29484bbff95 55 seconds ago Running kube-apiserver 0 68897e91b8407 kube-apiserver-old-k8s-version-169878 kube-system
b020497f5a6f6 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 55 seconds ago Running etcd 0 f13c7601987a1 etcd-old-k8s-version-169878 kube-system
ab5eb437c1875 4be79c38a4bab6e1252a35697500e8a0d9c5c7c771d9fcc1935c9a7f6cdf4c62 55 seconds ago Running kube-controller-manager 0 5b1de03a32d1b kube-controller-manager-old-k8s-version-169878 kube-system
==> coredns [7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 8aa94104b4dae56b00431f7362ac05b997af2246775de35dc2eb361b0707b2fa7199f9ddfdba27fdef1331b76d09c41700f6cb5d00836dabab7c0df8e651283f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] 127.0.0.1:60142 - 49769 "HINFO IN 2788691698134012747.4331806363309765400. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.500424102s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-169878
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-169878
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=old-k8s-version-169878
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_49_17_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:49:13 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-169878
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:04 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:42 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-169878
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 57df10e8-2d05-435a-9964-d44e1c0a4356
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.28.0
Kube-Proxy Version: v1.28.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 90s
kube-system coredns-5dd5756b68-fkcs9 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 107s
kube-system etcd-old-k8s-version-169878 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 2m
kube-system kindnet-ptwwj 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 108s
kube-system kube-apiserver-old-k8s-version-169878 250m (3%) 0 (0%) 0 (0%) 0 (0%) 2m
kube-system kube-controller-manager-old-k8s-version-169878 200m (2%) 0 (0%) 0 (0%) 0 (0%) 2m
kube-system kube-proxy-c7nnb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 108s
kube-system kube-scheduler-old-k8s-version-169878 100m (1%) 0 (0%) 0 (0%) 0 (0%) 2m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 107s
kubernetes-dashboard dashboard-metrics-scraper-5f989dc9cf-5t77w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 39s
kubernetes-dashboard kubernetes-dashboard-8694d4445c-mr7x8 0 (0%) 0 (0%) 0 (0%) 0 (0%) 39s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 106s kube-proxy
Normal Starting 52s kube-proxy
Normal Starting 2m5s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 2m5s (x8 over 2m5s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 2m5s (x8 over 2m5s) kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m5s (x8 over 2m5s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 2m kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 2m kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 2m kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal Starting 2m kubelet Starting kubelet.
Normal RegisteredNode 108s node-controller Node old-k8s-version-169878 event: Registered Node old-k8s-version-169878 in Controller
Normal NodeReady 94s kubelet Node old-k8s-version-169878 status is now: NodeReady
Normal Starting 55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 55s (x8 over 55s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 55s (x8 over 55s) kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 55s (x8 over 55s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal RegisteredNode 40s node-controller Node old-k8s-version-169878 event: Registered Node old-k8s-version-169878 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f] <==
{"level":"info","ts":"2025-11-22T02:50:22.701416Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701513Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701558Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701591Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.70161Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.70163Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.701649Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.702737Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:old-k8s-version-169878 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
{"level":"info","ts":"2025-11-22T02:50:22.702803Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:50:22.703086Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2025-11-22T02:50:22.703183Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2025-11-22T02:50:22.70282Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:50:22.704421Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2025-11-22T02:50:22.704841Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.85.2:2379"}
{"level":"info","ts":"2025-11-22T02:50:30.587704Z","caller":"traceutil/trace.go:171","msg":"trace[1426692367] transaction","detail":"{read_only:false; response_revision:502; number_of_response:1; }","duration":"129.431443ms","start":"2025-11-22T02:50:30.458243Z","end":"2025-11-22T02:50:30.587675Z","steps":["trace[1426692367] 'process raft request' (duration: 128.856456ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:30.846467Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"128.128008ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413836 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b38ff\" mod_revision:0 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b38ff\" value_size:658 lease:499225186365638023 >> failure:<>>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:30.846561Z","caller":"traceutil/trace.go:171","msg":"trace[638011859] transaction","detail":"{read_only:false; response_revision:503; number_of_response:1; }","duration":"255.691505ms","start":"2025-11-22T02:50:30.590852Z","end":"2025-11-22T02:50:30.846543Z","steps":["trace[638011859] 'process raft request' (duration: 127.181383ms)","trace[638011859] 'compare' (duration: 128.034975ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:31.063985Z","caller":"traceutil/trace.go:171","msg":"trace[563655906] transaction","detail":"{read_only:false; response_revision:506; number_of_response:1; }","duration":"120.330343ms","start":"2025-11-22T02:50:30.94362Z","end":"2025-11-22T02:50:31.06395Z","steps":["trace[563655906] 'process raft request' (duration: 119.604267ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:31.314541Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.708592ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413843 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" mod_revision:504 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" value_size:654 lease:499225186365638023 >> failure:<request_range:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:31.314615Z","caller":"traceutil/trace.go:171","msg":"trace[934271222] linearizableReadLoop","detail":"{readStateIndex:532; appliedIndex:531; }","duration":"244.708017ms","start":"2025-11-22T02:50:31.069893Z","end":"2025-11-22T02:50:31.314601Z","steps":["trace[934271222] 'read index received' (duration: 116.787919ms)","trace[934271222] 'applied index is now lower than readState.Index' (duration: 127.919109ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:31.314676Z","caller":"traceutil/trace.go:171","msg":"trace[876851820] transaction","detail":"{read_only:false; response_revision:507; number_of_response:1; }","duration":"246.260982ms","start":"2025-11-22T02:50:31.068393Z","end":"2025-11-22T02:50:31.314655Z","steps":["trace[876851820] 'process raft request' (duration: 118.29001ms)","trace[876851820] 'compare' (duration: 127.62336ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:31.314725Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"244.816164ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/old-k8s-version-169878\" ","response":"range_response_count:1 size:6061"}
{"level":"info","ts":"2025-11-22T02:50:31.31475Z","caller":"traceutil/trace.go:171","msg":"trace[545138702] range","detail":"{range_begin:/registry/minions/old-k8s-version-169878; range_end:; response_count:1; response_revision:507; }","duration":"244.878418ms","start":"2025-11-22T02:50:31.069863Z","end":"2025-11-22T02:50:31.314741Z","steps":["trace[545138702] 'agreement among raft nodes before linearized reading' (duration: 244.773531ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:31.596454Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"128.295807ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413850 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" mod_revision:507 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" value_size:654 lease:499225186365638023 >> failure:<request_range:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:31.596579Z","caller":"traceutil/trace.go:171","msg":"trace[871619091] transaction","detail":"{read_only:false; response_revision:510; number_of_response:1; }","duration":"255.014147ms","start":"2025-11-22T02:50:31.341525Z","end":"2025-11-22T02:50:31.596539Z","steps":["trace[871619091] 'process raft request' (duration: 126.5654ms)","trace[871619091] 'compare' (duration: 128.206861ms)"],"step_count":2}
==> kernel <==
02:51:16 up 1:33, 0 user, load average: 5.02, 3.85, 2.25
Linux old-k8s-version-169878 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d] <==
I1122 02:50:24.704003 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:50:24.704271 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:50:24.704456 1 main.go:148] setting mtu 1500 for CNI
I1122 02:50:24.704479 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:50:24.704501 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:50:24Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:50:24.908479 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:50:24.908514 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:50:24.908526 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:50:24.908668 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:50:25.302287 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:50:25.302319 1 metrics.go:72] Registering metrics
I1122 02:50:25.302396 1 controller.go:711] "Syncing nftables rules"
I1122 02:50:34.908045 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:34.908100 1 main.go:301] handling current node
I1122 02:50:44.908079 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:44.908127 1 main.go:301] handling current node
I1122 02:50:54.908216 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:54.908261 1 main.go:301] handling current node
I1122 02:51:04.909063 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:51:04.909104 1 main.go:301] handling current node
I1122 02:51:14.914020 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:51:14.914063 1 main.go:301] handling current node
==> kube-apiserver [82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468] <==
I1122 02:50:23.915996 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:50:23.926800 1 apf_controller.go:377] Running API Priority and Fairness config worker
I1122 02:50:23.926821 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I1122 02:50:23.928953 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I1122 02:50:23.930894 1 shared_informer.go:318] Caches are synced for configmaps
I1122 02:50:23.931700 1 cache.go:39] Caches are synced for AvailableConditionController controller
I1122 02:50:23.932745 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:50:23.940072 1 shared_informer.go:318] Caches are synced for crd-autoregister
I1122 02:50:23.940104 1 aggregator.go:166] initial CRD sync complete...
I1122 02:50:23.940111 1 autoregister_controller.go:141] Starting autoregister controller
I1122 02:50:23.940117 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:50:23.940125 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:50:23.986178 1 shared_informer.go:318] Caches are synced for node_authorizer
I1122 02:50:24.832346 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:50:24.906801 1 controller.go:624] quota admission added evaluator for: namespaces
I1122 02:50:24.938894 1 controller.go:624] quota admission added evaluator for: deployments.apps
I1122 02:50:24.956640 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:50:24.964397 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:50:24.972458 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I1122 02:50:25.006564 1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.104.50.86"}
I1122 02:50:25.019154 1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.99.151.27"}
I1122 02:50:36.885166 1 controller.go:624] quota admission added evaluator for: replicasets.apps
I1122 02:50:37.084880 1 controller.go:624] quota admission added evaluator for: endpoints
I1122 02:50:37.084880 1 controller.go:624] quota admission added evaluator for: endpoints
I1122 02:50:37.333113 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-controller-manager [ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f] <==
I1122 02:50:36.976895 1 shared_informer.go:318] Caches are synced for persistent volume
I1122 02:50:37.289878 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="484.745562ms"
I1122 02:50:37.290076 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="117.31µs"
I1122 02:50:37.294192 1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-8694d4445c-mr7x8"
I1122 02:50:37.294352 1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-5f989dc9cf-5t77w"
I1122 02:50:37.302421 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="413.812596ms"
I1122 02:50:37.303843 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="415.077695ms"
I1122 02:50:37.310235 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="6.98103ms"
I1122 02:50:37.310332 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="40.505µs"
I1122 02:50:37.311180 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="7.290194ms"
I1122 02:50:37.311318 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="43.703µs"
I1122 02:50:37.317546 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="46.61µs"
I1122 02:50:37.326542 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="54.801µs"
I1122 02:50:37.359632 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:50:37.378022 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:50:37.378052 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
I1122 02:50:40.142205 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="104.438µs"
I1122 02:50:41.152809 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="59.616µs"
I1122 02:50:42.155457 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="100.155µs"
I1122 02:50:44.173875 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="7.161598ms"
I1122 02:50:44.174008 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="67.743µs"
I1122 02:50:59.919127 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="8.396922ms"
I1122 02:50:59.919227 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="57.307µs"
I1122 02:51:02.202969 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="103.326µs"
I1122 02:51:07.616181 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="91.757µs"
==> kube-proxy [26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7] <==
I1122 02:50:24.529528 1 server_others.go:69] "Using iptables proxy"
I1122 02:50:24.542031 1 node.go:141] Successfully retrieved node IP: 192.168.85.2
I1122 02:50:24.562866 1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:50:24.565396 1 server_others.go:152] "Using iptables Proxier"
I1122 02:50:24.565420 1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
I1122 02:50:24.565427 1 server_others.go:438] "Defaulting to no-op detect-local"
I1122 02:50:24.565443 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I1122 02:50:24.565666 1 server.go:846] "Version info" version="v1.28.0"
I1122 02:50:24.565679 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:24.566240 1 config.go:97] "Starting endpoint slice config controller"
I1122 02:50:24.566311 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I1122 02:50:24.566232 1 config.go:188] "Starting service config controller"
I1122 02:50:24.567898 1 shared_informer.go:311] Waiting for caches to sync for service config
I1122 02:50:24.567210 1 config.go:315] "Starting node config controller"
I1122 02:50:24.567947 1 shared_informer.go:311] Waiting for caches to sync for node config
I1122 02:50:24.666408 1 shared_informer.go:318] Caches are synced for endpoint slice config
I1122 02:50:24.668530 1 shared_informer.go:318] Caches are synced for node config
I1122 02:50:24.668545 1 shared_informer.go:318] Caches are synced for service config
==> kube-scheduler [b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570] <==
I1122 02:50:22.258082 1 serving.go:348] Generated self-signed cert in-memory
W1122 02:50:23.889960 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:50:23.890001 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:50:23.890022 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:50:23.890035 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:50:23.924594 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.0"
I1122 02:50:23.924829 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:23.926573 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:50:23.926627 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1122 02:50:23.927777 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I1122 02:50:23.927889 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I1122 02:50:24.027621 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382157 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/da45cfda-d75d-4960-94d8-f5328f8ded9c-tmp-volume\") pod \"kubernetes-dashboard-8694d4445c-mr7x8\" (UID: \"da45cfda-d75d-4960-94d8-f5328f8ded9c\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382231 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnxr\" (UniqueName: \"kubernetes.io/projected/da45cfda-d75d-4960-94d8-f5328f8ded9c-kube-api-access-wjnxr\") pod \"kubernetes-dashboard-8694d4445c-mr7x8\" (UID: \"da45cfda-d75d-4960-94d8-f5328f8ded9c\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382389 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3ba8175-8509-42f0-8a5a-33377efc651a-tmp-volume\") pod \"dashboard-metrics-scraper-5f989dc9cf-5t77w\" (UID: \"e3ba8175-8509-42f0-8a5a-33377efc651a\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382434 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wb9\" (UniqueName: \"kubernetes.io/projected/e3ba8175-8509-42f0-8a5a-33377efc651a-kube-api-access-n5wb9\") pod \"dashboard-metrics-scraper-5f989dc9cf-5t77w\" (UID: \"e3ba8175-8509-42f0-8a5a-33377efc651a\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w"
Nov 22 02:50:40 old-k8s-version-169878 kubelet[717]: I1122 02:50:40.131548 717 scope.go:117] "RemoveContainer" containerID="0fdb9a5528ab4b40237a10572ca29882cc3330ce775a66453419eec41b06cfb0"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: I1122 02:50:41.139353 717 scope.go:117] "RemoveContainer" containerID="0fdb9a5528ab4b40237a10572ca29882cc3330ce775a66453419eec41b06cfb0"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: I1122 02:50:41.139462 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: E1122 02:50:41.139856 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:42 old-k8s-version-169878 kubelet[717]: I1122 02:50:42.143544 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:42 old-k8s-version-169878 kubelet[717]: E1122 02:50:42.143952 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:44 old-k8s-version-169878 kubelet[717]: I1122 02:50:44.166716 717 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8" podStartSLOduration=0.933354582 podCreationTimestamp="2025-11-22 02:50:37 +0000 UTC" firstStartedPulling="2025-11-22 02:50:37.633604714 +0000 UTC m=+16.718194179" lastFinishedPulling="2025-11-22 02:50:43.866888224 +0000 UTC m=+22.951477691" observedRunningTime="2025-11-22 02:50:44.166082224 +0000 UTC m=+23.250671701" watchObservedRunningTime="2025-11-22 02:50:44.166638094 +0000 UTC m=+23.251227568"
Nov 22 02:50:47 old-k8s-version-169878 kubelet[717]: I1122 02:50:47.606744 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:47 old-k8s-version-169878 kubelet[717]: E1122 02:50:47.607095 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:55 old-k8s-version-169878 kubelet[717]: I1122 02:50:55.174548 717 scope.go:117] "RemoveContainer" containerID="571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.062997 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.193115 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.193329 717 scope.go:117] "RemoveContainer" containerID="b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: E1122 02:51:02.193635 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:51:07 old-k8s-version-169878 kubelet[717]: I1122 02:51:07.607249 717 scope.go:117] "RemoveContainer" containerID="b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
Nov 22 02:51:07 old-k8s-version-169878 kubelet[717]: E1122 02:51:07.607619 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:51:13 old-k8s-version-169878 kubelet[717]: I1122 02:51:13.723921 717 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: kubelet.service: Consumed 1.451s CPU time.
==> kubernetes-dashboard [ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4] <==
2025/11/22 02:50:43 Using namespace: kubernetes-dashboard
2025/11/22 02:50:43 Using in-cluster config to connect to apiserver
2025/11/22 02:50:43 Using secret token for csrf signing
2025/11/22 02:50:43 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:50:43 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:50:43 Successful initial request to the apiserver, version: v1.28.0
2025/11/22 02:50:43 Generating JWE encryption key
2025/11/22 02:50:43 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:50:43 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:50:44 Initializing JWE encryption key from synchronized object
2025/11/22 02:50:44 Creating in-cluster Sidecar client
2025/11/22 02:50:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:50:44 Serving insecurely on HTTP port: 9090
2025/11/22 02:51:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:50:43 Starting overwatch
==> storage-provisioner [571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70] <==
I1122 02:50:24.485039 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:50:54.488090 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57] <==
I1122 02:50:55.221095 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:50:55.228124 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:50:55.228196 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1122 02:51:12.622117 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:51:12.622172 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8a847876-9310-429d-b2a3-b558de50b707", APIVersion:"v1", ResourceVersion:"655", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144 became leader
I1122 02:51:12.622254 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144!
I1122 02:51:12.722441 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144!
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-169878 -n old-k8s-version-169878
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-169878 -n old-k8s-version-169878: exit status 2 (336.724411ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context old-k8s-version-169878 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect old-k8s-version-169878
helpers_test.go:243: (dbg) docker inspect old-k8s-version-169878:
-- stdout --
[
{
"Id": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"Created": "2025-11-22T02:49:00.053065108Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 308037,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:50:14.33789729Z",
"FinishedAt": "2025-11-22T02:50:12.610253057Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hostname",
"HostsPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/hosts",
"LogPath": "/var/lib/docker/containers/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf/44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf-json.log",
"Name": "/old-k8s-version-169878",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-169878:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "old-k8s-version-169878",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "44c48c4768af2036ee63b8f458ba96aa8c5503f7d07062f8ae30fca9497d4ecf",
"LowerDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/merged",
"UpperDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/diff",
"WorkDir": "/var/lib/docker/overlay2/fa09f171a3323a1fc332441354ed7fa36e5b92448e1341852785d1c4afc187be/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-169878",
"Source": "/var/lib/docker/volumes/old-k8s-version-169878/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-169878",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-169878",
"name.minikube.sigs.k8s.io": "old-k8s-version-169878",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "463c0a6d27dd294b76c984fd9f93ffd8af361368f66bcfdd4ada0016b1c97d4b",
"SandboxKey": "/var/run/docker/netns/463c0a6d27dd",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33098"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33099"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33102"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33100"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33101"
}
]
},
"Networks": {
"old-k8s-version-169878": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "37299b5114cb0b65275d517d846c220687c34d27de79f0f10d855139d763153d",
"EndpointID": "b3306ca77ad483f3bec708b8e9a6b5edcc535b7438f78290196add08026a1c32",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "86:6e:6d:98:77:9b",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-169878",
"44c48c4768af"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878: exit status 2 (322.589422ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-169878 logs -n 25: (1.067429352s)
helpers_test.go:260: TestStartStop/group/old-k8s-version/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p bridge-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cri-dockerd --version │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status containerd --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat containerd --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /lib/systemd/system/containerd.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/containerd/config.toml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo containerd config dump │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status crio --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:05
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:05.292401 321423 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:05.292667 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292678 321423 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:05.292681 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292854 321423 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:05.293268 321423 out.go:368] Setting JSON to false
I1122 02:51:05.294543 321423 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5608,"bootTime":1763774257,"procs":316,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:05.294619 321423 start.go:143] virtualization: kvm guest
I1122 02:51:05.298223 321423 out.go:179] * [no-preload-346270] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:05.299715 321423 notify.go:221] Checking for updates...
I1122 02:51:05.300188 321423 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:05.301353 321423 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:05.302343 321423 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:05.303355 321423 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:05.304816 321423 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:05.306003 321423 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:05.307779 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:05.308378 321423 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:05.342814 321423 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:05.342926 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.408579 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.397212874 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.408691 321423 docker.go:319] overlay module found
I1122 02:51:05.410366 321423 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:05.411604 321423 start.go:309] selected driver: docker
I1122 02:51:05.411620 321423 start.go:927] validating driver "docker" against &{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.411720 321423 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:05.412352 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.479062 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.468487111 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.479387 321423 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.479425 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:05.479488 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:05.479545 321423 start.go:353] cluster config:
{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.481151 321423 out.go:179] * Starting "no-preload-346270" primary control-plane node in "no-preload-346270" cluster
I1122 02:51:05.482190 321423 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:05.483749 321423 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:05.484664 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:05.484750 321423 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:05.484777 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.484964 321423 cache.go:107] acquiring lock: {Name:mk9fd95b82b8a0ed47b4c79f858a382e519ed06e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.484985 321423 cache.go:107] acquiring lock: {Name:mk4d199bf40a6d6ba931e5e3bad6703ee1d4331a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485046 321423 cache.go:107] acquiring lock: {Name:mk3054179b69a4ecffba6a1633407784706f4e81 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485081 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1122 02:51:05.485084 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 exists
I1122 02:51:05.485096 321423 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 147.057µs
I1122 02:51:05.485110 321423 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1" took 150.821µs
I1122 02:51:05.485119 321423 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1122 02:51:05.485124 321423 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 succeeded
I1122 02:51:05.485108 321423 cache.go:107] acquiring lock: {Name:mk650b39e13f205b236b21e6fa6a8094ff95570c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485097 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 exists
I1122 02:51:05.485112 321423 cache.go:107] acquiring lock: {Name:mkc2dd19224be48dd2b652c2ba743eee0462ec74 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485153 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 exists
I1122 02:51:05.485161 321423 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1" took 55.025µs
I1122 02:51:05.485170 321423 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 succeeded
I1122 02:51:05.485140 321423 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1" took 101.513µs
I1122 02:51:05.485159 321423 cache.go:107] acquiring lock: {Name:mk9d6260ac85fdcae594a014de4c63c0ef47e012 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485135 321423 cache.go:107] acquiring lock: {Name:mk4e022e496bff3a4a0a326b942b57b39fa644a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485197 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 exists
I1122 02:51:05.485220 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 exists
I1122 02:51:05.485218 321423 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1" took 127.649µs
I1122 02:51:05.485230 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 exists
I1122 02:51:05.485235 321423 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 succeeded
I1122 02:51:05.485185 321423 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 succeeded
I1122 02:51:05.485239 321423 cache.go:96] cache image "registry.k8s.io/pause:3.10.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1" took 106.694µs
I1122 02:51:05.485233 321423 cache.go:96] cache image "registry.k8s.io/etcd:3.6.4-0" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0" took 79.549µs
I1122 02:51:05.485247 321423 cache.go:80] save to tar file registry.k8s.io/pause:3.10.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 succeeded
I1122 02:51:05.485251 321423 cache.go:80] save to tar file registry.k8s.io/etcd:3.6.4-0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 succeeded
I1122 02:51:05.485161 321423 cache.go:107] acquiring lock: {Name:mk4196ba38e7d41483a23902afbddf94052a6ebe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485331 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 exists
I1122 02:51:05.485341 321423 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.12.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1" took 183.677µs
I1122 02:51:05.485354 321423 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.12.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 succeeded
I1122 02:51:05.485369 321423 cache.go:87] Successfully saved all images to host disk.
I1122 02:51:05.507064 321423 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:05.507087 321423 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:05.507109 321423 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:05.507137 321423 start.go:360] acquireMachinesLock for no-preload-346270: {Name:mkdc74b684c3fde528391b5ed567e203df475597 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.507200 321423 start.go:364] duration metric: took 43.77µs to acquireMachinesLock for "no-preload-346270"
I1122 02:51:05.507222 321423 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:05.507233 321423 fix.go:54] fixHost starting:
I1122 02:51:05.507494 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.529630 321423 fix.go:112] recreateIfNeeded on no-preload-346270: state=Stopped err=<nil>
W1122 02:51:05.529657 321423 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:02.471600 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
I1122 02:51:04.971022 315098 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:04.971052 315098 node_ready.go:38] duration metric: took 11.00298075s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:04.971069 315098 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:04.971121 315098 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:04.984450 315098 api_server.go:72] duration metric: took 11.311544446s to wait for apiserver process to appear ...
I1122 02:51:04.984479 315098 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:04.984501 315098 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:04.989715 315098 api_server.go:279] https://192.168.94.2:8444/healthz returned 200:
ok
I1122 02:51:04.990867 315098 api_server.go:141] control plane version: v1.34.1
I1122 02:51:04.990896 315098 api_server.go:131] duration metric: took 6.408983ms to wait for apiserver health ...
I1122 02:51:04.990935 315098 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:04.996740 315098 system_pods.go:59] 8 kube-system pods found
I1122 02:51:04.996785 315098 system_pods.go:61] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:04.996793 315098 system_pods.go:61] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:04.996806 315098 system_pods.go:61] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:04.996812 315098 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:04.996821 315098 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:04.996827 315098 system_pods.go:61] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:04.996834 315098 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:04.996840 315098 system_pods.go:61] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:04.996852 315098 system_pods.go:74] duration metric: took 5.908484ms to wait for pod list to return data ...
I1122 02:51:04.996866 315098 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:04.999454 315098 default_sa.go:45] found service account: "default"
I1122 02:51:04.999480 315098 default_sa.go:55] duration metric: took 2.607343ms for default service account to be created ...
I1122 02:51:04.999490 315098 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:05.002424 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.002458 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.002466 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.002478 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.002483 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.002489 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.002497 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.002502 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.002510 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.002527 315098 retry.go:31] will retry after 292.812059ms: missing components: kube-dns
I1122 02:51:05.300370 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.300409 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.300423 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.300436 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.300441 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.300450 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.300455 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.300460 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.300473 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.300509 315098 retry.go:31] will retry after 302.068749ms: missing components: kube-dns
I1122 02:51:05.608920 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.608952 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running
I1122 02:51:05.608962 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.608970 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.608976 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.608981 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.608986 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.608991 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.608996 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running
I1122 02:51:05.609006 315098 system_pods.go:126] duration metric: took 609.508843ms to wait for k8s-apps to be running ...
I1122 02:51:05.609016 315098 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:05.609060 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:05.622415 315098 system_svc.go:56] duration metric: took 13.394002ms WaitForService to wait for kubelet
I1122 02:51:05.622441 315098 kubeadm.go:587] duration metric: took 11.949540634s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.622465 315098 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:05.625578 315098 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:05.625607 315098 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:05.625627 315098 node_conditions.go:105] duration metric: took 3.155603ms to run NodePressure ...
I1122 02:51:05.625647 315098 start.go:242] waiting for startup goroutines ...
I1122 02:51:05.625660 315098 start.go:247] waiting for cluster config update ...
I1122 02:51:05.625677 315098 start.go:256] writing updated cluster config ...
I1122 02:51:05.625998 315098 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:05.629769 315098 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:05.634023 315098 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.639844 315098 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:51:05.639870 315098 pod_ready.go:86] duration metric: took 5.820698ms for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.642079 315098 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.646975 315098 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.646997 315098 pod_ready.go:86] duration metric: took 4.896289ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.650547 315098 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.656360 315098 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.656379 315098 pod_ready.go:86] duration metric: took 5.809428ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.658496 315098 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.034642 315098 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:06.034672 315098 pod_ready.go:86] duration metric: took 376.141388ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.235032 315098 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.634430 315098 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:51:06.634459 315098 pod_ready.go:86] duration metric: took 399.402834ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.834285 315098 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234497 315098 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:07.234529 315098 pod_ready.go:86] duration metric: took 400.219434ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234544 315098 pod_ready.go:40] duration metric: took 1.604742884s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:07.279768 315098 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:51:07.281342 315098 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
I1122 02:51:05.532532 321423 out.go:252] * Restarting existing docker container for "no-preload-346270" ...
I1122 02:51:05.532620 321423 cli_runner.go:164] Run: docker start no-preload-346270
I1122 02:51:05.816791 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.839930 321423 kic.go:430] container "no-preload-346270" state is running.
I1122 02:51:05.840366 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:05.860411 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.860662 321423 machine.go:94] provisionDockerMachine start ...
I1122 02:51:05.860741 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:05.880986 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:05.881268 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:05.881285 321423 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:05.882003 321423 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59850->127.0.0.1:33113: read: connection reset by peer
I1122 02:51:09.012278 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.012306 321423 ubuntu.go:182] provisioning hostname "no-preload-346270"
I1122 02:51:09.012365 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.029857 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.030223 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.030245 321423 main.go:143] libmachine: About to run SSH command:
sudo hostname no-preload-346270 && echo "no-preload-346270" | sudo tee /etc/hostname
I1122 02:51:09.169532 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.169634 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.187316 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.187555 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.187572 321423 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-346270' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-346270/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-346270' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:09.314808 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:09.314832 321423 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:09.314870 321423 ubuntu.go:190] setting up certificates
I1122 02:51:09.314884 321423 provision.go:84] configureAuth start
I1122 02:51:09.314968 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:09.333329 321423 provision.go:143] copyHostCerts
I1122 02:51:09.333396 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:09.333416 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:09.333497 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:09.333624 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:09.333638 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:09.333680 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:09.333781 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:09.333791 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:09.333828 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:09.333936 321423 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.no-preload-346270 san=[127.0.0.1 192.168.103.2 localhost minikube no-preload-346270]
I1122 02:51:09.380976 321423 provision.go:177] copyRemoteCerts
I1122 02:51:09.381023 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:09.381066 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.397774 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.491675 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:09.508429 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:51:09.525294 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:09.541666 321423 provision.go:87] duration metric: took 226.765786ms to configureAuth
I1122 02:51:09.541693 321423 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:09.541850 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:09.541987 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.559289 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.559516 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.559533 321423 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:09.861098 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:09.861128 321423 machine.go:97] duration metric: took 4.000446711s to provisionDockerMachine
I1122 02:51:09.861143 321423 start.go:293] postStartSetup for "no-preload-346270" (driver="docker")
I1122 02:51:09.861157 321423 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:09.861239 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:09.861284 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.880641 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.974101 321423 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:09.977444 321423 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:09.977475 321423 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:09.977488 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:09.977550 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:09.977649 321423 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:09.977772 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:09.985350 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:10.001752 321423 start.go:296] duration metric: took 140.596737ms for postStartSetup
I1122 02:51:10.001816 321423 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:10.001866 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.019452 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.109262 321423 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:10.113505 321423 fix.go:56] duration metric: took 4.606268175s for fixHost
I1122 02:51:10.113529 321423 start.go:83] releasing machines lock for "no-preload-346270", held for 4.606314821s
I1122 02:51:10.113590 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:10.130892 321423 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:10.130986 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.130993 321423 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:10.131044 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.148095 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.149275 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.237443 321423 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:10.288257 321423 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:10.322333 321423 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:10.326765 321423 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:10.326823 321423 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:10.334507 321423 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:10.334526 321423 start.go:496] detecting cgroup driver to use...
I1122 02:51:10.334559 321423 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:10.334612 321423 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:10.348194 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:10.359369 321423 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:10.359412 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:10.372620 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:10.384054 321423 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:10.463037 321423 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:10.545999 321423 docker.go:234] disabling docker service ...
I1122 02:51:10.546079 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:10.559066 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:10.570379 321423 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:10.648951 321423 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:10.726849 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:10.738572 321423 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:10.751757 321423 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:10.751813 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.760039 321423 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:10.760092 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.768370 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.776550 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.784678 321423 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:10.792267 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.800303 321423 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.808119 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.815945 321423 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:10.822682 321423 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:10.829812 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:10.909932 321423 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:11.047820 321423 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:11.047885 321423 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:11.051613 321423 start.go:564] Will wait 60s for crictl version
I1122 02:51:11.051669 321423 ssh_runner.go:195] Run: which crictl
I1122 02:51:11.055210 321423 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:11.081035 321423 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:11.081123 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.111141 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.140655 321423 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:11.141675 321423 cli_runner.go:164] Run: docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:11.161301 321423 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:51:11.165226 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.174797 321423 kubeadm.go:884] updating cluster {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:11.174956 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:11.175032 321423 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:11.204999 321423 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:11.205018 321423 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:11.205025 321423 kubeadm.go:935] updating node { 192.168.103.2 8443 v1.34.1 crio true true} ...
I1122 02:51:11.205128 321423 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-346270 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:11.205212 321423 ssh_runner.go:195] Run: crio config
I1122 02:51:11.248739 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:11.248761 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:11.248779 321423 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:11.248799 321423 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-346270 NodeName:no-preload-346270 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:11.250422 321423 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-346270"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.103.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:11.250742 321423 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:11.258573 321423 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:11.258616 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:11.265773 321423 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:11.277486 321423 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:11.289322 321423 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2216 bytes)
I1122 02:51:11.301167 321423 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:11.304669 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.314168 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:11.392747 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:11.414847 321423 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270 for IP: 192.168.103.2
I1122 02:51:11.414869 321423 certs.go:195] generating shared ca certs ...
I1122 02:51:11.414885 321423 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:11.415077 321423 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:11.415137 321423 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:11.415151 321423 certs.go:257] generating profile certs ...
I1122 02:51:11.415274 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/client.key
I1122 02:51:11.415348 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key.0aee8636
I1122 02:51:11.415420 321423 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key
I1122 02:51:11.415575 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:11.415618 321423 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:11.415632 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:11.415666 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:11.415698 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:11.415728 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:11.415782 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:11.416629 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:11.434099 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:11.452019 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:11.470785 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:11.493447 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:51:11.511840 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:11.528280 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:11.544534 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:11.560450 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:11.576652 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:11.592823 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:11.609677 321423 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:11.621229 321423 ssh_runner.go:195] Run: openssl version
I1122 02:51:11.627023 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:11.634796 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638198 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638247 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:11.673061 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:11.680196 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:11.688179 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691459 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691519 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.724729 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:11.732016 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:11.739896 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743358 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743390 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:11.779449 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:11.787202 321423 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:11.790931 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:11.825925 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:11.864004 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:11.897650 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:11.943987 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:11.991846 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:12.034579 321423 kubeadm.go:401] StartCluster: {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:12.034687 321423 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:12.034785 321423 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:12.070615 321423 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:12.070637 321423 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:12.070641 321423 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:12.070644 321423 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:12.070647 321423 cri.go:89] found id: ""
I1122 02:51:12.070686 321423 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:12.087235 321423 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:12Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:12.087306 321423 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:12.095436 321423 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:12.095461 321423 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:12.095502 321423 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:12.104006 321423 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:12.105338 321423 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-346270" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.106304 321423 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-346270" cluster setting kubeconfig missing "no-preload-346270" context setting]
I1122 02:51:12.107661 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.110159 321423 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:12.118041 321423 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.103.2
I1122 02:51:12.118077 321423 kubeadm.go:602] duration metric: took 22.610162ms to restartPrimaryControlPlane
I1122 02:51:12.118087 321423 kubeadm.go:403] duration metric: took 83.520469ms to StartCluster
I1122 02:51:12.118102 321423 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.118181 321423 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.120719 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.120932 321423 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:12.121053 321423 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:12.121149 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:12.121156 321423 addons.go:70] Setting storage-provisioner=true in profile "no-preload-346270"
I1122 02:51:12.121174 321423 addons.go:239] Setting addon storage-provisioner=true in "no-preload-346270"
W1122 02:51:12.121183 321423 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:12.121192 321423 addons.go:70] Setting default-storageclass=true in profile "no-preload-346270"
I1122 02:51:12.121206 321423 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "no-preload-346270"
I1122 02:51:12.121211 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121194 321423 addons.go:70] Setting dashboard=true in profile "no-preload-346270"
I1122 02:51:12.121234 321423 addons.go:239] Setting addon dashboard=true in "no-preload-346270"
W1122 02:51:12.121244 321423 addons.go:248] addon dashboard should already be in state true
I1122 02:51:12.121275 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121546 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121684 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121778 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.122684 321423 out.go:179] * Verifying Kubernetes components...
I1122 02:51:12.123731 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:12.147021 321423 addons.go:239] Setting addon default-storageclass=true in "no-preload-346270"
W1122 02:51:12.147091 321423 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:12.147131 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.147594 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.148252 321423 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:12.148252 321423 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:12.150224 321423 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.150242 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:12.150283 321423 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:12.150303 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.154020 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:12.154040 321423 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:12.154093 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.185355 321423 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.185384 321423 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:12.185448 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.186269 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.189464 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.214937 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.262215 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:12.274680 321423 node_ready.go:35] waiting up to 6m0s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:12.292510 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.300072 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:12.300091 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:12.315478 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:12.315499 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:12.321137 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.329365 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:12.329386 321423 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:12.343422 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:12.343436 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:12.356469 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:12.356528 321423 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:12.370188 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:12.370206 321423 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:12.383364 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:12.383385 321423 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:12.395140 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:12.395162 321423 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:12.407073 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:12.407091 321423 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:12.419200 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:13.706639 321423 node_ready.go:49] node "no-preload-346270" is "Ready"
I1122 02:51:13.706675 321423 node_ready.go:38] duration metric: took 1.431966817s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:13.706693 321423 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:13.706749 321423 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:14.227510 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.934969246s)
I1122 02:51:14.227590 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.906419176s)
I1122 02:51:14.227696 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.808462104s)
I1122 02:51:14.227749 321423 api_server.go:72] duration metric: took 2.106789491s to wait for apiserver process to appear ...
I1122 02:51:14.227772 321423 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:14.227797 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.232614 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.232635 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:14.233003 321423 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-346270 addons enable metrics-server
I1122 02:51:14.234413 321423 out.go:179] * Enabled addons: storage-provisioner, default-storageclass, dashboard
I1122 02:51:14.235431 321423 addons.go:530] duration metric: took 2.114388744s for enable addons: enabled=[storage-provisioner default-storageclass dashboard]
I1122 02:51:14.728204 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.732646 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.732670 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:15.228038 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:15.233046 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:51:15.234234 321423 api_server.go:141] control plane version: v1.34.1
I1122 02:51:15.234257 321423 api_server.go:131] duration metric: took 1.006474684s to wait for apiserver health ...
I1122 02:51:15.234265 321423 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:15.238124 321423 system_pods.go:59] 8 kube-system pods found
I1122 02:51:15.238151 321423 system_pods.go:61] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.238164 321423 system_pods.go:61] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.238187 321423 system_pods.go:61] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.238195 321423 system_pods.go:61] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.238203 321423 system_pods.go:61] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.238208 321423 system_pods.go:61] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.238215 321423 system_pods.go:61] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.238221 321423 system_pods.go:61] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.238229 321423 system_pods.go:74] duration metric: took 3.958929ms to wait for pod list to return data ...
I1122 02:51:15.238238 321423 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:15.240951 321423 default_sa.go:45] found service account: "default"
I1122 02:51:15.240971 321423 default_sa.go:55] duration metric: took 2.726862ms for default service account to be created ...
I1122 02:51:15.240981 321423 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:15.243750 321423 system_pods.go:86] 8 kube-system pods found
I1122 02:51:15.243773 321423 system_pods.go:89] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.243780 321423 system_pods.go:89] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.243789 321423 system_pods.go:89] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.243799 321423 system_pods.go:89] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.243807 321423 system_pods.go:89] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.243815 321423 system_pods.go:89] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.243824 321423 system_pods.go:89] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.243843 321423 system_pods.go:89] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.243853 321423 system_pods.go:126] duration metric: took 2.861267ms to wait for k8s-apps to be running ...
I1122 02:51:15.243866 321423 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:15.243945 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:15.258191 321423 system_svc.go:56] duration metric: took 14.317675ms WaitForService to wait for kubelet
I1122 02:51:15.258215 321423 kubeadm.go:587] duration metric: took 3.137259179s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:15.258229 321423 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:15.260690 321423 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:15.260711 321423 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:15.260725 321423 node_conditions.go:105] duration metric: took 2.491685ms to run NodePressure ...
I1122 02:51:15.260746 321423 start.go:242] waiting for startup goroutines ...
I1122 02:51:15.260760 321423 start.go:247] waiting for cluster config update ...
I1122 02:51:15.260778 321423 start.go:256] writing updated cluster config ...
I1122 02:51:15.261089 321423 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:15.264635 321423 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:15.268532 321423 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
==> CRI-O <==
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.92127268Z" level=info msg="Created container ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4: kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8/kubernetes-dashboard" id=42dff456-b9cb-408c-b031-11ff48162724 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.922248453Z" level=info msg="Starting container: ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4" id=5516f910-1ce4-43f6-87b4-ebe6179650d9 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:43 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:43.92477391Z" level=info msg="Started container" PID=1735 containerID=ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4 description=kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8/kubernetes-dashboard id=5516f910-1ce4-43f6-87b4-ebe6179650d9 name=/runtime.v1.RuntimeService/StartContainer sandboxID=f94a2585bc50cb3ebb8626001871a4d532ffcd646151fc0ea370e53dea14fa76
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.175061364Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=90772dfb-a4c5-48ca-88ce-0a768b74a33a name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.175995933Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=fe2a5830-e4f6-4eaa-bf4d-15a7584e1099 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.177058511Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=1c96d043-8e4f-4791-bdf6-b3e30f8d6803 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.177179986Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.18161767Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.181803838Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/0d3a90672308e31c0319338ceb9e43f5d681c103417fc9b6e2b9af427b438d42/merged/etc/passwd: no such file or directory"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.181839183Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/0d3a90672308e31c0319338ceb9e43f5d681c103417fc9b6e2b9af427b438d42/merged/etc/group: no such file or directory"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.182145909Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.207281273Z" level=info msg="Created container a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57: kube-system/storage-provisioner/storage-provisioner" id=1c96d043-8e4f-4791-bdf6-b3e30f8d6803 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.207757299Z" level=info msg="Starting container: a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57" id=5d48b732-91b2-46d3-be85-3d20a9c8e9f0 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:50:55 old-k8s-version-169878 crio[561]: time="2025-11-22T02:50:55.209507459Z" level=info msg="Started container" PID=1759 containerID=a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57 description=kube-system/storage-provisioner/storage-provisioner id=5d48b732-91b2-46d3-be85-3d20a9c8e9f0 name=/runtime.v1.RuntimeService/StartContainer sandboxID=b4a1da1a3b203a6e2fa5b9257e2b0338d202a8da2bf68be85f3a6a794875d51e
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.063525841Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=6632c1c7-5c42-4b38-82a6-3c70b9235a17 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.064327018Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=188bd952-2e1c-49de-b8c5-50d9d4d5c819 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.065204411Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=12df8b67-e992-4b39-8b48-156de2469e8f name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.065342593Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.070534774Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.071085582Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.095544338Z" level=info msg="Created container b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=12df8b67-e992-4b39-8b48-156de2469e8f name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.095992239Z" level=info msg="Starting container: b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314" id=f3855b67-e79b-4562-8564-9b106ea24195 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.097586964Z" level=info msg="Started container" PID=1795 containerID=b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314 description=kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper id=f3855b67-e79b-4562-8564-9b106ea24195 name=/runtime.v1.RuntimeService/StartContainer sandboxID=28dcacd17b306cd76ff62607992c15cd475c5c02906d7a0e55bbbff2e62daa2a
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.194203743Z" level=info msg="Removing container: fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e" id=14474f9b-3550-4497-b3b5-b605196a756c name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:02 old-k8s-version-169878 crio[561]: time="2025-11-22T02:51:02.202586912Z" level=info msg="Removed container fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e: kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w/dashboard-metrics-scraper" id=14474f9b-3550-4497-b3b5-b605196a756c name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
b69855642e801 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 16 seconds ago Exited dashboard-metrics-scraper 2 28dcacd17b306 dashboard-metrics-scraper-5f989dc9cf-5t77w kubernetes-dashboard
a47b31eceb737 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 23 seconds ago Running storage-provisioner 1 b4a1da1a3b203 storage-provisioner kube-system
ebd36dba3f464 docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 34 seconds ago Running kubernetes-dashboard 0 f94a2585bc50c kubernetes-dashboard-8694d4445c-mr7x8 kubernetes-dashboard
e55d006f4fb79 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 54 seconds ago Running busybox 1 7c306a7c40910 busybox default
7fc7ba9d097d7 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 54 seconds ago Running coredns 0 145bed249f8f5 coredns-5dd5756b68-fkcs9 kube-system
26f76332ea264 ea1030da44aa18666a7bf15fddd2a38c3143c3277159cb8bdd95f45c8ce62d7a 54 seconds ago Running kube-proxy 0 f3c7477d0b56e kube-proxy-c7nnb kube-system
571a714d8715e 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 54 seconds ago Exited storage-provisioner 0 b4a1da1a3b203 storage-provisioner kube-system
76030ce734602 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 54 seconds ago Running kindnet-cni 0 025af843c9001 kindnet-ptwwj kube-system
b96fc7cf548ba f6f496300a2ae7a6727ccf3080d66d2fd22b6cfc271df5351c976c23a28bb157 56 seconds ago Running kube-scheduler 0 56ab9bee4993e kube-scheduler-old-k8s-version-169878 kube-system
82d373551c054 bb5e0dde9054c02d6badee88547be7e7bb7b7b818d277c8a61b4b29484bbff95 56 seconds ago Running kube-apiserver 0 68897e91b8407 kube-apiserver-old-k8s-version-169878 kube-system
b020497f5a6f6 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 57 seconds ago Running etcd 0 f13c7601987a1 etcd-old-k8s-version-169878 kube-system
ab5eb437c1875 4be79c38a4bab6e1252a35697500e8a0d9c5c7c771d9fcc1935c9a7f6cdf4c62 57 seconds ago Running kube-controller-manager 0 5b1de03a32d1b kube-controller-manager-old-k8s-version-169878 kube-system
==> coredns [7fc7ba9d097d7e0f7219c7eec375331b06098962fea1a74c0b810d750713e43b] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 8aa94104b4dae56b00431f7362ac05b997af2246775de35dc2eb361b0707b2fa7199f9ddfdba27fdef1331b76d09c41700f6cb5d00836dabab7c0df8e651283f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] 127.0.0.1:60142 - 49769 "HINFO IN 2788691698134012747.4331806363309765400. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.500424102s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-169878
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-169878
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=old-k8s-version-169878
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_49_17_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:49:13 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-169878
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:04 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:12 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:50:54 +0000 Sat, 22 Nov 2025 02:49:42 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-169878
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 57df10e8-2d05-435a-9964-d44e1c0a4356
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.28.0
Kube-Proxy Version: v1.28.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 92s
kube-system coredns-5dd5756b68-fkcs9 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 109s
kube-system etcd-old-k8s-version-169878 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 2m2s
kube-system kindnet-ptwwj 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 110s
kube-system kube-apiserver-old-k8s-version-169878 250m (3%) 0 (0%) 0 (0%) 0 (0%) 2m2s
kube-system kube-controller-manager-old-k8s-version-169878 200m (2%) 0 (0%) 0 (0%) 0 (0%) 2m2s
kube-system kube-proxy-c7nnb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 110s
kube-system kube-scheduler-old-k8s-version-169878 100m (1%) 0 (0%) 0 (0%) 0 (0%) 2m2s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 109s
kubernetes-dashboard dashboard-metrics-scraper-5f989dc9cf-5t77w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 41s
kubernetes-dashboard kubernetes-dashboard-8694d4445c-mr7x8 0 (0%) 0 (0%) 0 (0%) 0 (0%) 41s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 108s kube-proxy
Normal Starting 54s kube-proxy
Normal Starting 2m7s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 2m7s (x8 over 2m7s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 2m7s (x8 over 2m7s) kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m7s (x8 over 2m7s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 2m2s kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 2m2s kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 2m2s kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal Starting 2m2s kubelet Starting kubelet.
Normal RegisteredNode 110s node-controller Node old-k8s-version-169878 event: Registered Node old-k8s-version-169878 in Controller
Normal NodeReady 96s kubelet Node old-k8s-version-169878 status is now: NodeReady
Normal Starting 57s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 57s (x8 over 57s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 57s (x8 over 57s) kubelet Node old-k8s-version-169878 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 57s (x8 over 57s) kubelet Node old-k8s-version-169878 status is now: NodeHasSufficientPID
Normal RegisteredNode 42s node-controller Node old-k8s-version-169878 event: Registered Node old-k8s-version-169878 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [b020497f5a6f6817ad4c73f31db7d1305f1e123050555c31b605af6d683ea01f] <==
{"level":"info","ts":"2025-11-22T02:50:22.701416Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701513Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701558Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 2"}
{"level":"info","ts":"2025-11-22T02:50:22.701591Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.70161Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.70163Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.701649Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 3"}
{"level":"info","ts":"2025-11-22T02:50:22.702737Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:old-k8s-version-169878 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
{"level":"info","ts":"2025-11-22T02:50:22.702803Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:50:22.703086Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2025-11-22T02:50:22.703183Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2025-11-22T02:50:22.70282Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2025-11-22T02:50:22.704421Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2025-11-22T02:50:22.704841Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.85.2:2379"}
{"level":"info","ts":"2025-11-22T02:50:30.587704Z","caller":"traceutil/trace.go:171","msg":"trace[1426692367] transaction","detail":"{read_only:false; response_revision:502; number_of_response:1; }","duration":"129.431443ms","start":"2025-11-22T02:50:30.458243Z","end":"2025-11-22T02:50:30.587675Z","steps":["trace[1426692367] 'process raft request' (duration: 128.856456ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:30.846467Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"128.128008ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413836 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b38ff\" mod_revision:0 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b38ff\" value_size:658 lease:499225186365638023 >> failure:<>>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:30.846561Z","caller":"traceutil/trace.go:171","msg":"trace[638011859] transaction","detail":"{read_only:false; response_revision:503; number_of_response:1; }","duration":"255.691505ms","start":"2025-11-22T02:50:30.590852Z","end":"2025-11-22T02:50:30.846543Z","steps":["trace[638011859] 'process raft request' (duration: 127.181383ms)","trace[638011859] 'compare' (duration: 128.034975ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:31.063985Z","caller":"traceutil/trace.go:171","msg":"trace[563655906] transaction","detail":"{read_only:false; response_revision:506; number_of_response:1; }","duration":"120.330343ms","start":"2025-11-22T02:50:30.94362Z","end":"2025-11-22T02:50:31.06395Z","steps":["trace[563655906] 'process raft request' (duration: 119.604267ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:31.314541Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.708592ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413843 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" mod_revision:504 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" value_size:654 lease:499225186365638023 >> failure:<request_range:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:31.314615Z","caller":"traceutil/trace.go:171","msg":"trace[934271222] linearizableReadLoop","detail":"{readStateIndex:532; appliedIndex:531; }","duration":"244.708017ms","start":"2025-11-22T02:50:31.069893Z","end":"2025-11-22T02:50:31.314601Z","steps":["trace[934271222] 'read index received' (duration: 116.787919ms)","trace[934271222] 'applied index is now lower than readState.Index' (duration: 127.919109ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:50:31.314676Z","caller":"traceutil/trace.go:171","msg":"trace[876851820] transaction","detail":"{read_only:false; response_revision:507; number_of_response:1; }","duration":"246.260982ms","start":"2025-11-22T02:50:31.068393Z","end":"2025-11-22T02:50:31.314655Z","steps":["trace[876851820] 'process raft request' (duration: 118.29001ms)","trace[876851820] 'compare' (duration: 127.62336ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:50:31.314725Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"244.816164ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/old-k8s-version-169878\" ","response":"range_response_count:1 size:6061"}
{"level":"info","ts":"2025-11-22T02:50:31.31475Z","caller":"traceutil/trace.go:171","msg":"trace[545138702] range","detail":"{range_begin:/registry/minions/old-k8s-version-169878; range_end:; response_count:1; response_revision:507; }","duration":"244.878418ms","start":"2025-11-22T02:50:31.069863Z","end":"2025-11-22T02:50:31.314741Z","steps":["trace[545138702] 'agreement among raft nodes before linearized reading' (duration: 244.773531ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:50:31.596454Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"128.295807ms","expected-duration":"100ms","prefix":"","request":"header:<ID:9722597223220413850 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" mod_revision:507 > success:<request_put:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" value_size:654 lease:499225186365638023 >> failure:<request_range:<key:\"/registry/events/default/old-k8s-version-169878.187a3466ff8b545e\" > >>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:50:31.596579Z","caller":"traceutil/trace.go:171","msg":"trace[871619091] transaction","detail":"{read_only:false; response_revision:510; number_of_response:1; }","duration":"255.014147ms","start":"2025-11-22T02:50:31.341525Z","end":"2025-11-22T02:50:31.596539Z","steps":["trace[871619091] 'process raft request' (duration: 126.5654ms)","trace[871619091] 'compare' (duration: 128.206861ms)"],"step_count":2}
==> kernel <==
02:51:18 up 1:33, 0 user, load average: 5.02, 3.85, 2.25
Linux old-k8s-version-169878 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [76030ce73460226948fc4a8187f6f25c4d481e34929dee38a7cf6a725fd3e91d] <==
I1122 02:50:24.704003 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:50:24.704271 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:50:24.704456 1 main.go:148] setting mtu 1500 for CNI
I1122 02:50:24.704479 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:50:24.704501 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:50:24Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:50:24.908479 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:50:24.908514 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:50:24.908526 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:50:24.908668 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:50:25.302287 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:50:25.302319 1 metrics.go:72] Registering metrics
I1122 02:50:25.302396 1 controller.go:711] "Syncing nftables rules"
I1122 02:50:34.908045 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:34.908100 1 main.go:301] handling current node
I1122 02:50:44.908079 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:44.908127 1 main.go:301] handling current node
I1122 02:50:54.908216 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:50:54.908261 1 main.go:301] handling current node
I1122 02:51:04.909063 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:51:04.909104 1 main.go:301] handling current node
I1122 02:51:14.914020 1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]
I1122 02:51:14.914063 1 main.go:301] handling current node
==> kube-apiserver [82d373551c054bc918c65f2e4bf1f86b0b30b851cd1ee09356d42b81484d0468] <==
I1122 02:50:23.915996 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:50:23.926800 1 apf_controller.go:377] Running API Priority and Fairness config worker
I1122 02:50:23.926821 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I1122 02:50:23.928953 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I1122 02:50:23.930894 1 shared_informer.go:318] Caches are synced for configmaps
I1122 02:50:23.931700 1 cache.go:39] Caches are synced for AvailableConditionController controller
I1122 02:50:23.932745 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:50:23.940072 1 shared_informer.go:318] Caches are synced for crd-autoregister
I1122 02:50:23.940104 1 aggregator.go:166] initial CRD sync complete...
I1122 02:50:23.940111 1 autoregister_controller.go:141] Starting autoregister controller
I1122 02:50:23.940117 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:50:23.940125 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:50:23.986178 1 shared_informer.go:318] Caches are synced for node_authorizer
I1122 02:50:24.832346 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:50:24.906801 1 controller.go:624] quota admission added evaluator for: namespaces
I1122 02:50:24.938894 1 controller.go:624] quota admission added evaluator for: deployments.apps
I1122 02:50:24.956640 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:50:24.964397 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:50:24.972458 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I1122 02:50:25.006564 1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.104.50.86"}
I1122 02:50:25.019154 1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.99.151.27"}
I1122 02:50:36.885166 1 controller.go:624] quota admission added evaluator for: replicasets.apps
I1122 02:50:37.084880 1 controller.go:624] quota admission added evaluator for: endpoints
I1122 02:50:37.084880 1 controller.go:624] quota admission added evaluator for: endpoints
I1122 02:50:37.333113 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-controller-manager [ab5eb437c1875a43ac66aabed056e47fdbaeb8bf2b019d51272be1c88d62301f] <==
I1122 02:50:36.976895 1 shared_informer.go:318] Caches are synced for persistent volume
I1122 02:50:37.289878 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="484.745562ms"
I1122 02:50:37.290076 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="117.31µs"
I1122 02:50:37.294192 1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-8694d4445c-mr7x8"
I1122 02:50:37.294352 1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-5f989dc9cf-5t77w"
I1122 02:50:37.302421 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="413.812596ms"
I1122 02:50:37.303843 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="415.077695ms"
I1122 02:50:37.310235 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="6.98103ms"
I1122 02:50:37.310332 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="40.505µs"
I1122 02:50:37.311180 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="7.290194ms"
I1122 02:50:37.311318 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="43.703µs"
I1122 02:50:37.317546 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="46.61µs"
I1122 02:50:37.326542 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="54.801µs"
I1122 02:50:37.359632 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:50:37.378022 1 shared_informer.go:318] Caches are synced for garbage collector
I1122 02:50:37.378052 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
I1122 02:50:40.142205 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="104.438µs"
I1122 02:50:41.152809 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="59.616µs"
I1122 02:50:42.155457 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="100.155µs"
I1122 02:50:44.173875 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="7.161598ms"
I1122 02:50:44.174008 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="67.743µs"
I1122 02:50:59.919127 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="8.396922ms"
I1122 02:50:59.919227 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="57.307µs"
I1122 02:51:02.202969 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="103.326µs"
I1122 02:51:07.616181 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf" duration="91.757µs"
==> kube-proxy [26f76332ea2642066946406aef8c6e4b20f245f75ff31f230f3c5c108bdf54c7] <==
I1122 02:50:24.529528 1 server_others.go:69] "Using iptables proxy"
I1122 02:50:24.542031 1 node.go:141] Successfully retrieved node IP: 192.168.85.2
I1122 02:50:24.562866 1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:50:24.565396 1 server_others.go:152] "Using iptables Proxier"
I1122 02:50:24.565420 1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
I1122 02:50:24.565427 1 server_others.go:438] "Defaulting to no-op detect-local"
I1122 02:50:24.565443 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I1122 02:50:24.565666 1 server.go:846] "Version info" version="v1.28.0"
I1122 02:50:24.565679 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:24.566240 1 config.go:97] "Starting endpoint slice config controller"
I1122 02:50:24.566311 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I1122 02:50:24.566232 1 config.go:188] "Starting service config controller"
I1122 02:50:24.567898 1 shared_informer.go:311] Waiting for caches to sync for service config
I1122 02:50:24.567210 1 config.go:315] "Starting node config controller"
I1122 02:50:24.567947 1 shared_informer.go:311] Waiting for caches to sync for node config
I1122 02:50:24.666408 1 shared_informer.go:318] Caches are synced for endpoint slice config
I1122 02:50:24.668530 1 shared_informer.go:318] Caches are synced for node config
I1122 02:50:24.668545 1 shared_informer.go:318] Caches are synced for service config
==> kube-scheduler [b96fc7cf548ba9b90504c10a2556c900c9e1102157df1e5093e0750c2a960570] <==
I1122 02:50:22.258082 1 serving.go:348] Generated self-signed cert in-memory
W1122 02:50:23.889960 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:50:23.890001 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:50:23.890022 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:50:23.890035 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:50:23.924594 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.0"
I1122 02:50:23.924829 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:23.926573 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:50:23.926627 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1122 02:50:23.927777 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I1122 02:50:23.927889 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I1122 02:50:24.027621 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382157 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/da45cfda-d75d-4960-94d8-f5328f8ded9c-tmp-volume\") pod \"kubernetes-dashboard-8694d4445c-mr7x8\" (UID: \"da45cfda-d75d-4960-94d8-f5328f8ded9c\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382231 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnxr\" (UniqueName: \"kubernetes.io/projected/da45cfda-d75d-4960-94d8-f5328f8ded9c-kube-api-access-wjnxr\") pod \"kubernetes-dashboard-8694d4445c-mr7x8\" (UID: \"da45cfda-d75d-4960-94d8-f5328f8ded9c\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382389 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3ba8175-8509-42f0-8a5a-33377efc651a-tmp-volume\") pod \"dashboard-metrics-scraper-5f989dc9cf-5t77w\" (UID: \"e3ba8175-8509-42f0-8a5a-33377efc651a\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w"
Nov 22 02:50:37 old-k8s-version-169878 kubelet[717]: I1122 02:50:37.382434 717 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wb9\" (UniqueName: \"kubernetes.io/projected/e3ba8175-8509-42f0-8a5a-33377efc651a-kube-api-access-n5wb9\") pod \"dashboard-metrics-scraper-5f989dc9cf-5t77w\" (UID: \"e3ba8175-8509-42f0-8a5a-33377efc651a\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w"
Nov 22 02:50:40 old-k8s-version-169878 kubelet[717]: I1122 02:50:40.131548 717 scope.go:117] "RemoveContainer" containerID="0fdb9a5528ab4b40237a10572ca29882cc3330ce775a66453419eec41b06cfb0"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: I1122 02:50:41.139353 717 scope.go:117] "RemoveContainer" containerID="0fdb9a5528ab4b40237a10572ca29882cc3330ce775a66453419eec41b06cfb0"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: I1122 02:50:41.139462 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:41 old-k8s-version-169878 kubelet[717]: E1122 02:50:41.139856 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:42 old-k8s-version-169878 kubelet[717]: I1122 02:50:42.143544 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:42 old-k8s-version-169878 kubelet[717]: E1122 02:50:42.143952 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:44 old-k8s-version-169878 kubelet[717]: I1122 02:50:44.166716 717 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-mr7x8" podStartSLOduration=0.933354582 podCreationTimestamp="2025-11-22 02:50:37 +0000 UTC" firstStartedPulling="2025-11-22 02:50:37.633604714 +0000 UTC m=+16.718194179" lastFinishedPulling="2025-11-22 02:50:43.866888224 +0000 UTC m=+22.951477691" observedRunningTime="2025-11-22 02:50:44.166082224 +0000 UTC m=+23.250671701" watchObservedRunningTime="2025-11-22 02:50:44.166638094 +0000 UTC m=+23.251227568"
Nov 22 02:50:47 old-k8s-version-169878 kubelet[717]: I1122 02:50:47.606744 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:50:47 old-k8s-version-169878 kubelet[717]: E1122 02:50:47.607095 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:50:55 old-k8s-version-169878 kubelet[717]: I1122 02:50:55.174548 717 scope.go:117] "RemoveContainer" containerID="571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.062997 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.193115 717 scope.go:117] "RemoveContainer" containerID="fa3487b82e482f9c949c6482ad19f3cf6d8495fd31fd4851984b5c8b469e4a6e"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: I1122 02:51:02.193329 717 scope.go:117] "RemoveContainer" containerID="b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
Nov 22 02:51:02 old-k8s-version-169878 kubelet[717]: E1122 02:51:02.193635 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:51:07 old-k8s-version-169878 kubelet[717]: I1122 02:51:07.607249 717 scope.go:117] "RemoveContainer" containerID="b69855642e80162916bb49323ad2e4c7b766f231fdd3a3dca55720a7dfac8314"
Nov 22 02:51:07 old-k8s-version-169878 kubelet[717]: E1122 02:51:07.607619 717 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-5f989dc9cf-5t77w_kubernetes-dashboard(e3ba8175-8509-42f0-8a5a-33377efc651a)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-5f989dc9cf-5t77w" podUID="e3ba8175-8509-42f0-8a5a-33377efc651a"
Nov 22 02:51:13 old-k8s-version-169878 kubelet[717]: I1122 02:51:13.723921 717 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:51:13 old-k8s-version-169878 systemd[1]: kubelet.service: Consumed 1.451s CPU time.
==> kubernetes-dashboard [ebd36dba3f4649318fb99b5d8a16b672637192208718f1b57bf19b8069b40ec4] <==
2025/11/22 02:50:43 Using namespace: kubernetes-dashboard
2025/11/22 02:50:43 Using in-cluster config to connect to apiserver
2025/11/22 02:50:43 Using secret token for csrf signing
2025/11/22 02:50:43 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:50:43 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:50:43 Successful initial request to the apiserver, version: v1.28.0
2025/11/22 02:50:43 Generating JWE encryption key
2025/11/22 02:50:43 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:50:43 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:50:44 Initializing JWE encryption key from synchronized object
2025/11/22 02:50:44 Creating in-cluster Sidecar client
2025/11/22 02:50:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:50:44 Serving insecurely on HTTP port: 9090
2025/11/22 02:51:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:50:43 Starting overwatch
==> storage-provisioner [571a714d8715e7d5ea028c0266fd5cf415cffcb793489fb7ce62ec6a7f184d70] <==
I1122 02:50:24.485039 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:50:54.488090 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [a47b31eceb7370936e3f6154989a1d3fc383a3abfb1b246c6d0b6b8af1adfc57] <==
I1122 02:50:55.221095 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:50:55.228124 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:50:55.228196 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1122 02:51:12.622117 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:51:12.622172 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8a847876-9310-429d-b2a3-b558de50b707", APIVersion:"v1", ResourceVersion:"655", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144 became leader
I1122 02:51:12.622254 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144!
I1122 02:51:12.722441 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-169878_d423b1d4-25b3-4708-a887-c579707fa144!
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-169878 -n old-k8s-version-169878
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-169878 -n old-k8s-version-169878: exit status 2 (316.344381ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context old-k8s-version-169878 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (6.17s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 11 (270.90319ms)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:14Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:205: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 11
start_stop_delete_test.go:213: (dbg) Run: kubectl --context default-k8s-diff-port-714134 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:213: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-714134 describe deploy/metrics-server -n kube-system: exit status 1 (80.677243ms)
** stderr **
Error from server (NotFound): deployments.apps "metrics-server" not found
** /stderr **
start_stop_delete_test.go:215: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-714134 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:219: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect default-k8s-diff-port-714134
helpers_test.go:243: (dbg) docker inspect default-k8s-diff-port-714134:
-- stdout --
[
{
"Id": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"Created": "2025-11-22T02:50:31.741901438Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 315822,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:50:31.794609096Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hostname",
"HostsPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hosts",
"LogPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8-json.log",
"Name": "/default-k8s-diff-port-714134",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"default-k8s-diff-port-714134:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "default-k8s-diff-port-714134",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"LowerDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/merged",
"UpperDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/diff",
"WorkDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "default-k8s-diff-port-714134",
"Source": "/var/lib/docker/volumes/default-k8s-diff-port-714134/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "default-k8s-diff-port-714134",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8444/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"name.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "066d52821167f27522c18506d1b2a2b8f65b47c767aa2cc087809de2d82dedba",
"SandboxKey": "/var/run/docker/netns/066d52821167",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33108"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33109"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33112"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33110"
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33111"
}
]
},
"Networks": {
"default-k8s-diff-port-714134": {
"IPAMConfig": {
"IPv4Address": "192.168.94.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "1451805a580c7a9f0fd8e60ea19dcbce5f50443c1da7f0f14ca30139c5b28efb",
"EndpointID": "8eb3b893f1e8d34834644bcddc318354bfa6e74184d93643373f0df2eb38669d",
"Gateway": "192.168.94.1",
"IPAddress": "192.168.94.2",
"MacAddress": "12:f6:2b:a6:e9:2c",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"default-k8s-diff-port-714134",
"0ce4a57beec5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:252: <<< TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 logs -n 25: (1.056136206s)
helpers_test.go:260: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ -p bridge-430524 sudo systemctl cat cri-docker --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo cat /usr/lib/systemd/system/cri-docker.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cri-dockerd --version │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status containerd --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ ssh │ -p bridge-430524 sudo systemctl cat containerd --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /lib/systemd/system/containerd.service │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo cat /etc/containerd/config.toml │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo containerd config dump │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl status crio --all --full --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:05
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:05.292401 321423 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:05.292667 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292678 321423 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:05.292681 321423 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:05.292854 321423 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:05.293268 321423 out.go:368] Setting JSON to false
I1122 02:51:05.294543 321423 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5608,"bootTime":1763774257,"procs":316,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:05.294619 321423 start.go:143] virtualization: kvm guest
I1122 02:51:05.298223 321423 out.go:179] * [no-preload-346270] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:05.299715 321423 notify.go:221] Checking for updates...
I1122 02:51:05.300188 321423 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:05.301353 321423 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:05.302343 321423 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:05.303355 321423 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:05.304816 321423 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:05.306003 321423 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:05.307779 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:05.308378 321423 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:05.342814 321423 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:05.342926 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.408579 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.397212874 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.408691 321423 docker.go:319] overlay module found
I1122 02:51:05.410366 321423 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:05.411604 321423 start.go:309] selected driver: docker
I1122 02:51:05.411620 321423 start.go:927] validating driver "docker" against &{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.411720 321423 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:05.412352 321423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:05.479062 321423 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:51:05.468487111 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:05.479387 321423 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.479425 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:05.479488 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:05.479545 321423 start.go:353] cluster config:
{Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:05.481151 321423 out.go:179] * Starting "no-preload-346270" primary control-plane node in "no-preload-346270" cluster
I1122 02:51:05.482190 321423 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:05.483749 321423 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:05.484664 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:05.484750 321423 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:05.484777 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.484964 321423 cache.go:107] acquiring lock: {Name:mk9fd95b82b8a0ed47b4c79f858a382e519ed06e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.484985 321423 cache.go:107] acquiring lock: {Name:mk4d199bf40a6d6ba931e5e3bad6703ee1d4331a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485046 321423 cache.go:107] acquiring lock: {Name:mk3054179b69a4ecffba6a1633407784706f4e81 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485081 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1122 02:51:05.485084 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 exists
I1122 02:51:05.485096 321423 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 147.057µs
I1122 02:51:05.485110 321423 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1" took 150.821µs
I1122 02:51:05.485119 321423 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1122 02:51:05.485124 321423 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.34.1 succeeded
I1122 02:51:05.485108 321423 cache.go:107] acquiring lock: {Name:mk650b39e13f205b236b21e6fa6a8094ff95570c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485097 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 exists
I1122 02:51:05.485112 321423 cache.go:107] acquiring lock: {Name:mkc2dd19224be48dd2b652c2ba743eee0462ec74 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485153 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 exists
I1122 02:51:05.485161 321423 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1" took 55.025µs
I1122 02:51:05.485170 321423 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.34.1 succeeded
I1122 02:51:05.485140 321423 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1" took 101.513µs
I1122 02:51:05.485159 321423 cache.go:107] acquiring lock: {Name:mk9d6260ac85fdcae594a014de4c63c0ef47e012 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485135 321423 cache.go:107] acquiring lock: {Name:mk4e022e496bff3a4a0a326b942b57b39fa644a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485197 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 exists
I1122 02:51:05.485220 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 exists
I1122 02:51:05.485218 321423 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.34.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1" took 127.649µs
I1122 02:51:05.485230 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 exists
I1122 02:51:05.485235 321423 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.34.1 succeeded
I1122 02:51:05.485185 321423 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.34.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.34.1 succeeded
I1122 02:51:05.485239 321423 cache.go:96] cache image "registry.k8s.io/pause:3.10.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1" took 106.694µs
I1122 02:51:05.485233 321423 cache.go:96] cache image "registry.k8s.io/etcd:3.6.4-0" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0" took 79.549µs
I1122 02:51:05.485247 321423 cache.go:80] save to tar file registry.k8s.io/pause:3.10.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/pause_3.10.1 succeeded
I1122 02:51:05.485251 321423 cache.go:80] save to tar file registry.k8s.io/etcd:3.6.4-0 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.6.4-0 succeeded
I1122 02:51:05.485161 321423 cache.go:107] acquiring lock: {Name:mk4196ba38e7d41483a23902afbddf94052a6ebe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.485331 321423 cache.go:115] /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 exists
I1122 02:51:05.485341 321423 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.12.1" -> "/home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1" took 183.677µs
I1122 02:51:05.485354 321423 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.12.1 -> /home/jenkins/minikube-integration/21946-11041/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.12.1 succeeded
I1122 02:51:05.485369 321423 cache.go:87] Successfully saved all images to host disk.
I1122 02:51:05.507064 321423 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:05.507087 321423 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:05.507109 321423 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:05.507137 321423 start.go:360] acquireMachinesLock for no-preload-346270: {Name:mkdc74b684c3fde528391b5ed567e203df475597 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:05.507200 321423 start.go:364] duration metric: took 43.77µs to acquireMachinesLock for "no-preload-346270"
I1122 02:51:05.507222 321423 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:05.507233 321423 fix.go:54] fixHost starting:
I1122 02:51:05.507494 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.529630 321423 fix.go:112] recreateIfNeeded on no-preload-346270: state=Stopped err=<nil>
W1122 02:51:05.529657 321423 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:02.471600 315098 node_ready.go:57] node "default-k8s-diff-port-714134" has "Ready":"False" status (will retry)
I1122 02:51:04.971022 315098 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:04.971052 315098 node_ready.go:38] duration metric: took 11.00298075s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:04.971069 315098 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:04.971121 315098 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:04.984450 315098 api_server.go:72] duration metric: took 11.311544446s to wait for apiserver process to appear ...
I1122 02:51:04.984479 315098 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:04.984501 315098 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:04.989715 315098 api_server.go:279] https://192.168.94.2:8444/healthz returned 200:
ok
I1122 02:51:04.990867 315098 api_server.go:141] control plane version: v1.34.1
I1122 02:51:04.990896 315098 api_server.go:131] duration metric: took 6.408983ms to wait for apiserver health ...
I1122 02:51:04.990935 315098 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:04.996740 315098 system_pods.go:59] 8 kube-system pods found
I1122 02:51:04.996785 315098 system_pods.go:61] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:04.996793 315098 system_pods.go:61] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:04.996806 315098 system_pods.go:61] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:04.996812 315098 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:04.996821 315098 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:04.996827 315098 system_pods.go:61] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:04.996834 315098 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:04.996840 315098 system_pods.go:61] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:04.996852 315098 system_pods.go:74] duration metric: took 5.908484ms to wait for pod list to return data ...
I1122 02:51:04.996866 315098 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:04.999454 315098 default_sa.go:45] found service account: "default"
I1122 02:51:04.999480 315098 default_sa.go:55] duration metric: took 2.607343ms for default service account to be created ...
I1122 02:51:04.999490 315098 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:05.002424 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.002458 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.002466 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.002478 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.002483 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.002489 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.002497 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.002502 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.002510 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.002527 315098 retry.go:31] will retry after 292.812059ms: missing components: kube-dns
I1122 02:51:05.300370 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.300409 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:05.300423 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.300436 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.300441 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.300450 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.300455 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.300460 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.300473 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:05.300509 315098 retry.go:31] will retry after 302.068749ms: missing components: kube-dns
I1122 02:51:05.608920 315098 system_pods.go:86] 8 kube-system pods found
I1122 02:51:05.608952 315098 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running
I1122 02:51:05.608962 315098 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running
I1122 02:51:05.608970 315098 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running
I1122 02:51:05.608976 315098 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running
I1122 02:51:05.608981 315098 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running
I1122 02:51:05.608986 315098 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running
I1122 02:51:05.608991 315098 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running
I1122 02:51:05.608996 315098 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running
I1122 02:51:05.609006 315098 system_pods.go:126] duration metric: took 609.508843ms to wait for k8s-apps to be running ...
I1122 02:51:05.609016 315098 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:05.609060 315098 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:05.622415 315098 system_svc.go:56] duration metric: took 13.394002ms WaitForService to wait for kubelet
I1122 02:51:05.622441 315098 kubeadm.go:587] duration metric: took 11.949540634s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:05.622465 315098 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:05.625578 315098 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:05.625607 315098 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:05.625627 315098 node_conditions.go:105] duration metric: took 3.155603ms to run NodePressure ...
I1122 02:51:05.625647 315098 start.go:242] waiting for startup goroutines ...
I1122 02:51:05.625660 315098 start.go:247] waiting for cluster config update ...
I1122 02:51:05.625677 315098 start.go:256] writing updated cluster config ...
I1122 02:51:05.625998 315098 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:05.629769 315098 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:05.634023 315098 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.639844 315098 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:51:05.639870 315098 pod_ready.go:86] duration metric: took 5.820698ms for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.642079 315098 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.646975 315098 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.646997 315098 pod_ready.go:86] duration metric: took 4.896289ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.650547 315098 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.656360 315098 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:05.656379 315098 pod_ready.go:86] duration metric: took 5.809428ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:05.658496 315098 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.034642 315098 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:06.034672 315098 pod_ready.go:86] duration metric: took 376.141388ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.235032 315098 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.634430 315098 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:51:06.634459 315098 pod_ready.go:86] duration metric: took 399.402834ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:06.834285 315098 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234497 315098 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:51:07.234529 315098 pod_ready.go:86] duration metric: took 400.219434ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:51:07.234544 315098 pod_ready.go:40] duration metric: took 1.604742884s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:07.279768 315098 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:51:07.281342 315098 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
I1122 02:51:05.532532 321423 out.go:252] * Restarting existing docker container for "no-preload-346270" ...
I1122 02:51:05.532620 321423 cli_runner.go:164] Run: docker start no-preload-346270
I1122 02:51:05.816791 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:05.839930 321423 kic.go:430] container "no-preload-346270" state is running.
I1122 02:51:05.840366 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:05.860411 321423 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/config.json ...
I1122 02:51:05.860662 321423 machine.go:94] provisionDockerMachine start ...
I1122 02:51:05.860741 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:05.880986 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:05.881268 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:05.881285 321423 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:05.882003 321423 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59850->127.0.0.1:33113: read: connection reset by peer
I1122 02:51:09.012278 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.012306 321423 ubuntu.go:182] provisioning hostname "no-preload-346270"
I1122 02:51:09.012365 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.029857 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.030223 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.030245 321423 main.go:143] libmachine: About to run SSH command:
sudo hostname no-preload-346270 && echo "no-preload-346270" | sudo tee /etc/hostname
I1122 02:51:09.169532 321423 main.go:143] libmachine: SSH cmd err, output: <nil>: no-preload-346270
I1122 02:51:09.169634 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.187316 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.187555 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.187572 321423 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-346270' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-346270/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-346270' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:09.314808 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:09.314832 321423 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:09.314870 321423 ubuntu.go:190] setting up certificates
I1122 02:51:09.314884 321423 provision.go:84] configureAuth start
I1122 02:51:09.314968 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:09.333329 321423 provision.go:143] copyHostCerts
I1122 02:51:09.333396 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:09.333416 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:09.333497 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:09.333624 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:09.333638 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:09.333680 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:09.333781 321423 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:09.333791 321423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:09.333828 321423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:09.333936 321423 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.no-preload-346270 san=[127.0.0.1 192.168.103.2 localhost minikube no-preload-346270]
I1122 02:51:09.380976 321423 provision.go:177] copyRemoteCerts
I1122 02:51:09.381023 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:09.381066 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.397774 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.491675 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:09.508429 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:51:09.525294 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:09.541666 321423 provision.go:87] duration metric: took 226.765786ms to configureAuth
I1122 02:51:09.541693 321423 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:09.541850 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:09.541987 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.559289 321423 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:09.559516 321423 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33113 <nil> <nil>}
I1122 02:51:09.559533 321423 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:09.861098 321423 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:09.861128 321423 machine.go:97] duration metric: took 4.000446711s to provisionDockerMachine
I1122 02:51:09.861143 321423 start.go:293] postStartSetup for "no-preload-346270" (driver="docker")
I1122 02:51:09.861157 321423 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:09.861239 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:09.861284 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:09.880641 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:09.974101 321423 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:09.977444 321423 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:09.977475 321423 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:09.977488 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:09.977550 321423 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:09.977649 321423 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:09.977772 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:09.985350 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:10.001752 321423 start.go:296] duration metric: took 140.596737ms for postStartSetup
I1122 02:51:10.001816 321423 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:10.001866 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.019452 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.109262 321423 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:10.113505 321423 fix.go:56] duration metric: took 4.606268175s for fixHost
I1122 02:51:10.113529 321423 start.go:83] releasing machines lock for "no-preload-346270", held for 4.606314821s
I1122 02:51:10.113590 321423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-346270
I1122 02:51:10.130892 321423 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:10.130986 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.130993 321423 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:10.131044 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:10.148095 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.149275 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:10.237443 321423 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:10.288257 321423 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:10.322333 321423 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:10.326765 321423 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:10.326823 321423 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:10.334507 321423 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:10.334526 321423 start.go:496] detecting cgroup driver to use...
I1122 02:51:10.334559 321423 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:10.334612 321423 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:10.348194 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:10.359369 321423 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:10.359412 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:10.372620 321423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:10.384054 321423 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:10.463037 321423 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:10.545999 321423 docker.go:234] disabling docker service ...
I1122 02:51:10.546079 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:10.559066 321423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:10.570379 321423 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:10.648951 321423 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:10.726849 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:10.738572 321423 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:10.751757 321423 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:10.751813 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.760039 321423 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:10.760092 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.768370 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.776550 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.784678 321423 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:10.792267 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.800303 321423 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.808119 321423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:10.815945 321423 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:10.822682 321423 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:10.829812 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:10.909932 321423 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:11.047820 321423 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:11.047885 321423 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:11.051613 321423 start.go:564] Will wait 60s for crictl version
I1122 02:51:11.051669 321423 ssh_runner.go:195] Run: which crictl
I1122 02:51:11.055210 321423 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:11.081035 321423 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:11.081123 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.111141 321423 ssh_runner.go:195] Run: crio --version
I1122 02:51:11.140655 321423 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:11.141675 321423 cli_runner.go:164] Run: docker network inspect no-preload-346270 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:11.161301 321423 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I1122 02:51:11.165226 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.174797 321423 kubeadm.go:884] updating cluster {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:11.174956 321423 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:11.175032 321423 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:11.204999 321423 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:11.205018 321423 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:11.205025 321423 kubeadm.go:935] updating node { 192.168.103.2 8443 v1.34.1 crio true true} ...
I1122 02:51:11.205128 321423 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-346270 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:11.205212 321423 ssh_runner.go:195] Run: crio config
I1122 02:51:11.248739 321423 cni.go:84] Creating CNI manager for ""
I1122 02:51:11.248761 321423 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:11.248779 321423 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:11.248799 321423 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-346270 NodeName:no-preload-346270 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:11.250422 321423 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-346270"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.103.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:11.250742 321423 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:11.258573 321423 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:11.258616 321423 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:11.265773 321423 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:11.277486 321423 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:11.289322 321423 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2216 bytes)
I1122 02:51:11.301167 321423 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:11.304669 321423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:11.314168 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:11.392747 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:11.414847 321423 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270 for IP: 192.168.103.2
I1122 02:51:11.414869 321423 certs.go:195] generating shared ca certs ...
I1122 02:51:11.414885 321423 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:11.415077 321423 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:11.415137 321423 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:11.415151 321423 certs.go:257] generating profile certs ...
I1122 02:51:11.415274 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/client.key
I1122 02:51:11.415348 321423 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key.0aee8636
I1122 02:51:11.415420 321423 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key
I1122 02:51:11.415575 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:11.415618 321423 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:11.415632 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:11.415666 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:11.415698 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:11.415728 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:11.415782 321423 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:11.416629 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:11.434099 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:11.452019 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:11.470785 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:11.493447 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:51:11.511840 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:11.528280 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:11.544534 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/no-preload-346270/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:11.560450 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:11.576652 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:11.592823 321423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:11.609677 321423 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:11.621229 321423 ssh_runner.go:195] Run: openssl version
I1122 02:51:11.627023 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:11.634796 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638198 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:11.638247 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:11.673061 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:11.680196 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:11.688179 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691459 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.691519 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:11.724729 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:11.732016 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:11.739896 321423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743358 321423 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:11.743390 321423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:11.779449 321423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:11.787202 321423 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:11.790931 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:11.825925 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:11.864004 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:11.897650 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:11.943987 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:11.991846 321423 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:12.034579 321423 kubeadm.go:401] StartCluster: {Name:no-preload-346270 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:no-preload-346270 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:12.034687 321423 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:12.034785 321423 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:12.070615 321423 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:12.070637 321423 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:12.070641 321423 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:12.070644 321423 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:12.070647 321423 cri.go:89] found id: ""
I1122 02:51:12.070686 321423 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:12.087235 321423 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:12Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:12.087306 321423 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:12.095436 321423 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:12.095461 321423 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:12.095502 321423 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:12.104006 321423 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:12.105338 321423 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-346270" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.106304 321423 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-346270" cluster setting kubeconfig missing "no-preload-346270" context setting]
I1122 02:51:12.107661 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.110159 321423 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:12.118041 321423 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.103.2
I1122 02:51:12.118077 321423 kubeadm.go:602] duration metric: took 22.610162ms to restartPrimaryControlPlane
I1122 02:51:12.118087 321423 kubeadm.go:403] duration metric: took 83.520469ms to StartCluster
I1122 02:51:12.118102 321423 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.118181 321423 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:12.120719 321423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:12.120932 321423 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:12.121053 321423 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:12.121149 321423 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:12.121156 321423 addons.go:70] Setting storage-provisioner=true in profile "no-preload-346270"
I1122 02:51:12.121174 321423 addons.go:239] Setting addon storage-provisioner=true in "no-preload-346270"
W1122 02:51:12.121183 321423 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:12.121192 321423 addons.go:70] Setting default-storageclass=true in profile "no-preload-346270"
I1122 02:51:12.121206 321423 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "no-preload-346270"
I1122 02:51:12.121211 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121194 321423 addons.go:70] Setting dashboard=true in profile "no-preload-346270"
I1122 02:51:12.121234 321423 addons.go:239] Setting addon dashboard=true in "no-preload-346270"
W1122 02:51:12.121244 321423 addons.go:248] addon dashboard should already be in state true
I1122 02:51:12.121275 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.121546 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121684 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.121778 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.122684 321423 out.go:179] * Verifying Kubernetes components...
I1122 02:51:12.123731 321423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:12.147021 321423 addons.go:239] Setting addon default-storageclass=true in "no-preload-346270"
W1122 02:51:12.147091 321423 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:12.147131 321423 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:12.147594 321423 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:12.148252 321423 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:12.148252 321423 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:12.150224 321423 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.150242 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:12.150283 321423 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:12.150303 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.154020 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:12.154040 321423 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:12.154093 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.185355 321423 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.185384 321423 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:12.185448 321423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:12.186269 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.189464 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.214937 321423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:12.262215 321423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:12.274680 321423 node_ready.go:35] waiting up to 6m0s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:12.292510 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:12.300072 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:12.300091 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:12.315478 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:12.315499 321423 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:12.321137 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:12.329365 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:12.329386 321423 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:12.343422 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:12.343436 321423 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:12.356469 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:12.356528 321423 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:12.370188 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:12.370206 321423 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:12.383364 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:12.383385 321423 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:12.395140 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:12.395162 321423 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:12.407073 321423 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:12.407091 321423 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:12.419200 321423 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:13.706639 321423 node_ready.go:49] node "no-preload-346270" is "Ready"
I1122 02:51:13.706675 321423 node_ready.go:38] duration metric: took 1.431966817s for node "no-preload-346270" to be "Ready" ...
I1122 02:51:13.706693 321423 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:13.706749 321423 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:14.227510 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.934969246s)
I1122 02:51:14.227590 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.906419176s)
I1122 02:51:14.227696 321423 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.808462104s)
I1122 02:51:14.227749 321423 api_server.go:72] duration metric: took 2.106789491s to wait for apiserver process to appear ...
I1122 02:51:14.227772 321423 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:14.227797 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.232614 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.232635 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:14.233003 321423 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-346270 addons enable metrics-server
I1122 02:51:14.234413 321423 out.go:179] * Enabled addons: storage-provisioner, default-storageclass, dashboard
I1122 02:51:14.235431 321423 addons.go:530] duration metric: took 2.114388744s for enable addons: enabled=[storage-provisioner default-storageclass dashboard]
I1122 02:51:14.728204 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:14.732646 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:14.732670 321423 api_server.go:103] status: https://192.168.103.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:15.228038 321423 api_server.go:253] Checking apiserver healthz at https://192.168.103.2:8443/healthz ...
I1122 02:51:15.233046 321423 api_server.go:279] https://192.168.103.2:8443/healthz returned 200:
ok
I1122 02:51:15.234234 321423 api_server.go:141] control plane version: v1.34.1
I1122 02:51:15.234257 321423 api_server.go:131] duration metric: took 1.006474684s to wait for apiserver health ...
I1122 02:51:15.234265 321423 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:15.238124 321423 system_pods.go:59] 8 kube-system pods found
I1122 02:51:15.238151 321423 system_pods.go:61] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.238164 321423 system_pods.go:61] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.238187 321423 system_pods.go:61] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.238195 321423 system_pods.go:61] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.238203 321423 system_pods.go:61] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.238208 321423 system_pods.go:61] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.238215 321423 system_pods.go:61] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.238221 321423 system_pods.go:61] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.238229 321423 system_pods.go:74] duration metric: took 3.958929ms to wait for pod list to return data ...
I1122 02:51:15.238238 321423 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:15.240951 321423 default_sa.go:45] found service account: "default"
I1122 02:51:15.240971 321423 default_sa.go:55] duration metric: took 2.726862ms for default service account to be created ...
I1122 02:51:15.240981 321423 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:15.243750 321423 system_pods.go:86] 8 kube-system pods found
I1122 02:51:15.243773 321423 system_pods.go:89] "coredns-66bc5c9577-6tsqs" [1d8b5acd-6ff5-401d-b10b-b0215610f89f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:15.243780 321423 system_pods.go:89] "etcd-no-preload-346270" [adc5b7e0-aa37-4934-b4ff-c7097626f2fc] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:15.243789 321423 system_pods.go:89] "kindnet-8r9j8" [0619fa0d-b73c-464f-95c7-c91c3e277fd0] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:15.243799 321423 system_pods.go:89] "kube-apiserver-no-preload-346270" [3b694403-f4c1-4518-a103-93ce1e50658b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:15.243807 321423 system_pods.go:89] "kube-controller-manager-no-preload-346270" [d72ac78a-2a6f-4d65-9cf9-8400a36a329a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:15.243815 321423 system_pods.go:89] "kube-proxy-lpft6" [f0bf01fd-546e-443d-88e5-cc692a85fd0e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:15.243824 321423 system_pods.go:89] "kube-scheduler-no-preload-346270" [0cc28a91-f6d6-418f-b05e-c88118506aa2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:15.243843 321423 system_pods.go:89] "storage-provisioner" [5193d7c1-5d53-41ed-9565-77394f13c055] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:15.243853 321423 system_pods.go:126] duration metric: took 2.861267ms to wait for k8s-apps to be running ...
I1122 02:51:15.243866 321423 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:15.243945 321423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:15.258191 321423 system_svc.go:56] duration metric: took 14.317675ms WaitForService to wait for kubelet
I1122 02:51:15.258215 321423 kubeadm.go:587] duration metric: took 3.137259179s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:15.258229 321423 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:15.260690 321423 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:15.260711 321423 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:15.260725 321423 node_conditions.go:105] duration metric: took 2.491685ms to run NodePressure ...
I1122 02:51:15.260746 321423 start.go:242] waiting for startup goroutines ...
I1122 02:51:15.260760 321423 start.go:247] waiting for cluster config update ...
I1122 02:51:15.260778 321423 start.go:256] writing updated cluster config ...
I1122 02:51:15.261089 321423 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:15.264635 321423 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:15.268532 321423 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-6tsqs" in "kube-system" namespace to be "Ready" or be gone ...
==> CRI-O <==
Nov 22 02:51:05 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:05.109012836Z" level=info msg="Starting container: 4ed248e0cc500cecd65bc22ebc1319875e80ab73feb08fbecadea4a9ffbf89a8" id=7ef4ecae-c4d8-4932-a2f5-8b7f28a05a76 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:05 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:05.111268698Z" level=info msg="Started container" PID=1859 containerID=4ed248e0cc500cecd65bc22ebc1319875e80ab73feb08fbecadea4a9ffbf89a8 description=kube-system/coredns-66bc5c9577-d74g5/coredns id=7ef4ecae-c4d8-4932-a2f5-8b7f28a05a76 name=/runtime.v1.RuntimeService/StartContainer sandboxID=100e69d51ff4bd961a9ee5fc3675b1c1341843c220ca3534cc7916be1ac3ef70
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.744837386Z" level=info msg="Running pod sandbox: default/busybox/POD" id=9c4d9518-9c2c-4221-988d-f44b2c3e3d38 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.744897592Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.749402216Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:8327d1f785df94292eed92711d15ee90eeea175be013e404ca864560226e725c UID:1adb74f3-b60d-4211-b993-496fae3afe14 NetNS:/var/run/netns/858002d1-f41d-4204-9f23-45bf7aadfe8c Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00008ab08}] Aliases:map[]}"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.749436379Z" level=info msg="Adding pod default_busybox to CNI network \"kindnet\" (type=ptp)"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.758543045Z" level=info msg="Got pod network &{Name:busybox Namespace:default ID:8327d1f785df94292eed92711d15ee90eeea175be013e404ca864560226e725c UID:1adb74f3-b60d-4211-b993-496fae3afe14 NetNS:/var/run/netns/858002d1-f41d-4204-9f23-45bf7aadfe8c Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[] CgroupPath: PodAnnotations:0xc00008ab08}] Aliases:map[]}"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.758663Z" level=info msg="Checking pod default_busybox for CNI network kindnet (type=ptp)"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.75931389Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.760052054Z" level=info msg="Ran pod sandbox 8327d1f785df94292eed92711d15ee90eeea175be013e404ca864560226e725c with infra container: default/busybox/POD" id=9c4d9518-9c2c-4221-988d-f44b2c3e3d38 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.761001676Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=5f9ca107-cd07-4913-bc23-ac6c908ea071 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.761089002Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=5f9ca107-cd07-4913-bc23-ac6c908ea071 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.761116365Z" level=info msg="Neither image nor artfiact gcr.io/k8s-minikube/busybox:1.28.4-glibc found" id=5f9ca107-cd07-4913-bc23-ac6c908ea071 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.761771591Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=65f181a7-faad-4c50-a1d2-088b3217e191 name=/runtime.v1.ImageService/PullImage
Nov 22 02:51:07 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:07.763253412Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28.4-glibc\""
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.386243585Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998" id=65f181a7-faad-4c50-a1d2-088b3217e191 name=/runtime.v1.ImageService/PullImage
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.386883709Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=be3f4672-8cbe-40ec-90b7-559af7b02e02 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.388133571Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=75234661-b933-4c40-89f0-fe4c1d46c9e5 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.390886669Z" level=info msg="Creating container: default/busybox/busybox" id=187e3e66-9454-457e-bbab-20762879bf88 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.391008714Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.394433117Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.395394856Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.422396041Z" level=info msg="Created container 710dce4b22f20ba9a12fa4e411eb7dc053a68b4af1d8044c28d8f2e9f8a1b37a: default/busybox/busybox" id=187e3e66-9454-457e-bbab-20762879bf88 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.422985301Z" level=info msg="Starting container: 710dce4b22f20ba9a12fa4e411eb7dc053a68b4af1d8044c28d8f2e9f8a1b37a" id=de8c96df-72ce-4e1e-ba52-f2bc8ea3e625 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:08 default-k8s-diff-port-714134 crio[769]: time="2025-11-22T02:51:08.424476598Z" level=info msg="Started container" PID=1934 containerID=710dce4b22f20ba9a12fa4e411eb7dc053a68b4af1d8044c28d8f2e9f8a1b37a description=default/busybox/busybox id=de8c96df-72ce-4e1e-ba52-f2bc8ea3e625 name=/runtime.v1.RuntimeService/StartContainer sandboxID=8327d1f785df94292eed92711d15ee90eeea175be013e404ca864560226e725c
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
710dce4b22f20 gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998 7 seconds ago Running busybox 0 8327d1f785df9 busybox default
4ed248e0cc500 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 10 seconds ago Running coredns 0 100e69d51ff4b coredns-66bc5c9577-d74g5 kube-system
0d7d77ddf965b 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 10 seconds ago Running storage-provisioner 0 b4a1b87554db8 storage-provisioner kube-system
8ea4067f00141 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 22 seconds ago Running kindnet-cni 0 b49db4c1531bf kindnet-jzn9z kube-system
c10041df3114b fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 22 seconds ago Running kube-proxy 0 e8ed80de00915 kube-proxy-ppn8j kube-system
554dcd57e129b c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 32 seconds ago Running kube-apiserver 0 8d61d5c258d5a kube-apiserver-default-k8s-diff-port-714134 kube-system
5c757dc3feab2 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 32 seconds ago Running kube-controller-manager 0 a8b2c236994ed kube-controller-manager-default-k8s-diff-port-714134 kube-system
e37e4625188da 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 32 seconds ago Running kube-scheduler 0 121ea52cabbfb kube-scheduler-default-k8s-diff-port-714134 kube-system
a45ab541a30dc 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 32 seconds ago Running etcd 0 ba0622cbc68fc etcd-default-k8s-diff-port-714134 kube-system
==> coredns [4ed248e0cc500cecd65bc22ebc1319875e80ab73feb08fbecadea4a9ffbf89a8] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = c7556d8fdf49c5e32a9077be8cfb9fc6947bb07e663a10d55b192eb63ad1f2bd9793e8e5f5a36fc9abb1957831eec5c997fd9821790e3990ae9531bf41ecea37
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:39442 - 61165 "HINFO IN 1362057438538993448.7408776361525274148. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.079979436s
==> describe nodes <==
Name: default-k8s-diff-port-714134
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-714134
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=default-k8s-diff-port-714134
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_48_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:45 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-714134
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:51:04 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:51:04 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:51:04 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:51:04 +0000 Sat, 22 Nov 2025 02:51:04 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.94.2
Hostname: default-k8s-diff-port-714134
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 49aec726-6fdc-4995-886e-8625defc71e6
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9s
kube-system coredns-66bc5c9577-d74g5 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 23s
kube-system etcd-default-k8s-diff-port-714134 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 29s
kube-system kindnet-jzn9z 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 23s
kube-system kube-apiserver-default-k8s-diff-port-714134 250m (3%) 0 (0%) 0 (0%) 0 (0%) 29s
kube-system kube-controller-manager-default-k8s-diff-port-714134 200m (2%) 0 (0%) 0 (0%) 0 (0%) 29s
kube-system kube-proxy-ppn8j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 23s
kube-system kube-scheduler-default-k8s-diff-port-714134 100m (1%) 0 (0%) 0 (0%) 0 (0%) 29s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 22s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 21s kube-proxy
Normal Starting 35s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 35s (x8 over 35s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 35s (x8 over 35s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 35s (x8 over 35s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal Starting 29s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 29s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 29s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 29s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal RegisteredNode 24s node-controller Node default-k8s-diff-port-714134 event: Registered Node default-k8s-diff-port-714134 in Controller
Normal NodeReady 12s kubelet Node default-k8s-diff-port-714134 status is now: NodeReady
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [a45ab541a30dc2c434fb29841a62d4834c5bd7b63304c0c54d42cc42bee6eb38] <==
{"level":"warn","ts":"2025-11-22T02:50:44.293466Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52384","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.302738Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52388","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.310758Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52406","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.319526Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52434","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.327707Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52450","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.336717Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52476","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.344581Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52482","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.352498Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52502","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.360566Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52510","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.376049Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52524","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.383284Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52530","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.392574Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52542","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.400455Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52568","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.408180Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52576","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.416181Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52598","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.426482Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52612","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.434391Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52632","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.442328Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52648","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.452216Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52664","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.465110Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52686","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.480360Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52710","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.496575Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52740","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.506108Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52748","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.513521Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52764","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:50:44.561433Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:52786","server-name":"","error":"EOF"}
==> kernel <==
02:51:16 up 1:33, 0 user, load average: 5.02, 3.85, 2.25
Linux default-k8s-diff-port-714134 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [8ea4067f001411108bf2dcb592e96deb91524a27368dfe52e018f61ed1caf75a] <==
I1122 02:50:54.170024 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:50:54.170435 1 main.go:139] hostIP = 192.168.94.2
podIP = 192.168.94.2
I1122 02:50:54.170586 1 main.go:148] setting mtu 1500 for CNI
I1122 02:50:54.170600 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:50:54.170624 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:50:54Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:50:54.374878 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:50:54.374900 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:50:54.466783 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:50:54.466989 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:50:54.767003 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:50:54.767040 1 metrics.go:72] Registering metrics
I1122 02:50:54.767334 1 controller.go:711] "Syncing nftables rules"
I1122 02:51:04.376044 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:51:04.376096 1 main.go:301] handling current node
I1122 02:51:14.376068 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:51:14.376111 1 main.go:301] handling current node
==> kube-apiserver [554dcd57e129b5a1c254f0fb813a8806c30d53c67101cc38378baf9506115c1c] <==
I1122 02:50:45.128205 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:50:45.131309 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:50:45.131349 1 default_servicecidr_controller.go:166] Creating default ServiceCIDR with CIDRs: [10.96.0.0/12]
I1122 02:50:45.134530 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:50:45.141416 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:50:45.172630 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:45.200331 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:50:46.030061 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:50:46.034769 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:50:46.034795 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:50:46.501094 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:50:46.536072 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:50:46.640629 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:50:46.647356 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.94.2]
I1122 02:50:46.648467 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:50:46.652498 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:50:47.390840 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:50:47.610965 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:50:47.619753 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:50:47.626781 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:50:53.143759 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:53.147107 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:50:53.242234 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1122 02:50:53.441809 1 controller.go:667] quota admission added evaluator for: replicasets.apps
E1122 02:51:14.536982 1 conn.go:339] Error on socket receive: read tcp 192.168.94.2:8444->192.168.94.1:36648: use of closed network connection
==> kube-controller-manager [5c757dc3feab2f532ce3ac9247d34c214e67e7b5f1b72b7b9c12f62a131f67e0] <==
I1122 02:50:52.389090 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:50:52.389297 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:50:52.389296 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:50:52.390227 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:50:52.390239 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:50:52.390256 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:50:52.390303 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:50:52.390309 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:50:52.390479 1 shared_informer.go:356] "Caches are synced" controller="PVC protection"
I1122 02:50:52.390877 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:50:52.391002 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:50:52.391133 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:50:52.392610 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:50:52.393699 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:50:52.393711 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:50:52.394815 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 02:50:52.397081 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:50:52.397126 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:50:52.397164 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:50:52.397171 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:50:52.397175 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:50:52.400372 1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
I1122 02:50:52.402427 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="default-k8s-diff-port-714134" podCIDRs=["10.244.0.0/24"]
I1122 02:50:52.410375 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:07.343152 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [c10041df3114b57a65c2622803e20153dc09e79cba3f882528cdac2be1e9092e] <==
I1122 02:50:53.962005 1 server_linux.go:53] "Using iptables proxy"
I1122 02:50:54.027378 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:50:54.127569 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:50:54.127612 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.94.2"]
E1122 02:50:54.127703 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:50:54.151526 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:50:54.151594 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:50:54.158418 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:50:54.159069 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:50:54.159121 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:54.160761 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:50:54.160788 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:50:54.160832 1 config.go:200] "Starting service config controller"
I1122 02:50:54.160897 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:50:54.160845 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:50:54.160970 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:50:54.162286 1 config.go:309] "Starting node config controller"
I1122 02:50:54.162332 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:50:54.162341 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:50:54.260980 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:50:54.260987 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:50:54.262307 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [e37e4625188daa4eaef25e718f22d3bb07fe6dc0e223d8e0bac1f833efa72e51] <==
I1122 02:50:46.142323 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:50:46.144857 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:50:46.144926 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:50:46.145324 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:50:46.145370 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E1122 02:50:46.146242 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:50:46.146989 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:50:46.151110 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:50:46.151134 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:50:46.151230 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:50:46.151457 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:50:46.151352 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1122 02:50:46.151356 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:50:46.151460 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:50:46.151520 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:50:46.151499 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:50:46.151560 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:50:46.151571 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:50:46.151656 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:50:46.151798 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:50:46.151818 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:50:46.151948 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:50:46.151235 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:50:46.152057 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
I1122 02:50:47.345927 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:50:48 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:48.495723 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-default-k8s-diff-port-714134" podStartSLOduration=1.495705394 podStartE2EDuration="1.495705394s" podCreationTimestamp="2025-11-22 02:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:48.495513757 +0000 UTC m=+1.140261632" watchObservedRunningTime="2025-11-22 02:50:48.495705394 +0000 UTC m=+1.140453254"
Nov 22 02:50:48 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:48.511391 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-default-k8s-diff-port-714134" podStartSLOduration=1.511372793 podStartE2EDuration="1.511372793s" podCreationTimestamp="2025-11-22 02:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:48.511367086 +0000 UTC m=+1.156114952" watchObservedRunningTime="2025-11-22 02:50:48.511372793 +0000 UTC m=+1.156120653"
Nov 22 02:50:48 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:48.511542 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/etcd-default-k8s-diff-port-714134" podStartSLOduration=1.51153511 podStartE2EDuration="1.51153511s" podCreationTimestamp="2025-11-22 02:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:48.502738038 +0000 UTC m=+1.147485907" watchObservedRunningTime="2025-11-22 02:50:48.51153511 +0000 UTC m=+1.156282975"
Nov 22 02:50:48 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:48.530660 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-default-k8s-diff-port-714134" podStartSLOduration=1.530642513 podStartE2EDuration="1.530642513s" podCreationTimestamp="2025-11-22 02:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:48.521353637 +0000 UTC m=+1.166101502" watchObservedRunningTime="2025-11-22 02:50:48.530642513 +0000 UTC m=+1.175390380"
Nov 22 02:50:52 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:52.465202 1310 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Nov 22 02:50:52 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:52.465833 1310 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.267081 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4cde99fd-ddcb-4210-b7e9-e2c960bf34ae-xtables-lock\") pod \"kube-proxy-ppn8j\" (UID: \"4cde99fd-ddcb-4210-b7e9-e2c960bf34ae\") " pod="kube-system/kube-proxy-ppn8j"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.267133 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cde99fd-ddcb-4210-b7e9-e2c960bf34ae-lib-modules\") pod \"kube-proxy-ppn8j\" (UID: \"4cde99fd-ddcb-4210-b7e9-e2c960bf34ae\") " pod="kube-system/kube-proxy-ppn8j"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.267164 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/4cde99fd-ddcb-4210-b7e9-e2c960bf34ae-kube-proxy\") pod \"kube-proxy-ppn8j\" (UID: \"4cde99fd-ddcb-4210-b7e9-e2c960bf34ae\") " pod="kube-system/kube-proxy-ppn8j"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.267184 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpd86\" (UniqueName: \"kubernetes.io/projected/4cde99fd-ddcb-4210-b7e9-e2c960bf34ae-kube-api-access-bpd86\") pod \"kube-proxy-ppn8j\" (UID: \"4cde99fd-ddcb-4210-b7e9-e2c960bf34ae\") " pod="kube-system/kube-proxy-ppn8j"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.367752 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/bd1a1993-721e-4ad8-8b2e-483f7223c084-xtables-lock\") pod \"kindnet-jzn9z\" (UID: \"bd1a1993-721e-4ad8-8b2e-483f7223c084\") " pod="kube-system/kindnet-jzn9z"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.367798 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7zf\" (UniqueName: \"kubernetes.io/projected/bd1a1993-721e-4ad8-8b2e-483f7223c084-kube-api-access-qr7zf\") pod \"kindnet-jzn9z\" (UID: \"bd1a1993-721e-4ad8-8b2e-483f7223c084\") " pod="kube-system/kindnet-jzn9z"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.367853 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/bd1a1993-721e-4ad8-8b2e-483f7223c084-cni-cfg\") pod \"kindnet-jzn9z\" (UID: \"bd1a1993-721e-4ad8-8b2e-483f7223c084\") " pod="kube-system/kindnet-jzn9z"
Nov 22 02:50:53 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:53.367879 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd1a1993-721e-4ad8-8b2e-483f7223c084-lib-modules\") pod \"kindnet-jzn9z\" (UID: \"bd1a1993-721e-4ad8-8b2e-483f7223c084\") " pod="kube-system/kindnet-jzn9z"
Nov 22 02:50:54 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:54.508556 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-jzn9z" podStartSLOduration=1.508534321 podStartE2EDuration="1.508534321s" podCreationTimestamp="2025-11-22 02:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:54.497166613 +0000 UTC m=+7.141914479" watchObservedRunningTime="2025-11-22 02:50:54.508534321 +0000 UTC m=+7.153282185"
Nov 22 02:50:54 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:50:54.509601 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-ppn8j" podStartSLOduration=1.509565396 podStartE2EDuration="1.509565396s" podCreationTimestamp="2025-11-22 02:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:50:54.508487259 +0000 UTC m=+7.153235125" watchObservedRunningTime="2025-11-22 02:50:54.509565396 +0000 UTC m=+7.154313262"
Nov 22 02:51:04 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:04.686650 1310 kubelet_node_status.go:439] "Fast updating node status as it just became ready"
Nov 22 02:51:04 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:04.738242 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6wc\" (UniqueName: \"kubernetes.io/projected/675367a5-8e5e-4257-90af-e021e0555ed5-kube-api-access-rp6wc\") pod \"storage-provisioner\" (UID: \"675367a5-8e5e-4257-90af-e021e0555ed5\") " pod="kube-system/storage-provisioner"
Nov 22 02:51:04 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:04.738311 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b9c4fb7-8643-4a65-a1d1-39a187413744-config-volume\") pod \"coredns-66bc5c9577-d74g5\" (UID: \"4b9c4fb7-8643-4a65-a1d1-39a187413744\") " pod="kube-system/coredns-66bc5c9577-d74g5"
Nov 22 02:51:04 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:04.738335 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/675367a5-8e5e-4257-90af-e021e0555ed5-tmp\") pod \"storage-provisioner\" (UID: \"675367a5-8e5e-4257-90af-e021e0555ed5\") " pod="kube-system/storage-provisioner"
Nov 22 02:51:04 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:04.738351 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqd8k\" (UniqueName: \"kubernetes.io/projected/4b9c4fb7-8643-4a65-a1d1-39a187413744-kube-api-access-nqd8k\") pod \"coredns-66bc5c9577-d74g5\" (UID: \"4b9c4fb7-8643-4a65-a1d1-39a187413744\") " pod="kube-system/coredns-66bc5c9577-d74g5"
Nov 22 02:51:05 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:05.520486 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=11.520466938 podStartE2EDuration="11.520466938s" podCreationTimestamp="2025-11-22 02:50:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:05.52021037 +0000 UTC m=+18.164958275" watchObservedRunningTime="2025-11-22 02:51:05.520466938 +0000 UTC m=+18.165214804"
Nov 22 02:51:05 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:05.533664 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-66bc5c9577-d74g5" podStartSLOduration=12.533642669 podStartE2EDuration="12.533642669s" podCreationTimestamp="2025-11-22 02:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:05.533534455 +0000 UTC m=+18.178282322" watchObservedRunningTime="2025-11-22 02:51:05.533642669 +0000 UTC m=+18.178390535"
Nov 22 02:51:07 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:07.558507 1310 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249xs\" (UniqueName: \"kubernetes.io/projected/1adb74f3-b60d-4211-b993-496fae3afe14-kube-api-access-249xs\") pod \"busybox\" (UID: \"1adb74f3-b60d-4211-b993-496fae3afe14\") " pod="default/busybox"
Nov 22 02:51:08 default-k8s-diff-port-714134 kubelet[1310]: I1122 02:51:08.524720 1310 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/busybox" podStartSLOduration=0.898482691 podStartE2EDuration="1.524703591s" podCreationTimestamp="2025-11-22 02:51:07 +0000 UTC" firstStartedPulling="2025-11-22 02:51:07.761374329 +0000 UTC m=+20.406122178" lastFinishedPulling="2025-11-22 02:51:08.387595218 +0000 UTC m=+21.032343078" observedRunningTime="2025-11-22 02:51:08.524489256 +0000 UTC m=+21.169237121" watchObservedRunningTime="2025-11-22 02:51:08.524703591 +0000 UTC m=+21.169451456"
==> storage-provisioner [0d7d77ddf965bc1736c0269482cd207b232c446bb0fe3865fc5b5f0cc7ea1772] <==
I1122 02:51:05.105521 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:51:05.114338 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:51:05.114392 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:51:05.118468 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:05.123013 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:51:05.123232 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:51:05.123357 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"ac612922-cc8d-492b-8e78-8d20922eff82", APIVersion:"v1", ResourceVersion:"442", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' default-k8s-diff-port-714134_f1c1a953-7818-4232-becd-856da8f208ac became leader
I1122 02:51:05.123437 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_f1c1a953-7818-4232-becd-856da8f208ac!
W1122 02:51:05.126526 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:05.131431 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:51:05.223994 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_f1c1a953-7818-4232-becd-856da8f208ac!
W1122 02:51:07.135003 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:07.139247 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:09.142571 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:09.146191 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:11.149497 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:11.154241 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:13.157406 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:13.161769 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:15.165797 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:51:15.169846 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:269: (dbg) Run: kubectl --context default-k8s-diff-port-714134 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (2.20s)
=== RUN TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p no-preload-346270 --alsologtostderr -v=1
E1122 02:51:46.940221 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p no-preload-346270 --alsologtostderr -v=1: exit status 80 (1.786730669s)
-- stdout --
* Pausing node no-preload-346270 ...
-- /stdout --
** stderr **
I1122 02:51:45.237074 334393 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:45.237188 334393 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:45.237199 334393 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:45.237205 334393 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:45.237504 334393 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:45.237812 334393 out.go:368] Setting JSON to false
I1122 02:51:45.237858 334393 mustload.go:66] Loading cluster: no-preload-346270
I1122 02:51:45.239160 334393 config.go:182] Loaded profile config "no-preload-346270": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:45.239824 334393 cli_runner.go:164] Run: docker container inspect no-preload-346270 --format={{.State.Status}}
I1122 02:51:45.268845 334393 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:45.269142 334393 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:45.345505 334393 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:79 OomKillDisable:false NGoroutines:88 SystemTime:2025-11-22 02:51:45.331438125 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:45.346156 334393 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:no-preload-346270 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true)
wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:51:45.349024 334393 out.go:179] * Pausing node no-preload-346270 ...
I1122 02:51:45.350209 334393 host.go:66] Checking if "no-preload-346270" exists ...
I1122 02:51:45.350516 334393 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:45.350577 334393 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-346270
I1122 02:51:45.377549 334393 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33113 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/no-preload-346270/id_rsa Username:docker}
I1122 02:51:45.484297 334393 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:45.502447 334393 pause.go:52] kubelet running: true
I1122 02:51:45.502660 334393 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:45.701003 334393 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:45.701095 334393 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:45.770447 334393 cri.go:89] found id: "c9c7339c17947a0fd12c23bd778cf8477baf7d7022c6b20e8c04148e7509eb5e"
I1122 02:51:45.770472 334393 cri.go:89] found id: "29d9eeb45ea5d45dddc97d4396e06f7162dc0002085d9ea51ef8f7c840edd886"
I1122 02:51:45.770477 334393 cri.go:89] found id: "f9bac6a5b7121e33df35418702e434766200300826f6bc80d6d7cce1af9870f2"
I1122 02:51:45.770483 334393 cri.go:89] found id: "10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6"
I1122 02:51:45.770497 334393 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:45.770502 334393 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:45.770505 334393 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:45.770507 334393 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:45.770510 334393 cri.go:89] found id: "70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa"
I1122 02:51:45.770516 334393 cri.go:89] found id: "c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
I1122 02:51:45.770519 334393 cri.go:89] found id: ""
I1122 02:51:45.770557 334393 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:45.782719 334393 retry.go:31] will retry after 216.7371ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:45Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:46.000205 334393 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:46.017215 334393 pause.go:52] kubelet running: false
I1122 02:51:46.017289 334393 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:46.224468 334393 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:46.224562 334393 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:46.316771 334393 cri.go:89] found id: "c9c7339c17947a0fd12c23bd778cf8477baf7d7022c6b20e8c04148e7509eb5e"
I1122 02:51:46.316795 334393 cri.go:89] found id: "29d9eeb45ea5d45dddc97d4396e06f7162dc0002085d9ea51ef8f7c840edd886"
I1122 02:51:46.316801 334393 cri.go:89] found id: "f9bac6a5b7121e33df35418702e434766200300826f6bc80d6d7cce1af9870f2"
I1122 02:51:46.316805 334393 cri.go:89] found id: "10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6"
I1122 02:51:46.316809 334393 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:46.316825 334393 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:46.316829 334393 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:46.316834 334393 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:46.316838 334393 cri.go:89] found id: "70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa"
I1122 02:51:46.316847 334393 cri.go:89] found id: "c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
I1122 02:51:46.316851 334393 cri.go:89] found id: ""
I1122 02:51:46.316899 334393 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:46.332550 334393 retry.go:31] will retry after 274.274954ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:46Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:46.607869 334393 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:46.630041 334393 pause.go:52] kubelet running: false
I1122 02:51:46.630101 334393 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:51:46.829804 334393 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:51:46.829889 334393 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:51:46.912894 334393 cri.go:89] found id: "c9c7339c17947a0fd12c23bd778cf8477baf7d7022c6b20e8c04148e7509eb5e"
I1122 02:51:46.912930 334393 cri.go:89] found id: "29d9eeb45ea5d45dddc97d4396e06f7162dc0002085d9ea51ef8f7c840edd886"
I1122 02:51:46.912936 334393 cri.go:89] found id: "f9bac6a5b7121e33df35418702e434766200300826f6bc80d6d7cce1af9870f2"
I1122 02:51:46.912940 334393 cri.go:89] found id: "10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6"
I1122 02:51:46.912944 334393 cri.go:89] found id: "dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9"
I1122 02:51:46.912948 334393 cri.go:89] found id: "46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127"
I1122 02:51:46.912951 334393 cri.go:89] found id: "1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c"
I1122 02:51:46.912955 334393 cri.go:89] found id: "4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32"
I1122 02:51:46.912958 334393 cri.go:89] found id: "70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa"
I1122 02:51:46.912999 334393 cri.go:89] found id: "c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
I1122 02:51:46.913007 334393 cri.go:89] found id: ""
I1122 02:51:46.913054 334393 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:51:46.929192 334393 out.go:203]
W1122 02:51:46.930600 334393 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:46Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:46Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:51:46.930623 334393 out.go:285] *
*
W1122 02:51:46.936449 334393 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:51:46.937851 334393 out.go:203]
** /stderr **
start_stop_delete_test.go:309: out/minikube-linux-amd64 pause -p no-preload-346270 --alsologtostderr -v=1 failed: exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect no-preload-346270
E1122 02:51:46.946830 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:46.958230 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:243: (dbg) docker inspect no-preload-346270:
-- stdout --
[
{
"Id": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"Created": "2025-11-22T02:49:44.656554358Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 321688,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:05.560417745Z",
"FinishedAt": "2025-11-22T02:51:04.560200714Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hostname",
"HostsPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hosts",
"LogPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d-json.log",
"Name": "/no-preload-346270",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"no-preload-346270:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "no-preload-346270",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"LowerDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/merged",
"UpperDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/diff",
"WorkDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "no-preload-346270",
"Source": "/var/lib/docker/volumes/no-preload-346270/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "no-preload-346270",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "no-preload-346270",
"name.minikube.sigs.k8s.io": "no-preload-346270",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "bc7e59878749156aee3e06e316ed490dfb58b6038f2d059859101125832b5169",
"SandboxKey": "/var/run/docker/netns/bc7e59878749",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33113"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33114"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33117"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33115"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33116"
}
]
},
"Networks": {
"no-preload-346270": {
"IPAMConfig": {
"IPv4Address": "192.168.103.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "b056c157b0938097ab83f43dd906bd8cb89754351bc1a446e56b63614f473353",
"EndpointID": "0fe4ab649a0f62cce7889ecd033cd708d10657737ae761da12484f8276a73207",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"MacAddress": "26:18:4b:14:ff:c6",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"no-preload-346270",
"6c4d4f5318ee"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270
E1122 02:51:46.979691 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:47.021130 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:47.103330 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:47.265091 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270: exit status 2 (404.628669ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/no-preload/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25
E1122 02:51:47.587079 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:48.228512 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25: (1.485846821s)
helpers_test.go:260: TestStartStop/group/no-preload/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:33
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:33.808120 331164 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:33.808429 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808440 331164 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:33.808447 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808699 331164 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:33.809239 331164 out.go:368] Setting JSON to false
I1122 02:51:33.810667 331164 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5637,"bootTime":1763774257,"procs":295,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:33.810733 331164 start.go:143] virtualization: kvm guest
I1122 02:51:33.817123 331164 out.go:179] * [default-k8s-diff-port-714134] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:33.818705 331164 notify.go:221] Checking for updates...
I1122 02:51:33.818743 331164 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:33.822389 331164 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:33.823661 331164 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:33.824783 331164 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:33.825764 331164 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:33.826754 331164 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:33.828520 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:33.829196 331164 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:33.857369 331164 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:33.857562 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.920077 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.910365077 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.920186 331164 docker.go:319] overlay module found
I1122 02:51:33.922011 331164 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:33.923075 331164 start.go:309] selected driver: docker
I1122 02:51:33.923090 331164 start.go:927] validating driver "docker" against &{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.923198 331164 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:33.923985 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.996972 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.986760851 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.997265 331164 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:33.997302 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.997351 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.997382 331164 start.go:353] cluster config:
{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.999198 331164 out.go:179] * Starting "default-k8s-diff-port-714134" primary control-plane node in "default-k8s-diff-port-714134" cluster
I1122 02:51:34.000156 331164 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:34.001284 331164 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:34.002331 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:34.002366 331164 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:34.002380 331164 cache.go:65] Caching tarball of preloaded images
I1122 02:51:34.002411 331164 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:34.002468 331164 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:34.002478 331164 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:34.002600 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.023601 331164 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:34.023621 331164 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:34.023641 331164 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:34.023666 331164 start.go:360] acquireMachinesLock for default-k8s-diff-port-714134: {Name:mk7e1a12e2fa8aced0c98248f29bf8f0364ff72a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:34.023746 331164 start.go:364] duration metric: took 44.96µs to acquireMachinesLock for "default-k8s-diff-port-714134"
I1122 02:51:34.023769 331164 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:34.023775 331164 fix.go:54] fixHost starting:
I1122 02:51:34.024069 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.041134 331164 fix.go:112] recreateIfNeeded on default-k8s-diff-port-714134: state=Stopped err=<nil>
W1122 02:51:34.041193 331164 fix.go:138] unexpected machine state, will restart: <nil>
I1122 02:51:33.703692 327960 cli_runner.go:164] Run: docker network inspect embed-certs-153115 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:33.722074 327960 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:51:33.725954 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.735738 327960 kubeadm.go:884] updating cluster {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:33.735890 327960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:33.735990 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.775864 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.775888 327960 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:33.775945 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.803499 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.803521 327960 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:33.803530 327960 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.34.1 crio true true} ...
I1122 02:51:33.803634 327960 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-153115 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:33.803708 327960 ssh_runner.go:195] Run: crio config
I1122 02:51:33.859877 327960 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.859923 327960 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.859948 327960 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:33.859982 327960 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-153115 NodeName:embed-certs-153115 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/et
c/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:33.860206 327960 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-153115"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:33.860275 327960 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:33.869804 327960 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:33.869931 327960 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:33.879000 327960 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:33.892987 327960 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:33.909568 327960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2214 bytes)
I1122 02:51:33.923811 327960 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:33.927547 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.937743 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.038162 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:34.064574 327960 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115 for IP: 192.168.76.2
I1122 02:51:34.064592 327960 certs.go:195] generating shared ca certs ...
I1122 02:51:34.064608 327960 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.064762 327960 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:34.064809 327960 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:34.064819 327960 certs.go:257] generating profile certs ...
I1122 02:51:34.064963 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/client.key
I1122 02:51:34.065021 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key.a2dcd911
I1122 02:51:34.065079 327960 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key
I1122 02:51:34.065209 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:34.065245 327960 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:34.065253 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:34.065282 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:34.065308 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:34.065334 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:34.065385 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:34.066195 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:34.087518 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:34.107591 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:34.127804 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:34.150798 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I1122 02:51:34.172965 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:34.200246 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:34.219605 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:51:34.237481 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:34.257690 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:34.276956 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:34.294622 327960 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:34.306511 327960 ssh_runner.go:195] Run: openssl version
I1122 02:51:34.312288 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:34.320109 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324197 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324278 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:34.367392 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:34.377010 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:34.387536 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.391975 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.392022 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.429653 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:34.438043 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:34.447315 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451034 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451086 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:34.491615 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:34.499711 327960 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:34.503423 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:34.541936 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:34.589295 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:34.648308 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:34.707752 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:34.760015 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:34.804463 327960 kubeadm.go:401] StartCluster: {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:34.804572 327960 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:34.804626 327960 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:34.837717 327960 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:51:34.837741 327960 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:51:34.837746 327960 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:51:34.837751 327960 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:51:34.837755 327960 cri.go:89] found id: ""
I1122 02:51:34.837797 327960 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:34.849976 327960 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:34Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:34.850037 327960 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:34.858633 327960 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:34.858646 327960 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:34.858702 327960 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:34.866840 327960 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:34.870118 327960 kubeconfig.go:47] verify endpoint returned: get endpoint: "embed-certs-153115" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.870434 327960 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "embed-certs-153115" cluster setting kubeconfig missing "embed-certs-153115" context setting]
I1122 02:51:34.871098 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.872766 327960 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:34.880234 327960 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.76.2
I1122 02:51:34.880263 327960 kubeadm.go:602] duration metric: took 21.610639ms to restartPrimaryControlPlane
I1122 02:51:34.880272 327960 kubeadm.go:403] duration metric: took 75.818579ms to StartCluster
I1122 02:51:34.880288 327960 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.880344 327960 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.881853 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.882098 327960 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:34.882167 327960 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:34.882274 327960 addons.go:70] Setting storage-provisioner=true in profile "embed-certs-153115"
I1122 02:51:34.882296 327960 addons.go:70] Setting dashboard=true in profile "embed-certs-153115"
I1122 02:51:34.882311 327960 addons.go:239] Setting addon storage-provisioner=true in "embed-certs-153115"
I1122 02:51:34.882316 327960 addons.go:239] Setting addon dashboard=true in "embed-certs-153115"
W1122 02:51:34.882319 327960 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:34.882318 327960 addons.go:70] Setting default-storageclass=true in profile "embed-certs-153115"
I1122 02:51:34.882327 327960 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:34.882347 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882352 327960 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-153115"
W1122 02:51:34.882325 327960 addons.go:248] addon dashboard should already be in state true
I1122 02:51:34.882443 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882675 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.882878 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.883057 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.884392 327960 out.go:179] * Verifying Kubernetes components...
I1122 02:51:34.886921 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.911466 327960 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:34.911523 327960 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:34.911898 327960 addons.go:239] Setting addon default-storageclass=true in "embed-certs-153115"
W1122 02:51:34.911934 327960 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:34.911961 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.912424 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.912938 327960 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:34.912957 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:34.913007 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.913995 327960 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:34.915941 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:34.915959 327960 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:34.916008 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.944068 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.947046 327960 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:34.947068 327960 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:34.947264 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.956178 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.973759 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:35.050045 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:35.066242 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:35.067551 327960 node_ready.go:35] waiting up to 6m0s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:35.080204 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:35.080225 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:35.089121 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:35.095997 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:35.096015 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:35.112983 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:35.113005 327960 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:35.129055 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:35.129078 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:35.144601 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:35.144620 327960 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:35.160289 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:35.160304 327960 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:35.175854 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:35.175876 327960 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:35.188348 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:35.188368 327960 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:35.200442 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:35.200459 327960 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:35.213676 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:36.450666 327960 node_ready.go:49] node "embed-certs-153115" is "Ready"
I1122 02:51:36.450712 327960 node_ready.go:38] duration metric: took 1.383125895s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:36.450729 327960 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:36.450786 327960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:36.968538 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.902260952s)
I1122 02:51:36.968607 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.879455326s)
I1122 02:51:36.968726 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.754999504s)
I1122 02:51:36.968787 327960 api_server.go:72] duration metric: took 2.086658227s to wait for apiserver process to appear ...
I1122 02:51:36.968849 327960 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:36.968872 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:36.970439 327960 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p embed-certs-153115 addons enable metrics-server
I1122 02:51:36.975277 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:36.975300 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:36.980766 327960 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
I1122 02:51:32.944974 327113 out.go:252] - Generating certificates and keys ...
I1122 02:51:32.945087 327113 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:51:32.945183 327113 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:51:33.463695 327113 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:51:33.654473 327113 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:51:34.283220 327113 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:51:34.658725 327113 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:51:34.991210 327113 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:51:34.991380 327113 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.348113 327113 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:51:35.348291 327113 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.729080 327113 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:51:35.838398 327113 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:51:36.135928 327113 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:51:36.136205 327113 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:51:36.489488 327113 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:51:36.746954 327113 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:51:37.381597 327113 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:51:37.828548 327113 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:51:38.113827 327113 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:51:38.114496 327113 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:51:38.119336 327113 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:51:34.042619 331164 out.go:252] * Restarting existing docker container for "default-k8s-diff-port-714134" ...
I1122 02:51:34.042686 331164 cli_runner.go:164] Run: docker start default-k8s-diff-port-714134
I1122 02:51:34.328691 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.350055 331164 kic.go:430] container "default-k8s-diff-port-714134" state is running.
I1122 02:51:34.350463 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:34.372170 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.372397 331164 machine.go:94] provisionDockerMachine start ...
I1122 02:51:34.372468 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:34.394122 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:34.394363 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:34.394379 331164 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:34.395096 331164 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34084->127.0.0.1:33128: read: connection reset by peer
I1122 02:51:37.540642 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.540728 331164 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-714134"
I1122 02:51:37.540882 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.566239 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.566544 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.566566 331164 main.go:143] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-714134 && echo "default-k8s-diff-port-714134" | sudo tee /etc/hostname
I1122 02:51:37.716876 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.716974 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.736603 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.736881 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.736922 331164 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-714134' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-714134/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-714134' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:37.875013 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:37.875043 331164 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:37.875074 331164 ubuntu.go:190] setting up certificates
I1122 02:51:37.875088 331164 provision.go:84] configureAuth start
I1122 02:51:37.875151 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:37.894002 331164 provision.go:143] copyHostCerts
I1122 02:51:37.894074 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:37.894094 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:37.894175 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:37.894311 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:37.894326 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:37.894371 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:37.894468 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:37.894487 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:37.894536 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:37.894625 331164 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-714134 san=[127.0.0.1 192.168.94.2 default-k8s-diff-port-714134 localhost minikube]
I1122 02:51:38.230740 331164 provision.go:177] copyRemoteCerts
I1122 02:51:38.230805 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:38.230849 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.249368 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.344588 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1122 02:51:38.361871 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:38.378711 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:38.395414 331164 provision.go:87] duration metric: took 520.309788ms to configureAuth
I1122 02:51:38.395438 331164 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:38.395615 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:38.395716 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.412782 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:38.413035 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:38.413054 331164 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:38.753526 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:38.753556 331164 machine.go:97] duration metric: took 4.381140927s to provisionDockerMachine
I1122 02:51:38.753571 331164 start.go:293] postStartSetup for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:51:38.753584 331164 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:38.753654 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:38.753704 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.774405 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.868582 331164 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:38.871897 331164 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:38.871961 331164 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:38.871973 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:38.872020 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:38.872087 331164 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:38.872531 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:38.881103 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:38.897768 331164 start.go:296] duration metric: took 144.184538ms for postStartSetup
I1122 02:51:38.897838 331164 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:38.897885 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.918344 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.010096 331164 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:39.014852 331164 fix.go:56] duration metric: took 4.991072115s for fixHost
I1122 02:51:39.014877 331164 start.go:83] releasing machines lock for "default-k8s-diff-port-714134", held for 4.991117201s
I1122 02:51:39.014966 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:39.033303 331164 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:39.033326 331164 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:39.033342 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.033395 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.050441 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.050812 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.212840 331164 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:39.219292 331164 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:39.263559 331164 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:39.270708 331164 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:39.270787 331164 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:39.279711 331164 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:39.279732 331164 start.go:496] detecting cgroup driver to use...
I1122 02:51:39.279768 331164 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:39.279817 331164 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:39.293134 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:39.304848 331164 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:39.304886 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:39.318093 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:39.329420 331164 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:39.417688 331164 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:39.499488 331164 docker.go:234] disabling docker service ...
I1122 02:51:39.499540 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:39.514311 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:39.525537 331164 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:39.608234 331164 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:39.684819 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:39.698122 331164 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:39.715088 331164 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:39.715149 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.724344 331164 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:39.724404 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.733704 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.743549 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.754797 331164 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:39.768466 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.785172 331164 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.798984 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.815655 331164 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:39.826134 331164 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:39.834804 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:39.928023 331164 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:40.072992 331164 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:40.073057 331164 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:40.076854 331164 start.go:564] Will wait 60s for crictl version
I1122 02:51:40.076922 331164 ssh_runner.go:195] Run: which crictl
I1122 02:51:40.080523 331164 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:40.106629 331164 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:40.106701 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.134559 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.165236 331164 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:36.981657 327960 addons.go:530] duration metric: took 2.099497416s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:51:37.469048 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.474530 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:37.474599 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:37.968988 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.973175 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1122 02:51:37.974331 327960 api_server.go:141] control plane version: v1.34.1
I1122 02:51:37.974362 327960 api_server.go:131] duration metric: took 1.005503785s to wait for apiserver health ...
I1122 02:51:37.974373 327960 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:37.978271 327960 system_pods.go:59] 8 kube-system pods found
I1122 02:51:37.978304 327960 system_pods.go:61] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.978314 327960 system_pods.go:61] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.978326 327960 system_pods.go:61] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.978513 327960 system_pods.go:61] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.978530 327960 system_pods.go:61] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.978539 327960 system_pods.go:61] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.978549 327960 system_pods.go:61] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.978557 327960 system_pods.go:61] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.978565 327960 system_pods.go:74] duration metric: took 4.183329ms to wait for pod list to return data ...
I1122 02:51:37.978577 327960 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:37.981059 327960 default_sa.go:45] found service account: "default"
I1122 02:51:37.981081 327960 default_sa.go:55] duration metric: took 2.496462ms for default service account to be created ...
I1122 02:51:37.981092 327960 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:37.984066 327960 system_pods.go:86] 8 kube-system pods found
I1122 02:51:37.984095 327960 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.984107 327960 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.984117 327960 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.984126 327960 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.984134 327960 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.984144 327960 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.984157 327960 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.984166 327960 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.984176 327960 system_pods.go:126] duration metric: took 3.078342ms to wait for k8s-apps to be running ...
I1122 02:51:37.984185 327960 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:37.984220 327960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:37.997569 327960 system_svc.go:56] duration metric: took 13.37647ms WaitForService to wait for kubelet
I1122 02:51:37.997591 327960 kubeadm.go:587] duration metric: took 3.115464866s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:37.997610 327960 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:38.000283 327960 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:38.000311 327960 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:38.000324 327960 node_conditions.go:105] duration metric: took 2.707917ms to run NodePressure ...
I1122 02:51:38.000338 327960 start.go:242] waiting for startup goroutines ...
I1122 02:51:38.000348 327960 start.go:247] waiting for cluster config update ...
I1122 02:51:38.000365 327960 start.go:256] writing updated cluster config ...
I1122 02:51:38.000631 327960 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:38.004168 327960 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:38.007292 327960 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:51:40.013015 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:40.166556 331164 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:40.185778 331164 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:51:40.189793 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.200293 331164 kubeadm.go:884] updating cluster {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT
ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:40.200431 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:40.200486 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.239242 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.239264 331164 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:40.239319 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.267336 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.267354 331164 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:40.267361 331164 kubeadm.go:935] updating node { 192.168.94.2 8444 v1.34.1 crio true true} ...
I1122 02:51:40.267451 331164 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-714134 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:40.267510 331164 ssh_runner.go:195] Run: crio config
I1122 02:51:40.318652 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:40.318673 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:40.318710 331164 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:40.318732 331164 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8444 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-714134 NodeName:default-k8s-diff-port-714134 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:40.318849 331164 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-714134"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:40.318936 331164 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:40.326997 331164 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:40.327054 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:40.334920 331164 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
I1122 02:51:40.349662 331164 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:40.365416 331164 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
I1122 02:51:40.384621 331164 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:40.389758 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.404895 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:40.503365 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:40.535438 331164 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134 for IP: 192.168.94.2
I1122 02:51:40.535459 331164 certs.go:195] generating shared ca certs ...
I1122 02:51:40.535476 331164 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:40.535643 331164 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:40.535708 331164 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:40.535725 331164 certs.go:257] generating profile certs ...
I1122 02:51:40.535839 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key
I1122 02:51:40.535930 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0
I1122 02:51:40.535996 331164 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key
I1122 02:51:40.536125 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:40.536166 331164 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:40.536181 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:40.536213 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:40.536250 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:40.536281 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:40.536336 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:40.537005 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:40.556550 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:40.576988 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:40.595219 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:40.622479 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I1122 02:51:40.645160 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:40.664363 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:40.681995 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:40.701586 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:40.723799 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:40.742435 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:40.761869 331164 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:40.773956 331164 ssh_runner.go:195] Run: openssl version
I1122 02:51:40.779823 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:40.787771 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791306 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791357 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:40.828463 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:40.836647 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:40.846093 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850356 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850395 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.889185 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:40.897675 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:40.906531 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910170 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910217 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:40.968186 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:40.979463 331164 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:40.985694 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:41.046839 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:41.108795 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:41.170881 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:41.242292 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:41.306878 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:41.400984 331164 kubeadm.go:401] StartCluster: {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:41.401089 331164 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:41.401156 331164 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:41.468811 331164 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:51:41.468892 331164 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:51:41.468928 331164 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:51:41.468957 331164 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:51:41.468972 331164 cri.go:89] found id: ""
I1122 02:51:41.469060 331164 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:41.494570 331164 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:41Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:41.494642 331164 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:41.507835 331164 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:41.507929 331164 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:41.507992 331164 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:41.531866 331164 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:41.533234 331164 kubeconfig.go:47] verify endpoint returned: get endpoint: "default-k8s-diff-port-714134" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.534277 331164 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "default-k8s-diff-port-714134" cluster setting kubeconfig missing "default-k8s-diff-port-714134" context setting]
I1122 02:51:41.535566 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.538207 331164 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:41.551210 331164 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.94.2
I1122 02:51:41.551236 331164 kubeadm.go:602] duration metric: took 43.297745ms to restartPrimaryControlPlane
I1122 02:51:41.551246 331164 kubeadm.go:403] duration metric: took 150.272079ms to StartCluster
I1122 02:51:41.551261 331164 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.551310 331164 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.553345 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.553565 331164 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:41.554035 331164 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:41.554123 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:41.554163 331164 addons.go:70] Setting storage-provisioner=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554173 331164 addons.go:70] Setting dashboard=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554183 331164 addons.go:239] Setting addon storage-provisioner=true in "default-k8s-diff-port-714134"
I1122 02:51:41.554199 331164 addons.go:70] Setting default-storageclass=true in profile "default-k8s-diff-port-714134"
W1122 02:51:41.554203 331164 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:41.554218 331164 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-714134"
I1122 02:51:41.554234 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.554519 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554187 331164 addons.go:239] Setting addon dashboard=true in "default-k8s-diff-port-714134"
W1122 02:51:41.554698 331164 addons.go:248] addon dashboard should already be in state true
I1122 02:51:41.554717 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554725 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.555180 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.556766 331164 out.go:179] * Verifying Kubernetes components...
I1122 02:51:41.561428 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:41.588610 331164 addons.go:239] Setting addon default-storageclass=true in "default-k8s-diff-port-714134"
W1122 02:51:41.590403 331164 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:41.590469 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.591052 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.592886 331164 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:41.592967 331164 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:41.594059 331164 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.594079 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:41.594195 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.595187 331164 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:38.120630 327113 out.go:252] - Booting up control plane ...
I1122 02:51:38.120796 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:51:38.120926 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:51:38.121614 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:51:38.134669 327113 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:51:38.134802 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:51:38.141938 327113 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:51:38.142274 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:51:38.142332 327113 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:51:38.253726 327113 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:51:38.253914 327113 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:51:39.755611 327113 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.501826871s
I1122 02:51:39.759624 327113 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:51:39.759764 327113 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.85.2:8443/livez
I1122 02:51:39.760175 327113 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:51:39.760561 327113 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:51:41.560999 327113 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 1.797435952s
I1122 02:51:41.598029 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:41.598070 331164 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:41.598119 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.630170 331164 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.630280 331164 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:41.630392 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.644561 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.648021 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.670326 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.784765 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:41.818289 331164 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:41.820889 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.823013 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.829399 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:41.829418 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:41.871182 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:41.871292 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:41.908781 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:41.908824 331164 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:41.961331 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:41.961355 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:41.996454 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:41.996486 331164 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:42.022318 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:42.022341 331164 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:42.044132 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:42.044171 331164 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:42.068895 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:42.068931 331164 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:42.094902 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:42.095167 331164 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:42.115750 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:43.273067 331164 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:43.273107 331164 node_ready.go:38] duration metric: took 1.454695177s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:43.273127 331164 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:43.273189 331164 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:43.346488 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.52555272s)
I1122 02:51:43.982658 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.159583631s)
I1122 02:51:43.982798 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.86700228s)
I1122 02:51:43.982886 331164 api_server.go:72] duration metric: took 2.42929171s to wait for apiserver process to appear ...
I1122 02:51:43.982964 331164 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:43.982996 331164 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:43.987024 331164 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p default-k8s-diff-port-714134 addons enable metrics-server
I1122 02:51:43.988326 331164 out.go:179] * Enabled addons: default-storageclass, storage-provisioner, dashboard
I1122 02:51:43.021138 327113 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 3.26139895s
I1122 02:51:44.761232 327113 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 5.001296243s
I1122 02:51:44.772246 327113 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:51:44.781163 327113 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:51:44.789615 327113 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:51:44.789898 327113 kubeadm.go:319] [mark-control-plane] Marking the node newest-cni-021912 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:51:44.798008 327113 kubeadm.go:319] [bootstrap-token] Using token: omniu2.5k9g6ns41l8h6qyz
I1122 02:51:44.799648 327113 out.go:252] - Configuring RBAC rules ...
I1122 02:51:44.799822 327113 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:51:44.802932 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:51:44.807795 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:51:44.810078 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:51:44.813275 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:51:44.816877 327113 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:51:45.169660 327113 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:51:45.583174 327113 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:51:46.167427 327113 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:51:46.168639 327113 kubeadm.go:319]
I1122 02:51:46.168738 327113 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:51:46.168750 327113 kubeadm.go:319]
I1122 02:51:46.168867 327113 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:51:46.168877 327113 kubeadm.go:319]
I1122 02:51:46.168941 327113 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:51:46.169023 327113 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:51:46.169093 327113 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:51:46.169103 327113 kubeadm.go:319]
I1122 02:51:46.169173 327113 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:51:46.169182 327113 kubeadm.go:319]
I1122 02:51:46.169243 327113 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:51:46.169253 327113 kubeadm.go:319]
I1122 02:51:46.169357 327113 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:51:46.169469 327113 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:51:46.169570 327113 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:51:46.169577 327113 kubeadm.go:319]
I1122 02:51:46.169728 327113 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:51:46.169845 327113 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:51:46.169856 327113 kubeadm.go:319]
I1122 02:51:46.169995 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170166 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:51:46.170206 327113 kubeadm.go:319] --control-plane
I1122 02:51:46.170230 327113 kubeadm.go:319]
I1122 02:51:46.170357 327113 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:51:46.170369 327113 kubeadm.go:319]
I1122 02:51:46.170482 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170623 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:51:46.173803 327113 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:51:46.174024 327113 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:51:46.174052 327113 cni.go:84] Creating CNI manager for ""
I1122 02:51:46.174061 327113 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:46.176516 327113 out.go:179] * Configuring CNI (Container Networking Interface) ...
W1122 02:51:42.018105 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:51:44.513440 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:46.177605 327113 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:51:46.182770 327113 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:51:46.182789 327113 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:51:46.198648 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:51:46.480371 327113 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:51:46.480473 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:46.480545 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes newest-cni-021912 minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=newest-cni-021912 minikube.k8s.io/primary=true
I1122 02:51:46.492989 327113 ops.go:34] apiserver oom_adj: -16
I1122 02:51:46.593992 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:47.094019 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
==> CRI-O <==
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.611271983Z" level=info msg="Created container c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper" id=ec6a481f-80fb-4cdf-97fa-458c6226e8be name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.61182812Z" level=info msg="Starting container: c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85" id=4446f0e5-54b8-4f32-92e6-6978b08c9282 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.614224458Z" level=info msg="Started container" PID=1712 containerID=c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper id=4446f0e5-54b8-4f32-92e6-6978b08c9282 name=/runtime.v1.RuntimeService/StartContainer sandboxID=b6e375da019d8c18300875222d891fb30c7b69f6f7b88fdb63c84e17ccd9403e
Nov 22 02:51:30 no-preload-346270 crio[566]: time="2025-11-22T02:51:30.573647312Z" level=info msg="Removing container: 9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879" id=cd20415c-5929-4d58-af77-4b50e6e177dc name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:30 no-preload-346270 crio[566]: time="2025-11-22T02:51:30.585047483Z" level=info msg="Removed container 9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper" id=cd20415c-5929-4d58-af77-4b50e6e177dc name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.466147985Z" level=info msg="Pulled image: docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029" id=862dcc38-f158-437c-9a32-88f3eb01d85d name=/runtime.v1.ImageService/PullImage
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.466961027Z" level=info msg="Checking image status: docker.io/kubernetesui/dashboard:v2.7.0@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" id=d53ed89d-8ed3-47d2-8102-a0a070772ce4 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.469050458Z" level=info msg="Checking image status: docker.io/kubernetesui/dashboard:v2.7.0@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" id=92fc294e-40f2-4bbd-bd56-3aaf157f1f45 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.472860835Z" level=info msg="Creating container: kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard" id=6b02ce96-a488-47a8-964b-13175199a81e name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.473024321Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478371511Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478566644Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/c10e20b2164a7b111612e530aa158e66a49c74fb80a1ec7fd7050cbeb1a22f2d/merged/etc/group: no such file or directory"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478925976Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.496157825Z" level=info msg="Created container 70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa: kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard" id=6b02ce96-a488-47a8-964b-13175199a81e name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.496680818Z" level=info msg="Starting container: 70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa" id=6366f030-e6aa-42f7-a90e-94245bce39f5 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.498490281Z" level=info msg="Started container" PID=1752 containerID=70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa description=kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard id=6366f030-e6aa-42f7-a90e-94245bce39f5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=311e4dbd4659c9ac3c86fe8e7ab0ef01a05c748069720f85a7d3a76ea976cfa3
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.623417783Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=a78acbdc-4af6-420c-a66f-648b1843f84c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.624435293Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=4d09495d-3988-49b2-a87c-f95561379458 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.625657493Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=761cf0a8-4192-45c9-a613-e429a2efa1e7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.625766338Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630050146Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630220326Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/45ddab7cfa07e7edf288139db2e9e17f76a6ed8e88ddb5f6e986e992ad24e1d3/merged/etc/passwd: no such file or directory"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630245503Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/45ddab7cfa07e7edf288139db2e9e17f76a6ed8e88ddb5f6e986e992ad24e1d3/merged/etc/group: no such file or directory"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630446495Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.705761052Z" level=info msg="CreateCtr: context was either canceled or the deadline was exceeded: context canceled" id=761cf0a8-4192-45c9-a613-e429a2efa1e7 name=/runtime.v1.RuntimeService/CreateContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
70cb5fad3a68e docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 14 seconds ago Running kubernetes-dashboard 0 311e4dbd4659c kubernetes-dashboard-855c9754f9-h2f2w kubernetes-dashboard
c38891ca75de2 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 18 seconds ago Exited dashboard-metrics-scraper 1 b6e375da019d8 dashboard-metrics-scraper-6ffb444bf9-9727m kubernetes-dashboard
6f3a9abdd01af 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 29 seconds ago Running busybox 1 cda05a24c8e3a busybox default
c9c7339c17947 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 29 seconds ago Running coredns 0 ce60e0f25fb90 coredns-66bc5c9577-6tsqs kube-system
29d9eeb45ea5d fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 33 seconds ago Running kube-proxy 0 1a087b8754507 kube-proxy-lpft6 kube-system
f9bac6a5b7121 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 33 seconds ago Running kindnet-cni 0 bd140c716f028 kindnet-8r9j8 kube-system
10b82e028f448 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 33 seconds ago Exited storage-provisioner 0 99bcfb016ed53 storage-provisioner kube-system
dd4a333886960 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 36 seconds ago Running kube-controller-manager 0 42bd702fee1b3 kube-controller-manager-no-preload-346270 kube-system
46c1cb6849739 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 36 seconds ago Running kube-apiserver 0 c21033ffc5757 kube-apiserver-no-preload-346270 kube-system
1361889d7d62e 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 36 seconds ago Running etcd 0 d9c0769bc7b66 etcd-no-preload-346270 kube-system
4f664442dad51 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 36 seconds ago Running kube-scheduler 0 687593ee3c672 kube-scheduler-no-preload-346270 kube-system
==> coredns [c9c7339c17947a0fd12c23bd778cf8477baf7d7022c6b20e8c04148e7509eb5e] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 66f0a748f44f6317a6b122af3f457c9dd0ecaed8718ffbf95a69434523efd9ec4992e71f54c7edd5753646fe9af89ac2138b9c3ce14d4a0ba9d2372a55f120bb
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:38571 - 17922 "HINFO IN 3451011737149478271.6560173198976961452. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.558887975s
==> describe nodes <==
Name: no-preload-346270
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=no-preload-346270
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=no-preload-346270
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_14_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:11 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: no-preload-346270
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:44 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:51:24 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.103.2
Hostname: no-preload-346270
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: af672df9-348e-4762-9b18-ecdbaf28da25
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 73s
kube-system coredns-66bc5c9577-6tsqs 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 89s
kube-system etcd-no-preload-346270 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 94s
kube-system kindnet-8r9j8 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 89s
kube-system kube-apiserver-no-preload-346270 250m (3%) 0 (0%) 0 (0%) 0 (0%) 94s
kube-system kube-controller-manager-no-preload-346270 200m (2%) 0 (0%) 0 (0%) 0 (0%) 94s
kube-system kube-proxy-lpft6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system kube-scheduler-no-preload-346270 100m (1%) 0 (0%) 0 (0%) 0 (0%) 94s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 88s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-9727m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 31s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-h2f2w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 31s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 88s kube-proxy
Normal Starting 33s kube-proxy
Normal Starting 95s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 94s kubelet Node no-preload-346270 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 94s kubelet Node no-preload-346270 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 94s kubelet Node no-preload-346270 status is now: NodeHasSufficientPID
Normal RegisteredNode 90s node-controller Node no-preload-346270 event: Registered Node no-preload-346270 in Controller
Normal NodeReady 75s kubelet Node no-preload-346270 status is now: NodeReady
Normal Starting 37s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 37s (x8 over 37s) kubelet Node no-preload-346270 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 37s (x8 over 37s) kubelet Node no-preload-346270 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 37s (x8 over 37s) kubelet Node no-preload-346270 status is now: NodeHasSufficientPID
Normal RegisteredNode 31s node-controller Node no-preload-346270 event: Registered Node no-preload-346270 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c] <==
{"level":"warn","ts":"2025-11-22T02:51:13.040312Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35900","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.054205Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35940","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.061640Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35950","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.069759Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35962","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.078026Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35984","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.085977Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36014","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.092269Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36026","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.098317Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36050","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.104720Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36064","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.110634Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36078","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.126875Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36092","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.132876Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36112","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.139016Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36136","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.206328Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36150","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:24.371416Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"100.673089ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-66bc5c9577-6tsqs\" limit:1 ","response":"range_response_count:1 size:5757"}
{"level":"info","ts":"2025-11-22T02:51:24.371533Z","caller":"traceutil/trace.go:172","msg":"trace[1648513989] range","detail":"{range_begin:/registry/pods/kube-system/coredns-66bc5c9577-6tsqs; range_end:; response_count:1; response_revision:599; }","duration":"100.808939ms","start":"2025-11-22T02:51:24.270708Z","end":"2025-11-22T02:51:24.371517Z","steps":["trace[1648513989] 'agreement among raft nodes before linearized reading' (duration: 37.984552ms)","trace[1648513989] 'range keys from in-memory index tree' (duration: 62.575166ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:24.371466Z","caller":"traceutil/trace.go:172","msg":"trace[946781506] transaction","detail":"{read_only:false; response_revision:600; number_of_response:1; }","duration":"184.038429ms","start":"2025-11-22T02:51:24.187405Z","end":"2025-11-22T02:51:24.371443Z","steps":["trace[946781506] 'process raft request' (duration: 121.30702ms)","trace[946781506] 'compare' (duration: 62.617466ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:24.511227Z","caller":"traceutil/trace.go:172","msg":"trace[1771941874] transaction","detail":"{read_only:false; response_revision:602; number_of_response:1; }","duration":"127.542885ms","start":"2025-11-22T02:51:24.383665Z","end":"2025-11-22T02:51:24.511208Z","steps":["trace[1771941874] 'process raft request' (duration: 127.018312ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:51:24.917346Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"135.849048ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard\" limit:1 ","response":"range_response_count:1 size:957"}
{"level":"info","ts":"2025-11-22T02:51:24.917412Z","caller":"traceutil/trace.go:172","msg":"trace[1457512624] range","detail":"{range_begin:/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard; range_end:; response_count:1; response_revision:609; }","duration":"135.926368ms","start":"2025-11-22T02:51:24.781471Z","end":"2025-11-22T02:51:24.917398Z","steps":["trace[1457512624] 'range keys from in-memory index tree' (duration: 135.62898ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:51:25.193034Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"141.154716ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/no-preload-346270\" limit:1 ","response":"range_response_count:1 size:4876"}
{"level":"info","ts":"2025-11-22T02:51:25.193101Z","caller":"traceutil/trace.go:172","msg":"trace[988084431] range","detail":"{range_begin:/registry/minions/no-preload-346270; range_end:; response_count:1; response_revision:609; }","duration":"141.236972ms","start":"2025-11-22T02:51:25.051847Z","end":"2025-11-22T02:51:25.193084Z","steps":["trace[988084431] 'agreement among raft nodes before linearized reading' (duration: 74.825977ms)","trace[988084431] 'range keys from in-memory index tree' (duration: 66.197631ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:25.193165Z","caller":"traceutil/trace.go:172","msg":"trace[1712077879] transaction","detail":"{read_only:false; response_revision:610; number_of_response:1; }","duration":"142.869507ms","start":"2025-11-22T02:51:25.050276Z","end":"2025-11-22T02:51:25.193146Z","steps":["trace[1712077879] 'process raft request' (duration: 76.426776ms)","trace[1712077879] 'compare' (duration: 66.245841ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:51:25.472126Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"150.249551ms","expected-duration":"100ms","prefix":"","request":"header:<ID:13873790179762061558 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m.187a3475f0361438\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m.187a3475f0361438\" value_size:746 lease:4650418142907285499 >> failure:<>>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:51:25.472309Z","caller":"traceutil/trace.go:172","msg":"trace[1238311492] transaction","detail":"{read_only:false; response_revision:611; number_of_response:1; }","duration":"255.121258ms","start":"2025-11-22T02:51:25.217171Z","end":"2025-11-22T02:51:25.472293Z","steps":["trace[1238311492] 'process raft request' (duration: 104.250929ms)","trace[1238311492] 'compare' (duration: 150.13266ms)"],"step_count":2}
==> kernel <==
02:51:48 up 1:34, 0 user, load average: 5.75, 4.11, 2.39
Linux no-preload-346270 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [f9bac6a5b7121e33df35418702e434766200300826f6bc80d6d7cce1af9870f2] <==
I1122 02:51:15.087181 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:15.087452 1 main.go:139] hostIP = 192.168.103.2
podIP = 192.168.103.2
I1122 02:51:15.087576 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:15.087591 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:15.087610 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:15Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:15.289249 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:15.289339 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:15.289351 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:15.289504 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:51:15.490169 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:51:15.490199 1 metrics.go:72] Registering metrics
I1122 02:51:15.490291 1 controller.go:711] "Syncing nftables rules"
I1122 02:51:25.289839 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:25.289954 1 main.go:301] handling current node
I1122 02:51:35.290006 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:35.290043 1 main.go:301] handling current node
I1122 02:51:45.289440 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:45.289537 1 main.go:301] handling current node
==> kube-apiserver [46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127] <==
I1122 02:51:13.770843 1 cache.go:39] Caches are synced for RemoteAvailability controller
I1122 02:51:13.770985 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:51:13.771261 1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
I1122 02:51:13.771312 1 aggregator.go:171] initial CRD sync complete...
I1122 02:51:13.771325 1 autoregister_controller.go:144] Starting autoregister controller
I1122 02:51:13.771331 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:51:13.771338 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:51:13.771351 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:13.771432 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:13.771468 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:13.778357 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
I1122 02:51:13.804209 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:13.836311 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:14.022838 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:14.047185 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:14.062559 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:14.073357 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:14.079555 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:14.107673 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.104.51.166"}
I1122 02:51:14.116869 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.105.82.161"}
I1122 02:51:14.679279 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:17.097427 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:17.496254 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:51:17.597512 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:51:17.694994 1 controller.go:667] quota admission added evaluator for: endpoints
==> kube-controller-manager [dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9] <==
I1122 02:51:17.068058 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:51:17.084241 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 02:51:17.086734 1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
I1122 02:51:17.092473 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:51:17.092588 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:51:17.093076 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:51:17.093129 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:51:17.093191 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:51:17.093246 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:51:17.093350 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:17.093514 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:51:17.093568 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:17.095554 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:51:17.097779 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:17.100408 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:17.102533 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:51:17.105684 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:51:17.106889 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:51:17.112136 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:17.132298 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:51:17.138546 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:51:17.144484 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:17.144506 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:17.144520 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:51:27.062524 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [29d9eeb45ea5d45dddc97d4396e06f7162dc0002085d9ea51ef8f7c840edd886] <==
I1122 02:51:14.899478 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:14.954932 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:15.055220 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:15.055267 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.103.2"]
E1122 02:51:15.055353 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:15.072870 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:15.072963 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:15.077967 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:15.078323 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:15.078352 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:15.079733 1 config.go:200] "Starting service config controller"
I1122 02:51:15.079757 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:15.079763 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:15.079778 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:15.079804 1 config.go:309] "Starting node config controller"
I1122 02:51:15.079810 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:15.079857 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:15.080005 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:15.180762 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:15.180792 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:51:15.180863 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:15.180894 1 shared_informer.go:356] "Caches are synced" controller="service config"
==> kube-scheduler [4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32] <==
I1122 02:51:13.573685 1 serving.go:386] Generated self-signed cert in-memory
I1122 02:51:13.767666 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:13.767695 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:13.773642 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I1122 02:51:13.773925 1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
I1122 02:51:13.773869 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.774118 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.774162 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:13.773812 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.774276 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.774142 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:13.875022 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.875062 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.875071 1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
==> kubelet <==
Nov 22 02:51:15 no-preload-346270 kubelet[720]: E1122 02:51:15.224385 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8 podName:ac002b55-1114-4073-9f4b-aa618203638d nodeName:}" failed. No retries permitted until 2025-11-22 02:51:16.224352954 +0000 UTC m=+4.807355977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5stg8" (UniqueName: "kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8") pod "busybox" (UID: "ac002b55-1114-4073-9f4b-aa618203638d") : object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.129357 720 configmap.go:193] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.129469 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d8b5acd-6ff5-401d-b10b-b0215610f89f-config-volume podName:1d8b5acd-6ff5-401d-b10b-b0215610f89f nodeName:}" failed. No retries permitted until 2025-11-22 02:51:18.129447809 +0000 UTC m=+6.712450829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/1d8b5acd-6ff5-401d-b10b-b0215610f89f-config-volume") pod "coredns-66bc5c9577-6tsqs" (UID: "1d8b5acd-6ff5-401d-b10b-b0215610f89f") : object "kube-system"/"coredns" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.229863 720 projected.go:291] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.229897 720 projected.go:196] Error preparing data for projected volume kube-api-access-5stg8 for pod default/busybox: object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.230023 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8 podName:ac002b55-1114-4073-9f4b-aa618203638d nodeName:}" failed. No retries permitted until 2025-11-22 02:51:18.230000009 +0000 UTC m=+6.813003028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5stg8" (UniqueName: "kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8") pod "busybox" (UID: "ac002b55-1114-4073-9f4b-aa618203638d") : object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:21 no-preload-346270 kubelet[720]: I1122 02:51:21.054885 720 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.678603 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec27387-5a7f-4691-9ef9-7081e676846c-tmp-volume\") pod \"kubernetes-dashboard-855c9754f9-h2f2w\" (UID: \"4ec27387-5a7f-4691-9ef9-7081e676846c\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.678663 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfzm5\" (UniqueName: \"kubernetes.io/projected/4ec27387-5a7f-4691-9ef9-7081e676846c-kube-api-access-cfzm5\") pod \"kubernetes-dashboard-855c9754f9-h2f2w\" (UID: \"4ec27387-5a7f-4691-9ef9-7081e676846c\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.779158 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/f741125d-c9f4-495e-bf40-8f1c9228a97e-tmp-volume\") pod \"dashboard-metrics-scraper-6ffb444bf9-9727m\" (UID: \"f741125d-c9f4-495e-bf40-8f1c9228a97e\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.779219 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl44c\" (UniqueName: \"kubernetes.io/projected/f741125d-c9f4-495e-bf40-8f1c9228a97e-kube-api-access-cl44c\") pod \"dashboard-metrics-scraper-6ffb444bf9-9727m\" (UID: \"f741125d-c9f4-495e-bf40-8f1c9228a97e\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m"
Nov 22 02:51:29 no-preload-346270 kubelet[720]: I1122 02:51:29.566321 720 scope.go:117] "RemoveContainer" containerID="9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: I1122 02:51:30.571990 720 scope.go:117] "RemoveContainer" containerID="9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: I1122 02:51:30.572126 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: E1122 02:51:30.572311 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:31 no-preload-346270 kubelet[720]: I1122 02:51:31.576756 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:31 no-preload-346270 kubelet[720]: E1122 02:51:31.577432 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:34 no-preload-346270 kubelet[720]: I1122 02:51:34.964994 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:34 no-preload-346270 kubelet[720]: E1122 02:51:34.966735 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:45 no-preload-346270 kubelet[720]: I1122 02:51:45.623026 720 scope.go:117] "RemoveContainer" containerID="10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6"
Nov 22 02:51:45 no-preload-346270 kubelet[720]: I1122 02:51:45.634670 720 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w" podStartSLOduration=20.768973686 podStartE2EDuration="28.63464938s" podCreationTimestamp="2025-11-22 02:51:17 +0000 UTC" firstStartedPulling="2025-11-22 02:51:25.602713979 +0000 UTC m=+14.185716997" lastFinishedPulling="2025-11-22 02:51:33.468389674 +0000 UTC m=+22.051392691" observedRunningTime="2025-11-22 02:51:33.598867061 +0000 UTC m=+22.181870125" watchObservedRunningTime="2025-11-22 02:51:45.63464938 +0000 UTC m=+34.217652392"
Nov 22 02:51:45 no-preload-346270 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:51:45 no-preload-346270 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:51:45 no-preload-346270 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:51:45 no-preload-346270 systemd[1]: kubelet.service: Consumed 1.285s CPU time.
==> kubernetes-dashboard [70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa] <==
2025/11/22 02:51:33 Starting overwatch
2025/11/22 02:51:33 Using namespace: kubernetes-dashboard
2025/11/22 02:51:33 Using in-cluster config to connect to apiserver
2025/11/22 02:51:33 Using secret token for csrf signing
2025/11/22 02:51:33 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:33 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:33 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:33 Generating JWE encryption key
2025/11/22 02:51:33 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:33 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:33 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:33 Creating in-cluster Sidecar client
2025/11/22 02:51:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:33 Serving insecurely on HTTP port: 9090
==> storage-provisioner [10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6] <==
I1122 02:51:14.854511 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:51:44.859358 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-346270 -n no-preload-346270
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-346270 -n no-preload-346270: exit status 2 (347.758887ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context no-preload-346270 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/no-preload/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect no-preload-346270
helpers_test.go:243: (dbg) docker inspect no-preload-346270:
-- stdout --
[
{
"Id": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"Created": "2025-11-22T02:49:44.656554358Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 321688,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:05.560417745Z",
"FinishedAt": "2025-11-22T02:51:04.560200714Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hostname",
"HostsPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/hosts",
"LogPath": "/var/lib/docker/containers/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d/6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d-json.log",
"Name": "/no-preload-346270",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"no-preload-346270:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "no-preload-346270",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6c4d4f5318eed417535d36b7c4d3fc1ff57a1bfe5788f7cb2f24c5a0fb4dee8d",
"LowerDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/merged",
"UpperDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/diff",
"WorkDir": "/var/lib/docker/overlay2/22bba6c7d7f2cea22441c6b7cfdcd2cb99568645b322350baf29a2624aa04361/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "no-preload-346270",
"Source": "/var/lib/docker/volumes/no-preload-346270/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "no-preload-346270",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "no-preload-346270",
"name.minikube.sigs.k8s.io": "no-preload-346270",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "bc7e59878749156aee3e06e316ed490dfb58b6038f2d059859101125832b5169",
"SandboxKey": "/var/run/docker/netns/bc7e59878749",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33113"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33114"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33117"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33115"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33116"
}
]
},
"Networks": {
"no-preload-346270": {
"IPAMConfig": {
"IPv4Address": "192.168.103.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "b056c157b0938097ab83f43dd906bd8cb89754351bc1a446e56b63614f473353",
"EndpointID": "0fe4ab649a0f62cce7889ecd033cd708d10657737ae761da12484f8276a73207",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"MacAddress": "26:18:4b:14:ff:c6",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"no-preload-346270",
"6c4d4f5318ee"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270
E1122 02:51:49.509859 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270: exit status 2 (379.675374ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/no-preload/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/no-preload/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p no-preload-346270 logs -n 25: (1.191295273s)
helpers_test.go:260: TestStartStop/group/no-preload/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ ssh │ -p bridge-430524 sudo systemctl cat crio --no-pager │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:33
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:33.808120 331164 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:33.808429 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808440 331164 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:33.808447 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808699 331164 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:33.809239 331164 out.go:368] Setting JSON to false
I1122 02:51:33.810667 331164 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5637,"bootTime":1763774257,"procs":295,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:33.810733 331164 start.go:143] virtualization: kvm guest
I1122 02:51:33.817123 331164 out.go:179] * [default-k8s-diff-port-714134] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:33.818705 331164 notify.go:221] Checking for updates...
I1122 02:51:33.818743 331164 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:33.822389 331164 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:33.823661 331164 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:33.824783 331164 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:33.825764 331164 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:33.826754 331164 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:33.828520 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:33.829196 331164 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:33.857369 331164 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:33.857562 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.920077 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.910365077 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.920186 331164 docker.go:319] overlay module found
I1122 02:51:33.922011 331164 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:33.923075 331164 start.go:309] selected driver: docker
I1122 02:51:33.923090 331164 start.go:927] validating driver "docker" against &{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.923198 331164 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:33.923985 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.996972 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.986760851 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.997265 331164 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:33.997302 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.997351 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.997382 331164 start.go:353] cluster config:
{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.999198 331164 out.go:179] * Starting "default-k8s-diff-port-714134" primary control-plane node in "default-k8s-diff-port-714134" cluster
I1122 02:51:34.000156 331164 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:34.001284 331164 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:34.002331 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:34.002366 331164 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:34.002380 331164 cache.go:65] Caching tarball of preloaded images
I1122 02:51:34.002411 331164 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:34.002468 331164 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:34.002478 331164 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:34.002600 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.023601 331164 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:34.023621 331164 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:34.023641 331164 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:34.023666 331164 start.go:360] acquireMachinesLock for default-k8s-diff-port-714134: {Name:mk7e1a12e2fa8aced0c98248f29bf8f0364ff72a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:34.023746 331164 start.go:364] duration metric: took 44.96µs to acquireMachinesLock for "default-k8s-diff-port-714134"
I1122 02:51:34.023769 331164 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:34.023775 331164 fix.go:54] fixHost starting:
I1122 02:51:34.024069 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.041134 331164 fix.go:112] recreateIfNeeded on default-k8s-diff-port-714134: state=Stopped err=<nil>
W1122 02:51:34.041193 331164 fix.go:138] unexpected machine state, will restart: <nil>
I1122 02:51:33.703692 327960 cli_runner.go:164] Run: docker network inspect embed-certs-153115 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:33.722074 327960 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:51:33.725954 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.735738 327960 kubeadm.go:884] updating cluster {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:33.735890 327960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:33.735990 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.775864 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.775888 327960 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:33.775945 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.803499 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.803521 327960 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:33.803530 327960 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.34.1 crio true true} ...
I1122 02:51:33.803634 327960 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-153115 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:33.803708 327960 ssh_runner.go:195] Run: crio config
I1122 02:51:33.859877 327960 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.859923 327960 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.859948 327960 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:33.859982 327960 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-153115 NodeName:embed-certs-153115 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/et
c/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:33.860206 327960 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-153115"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:33.860275 327960 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:33.869804 327960 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:33.869931 327960 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:33.879000 327960 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:33.892987 327960 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:33.909568 327960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2214 bytes)
I1122 02:51:33.923811 327960 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:33.927547 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.937743 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.038162 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:34.064574 327960 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115 for IP: 192.168.76.2
I1122 02:51:34.064592 327960 certs.go:195] generating shared ca certs ...
I1122 02:51:34.064608 327960 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.064762 327960 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:34.064809 327960 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:34.064819 327960 certs.go:257] generating profile certs ...
I1122 02:51:34.064963 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/client.key
I1122 02:51:34.065021 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key.a2dcd911
I1122 02:51:34.065079 327960 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key
I1122 02:51:34.065209 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:34.065245 327960 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:34.065253 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:34.065282 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:34.065308 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:34.065334 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:34.065385 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:34.066195 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:34.087518 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:34.107591 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:34.127804 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:34.150798 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I1122 02:51:34.172965 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:34.200246 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:34.219605 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:51:34.237481 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:34.257690 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:34.276956 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:34.294622 327960 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:34.306511 327960 ssh_runner.go:195] Run: openssl version
I1122 02:51:34.312288 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:34.320109 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324197 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324278 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:34.367392 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:34.377010 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:34.387536 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.391975 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.392022 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.429653 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:34.438043 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:34.447315 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451034 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451086 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:34.491615 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:34.499711 327960 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:34.503423 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:34.541936 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:34.589295 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:34.648308 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:34.707752 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:34.760015 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:34.804463 327960 kubeadm.go:401] StartCluster: {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:34.804572 327960 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:34.804626 327960 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:34.837717 327960 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:51:34.837741 327960 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:51:34.837746 327960 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:51:34.837751 327960 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:51:34.837755 327960 cri.go:89] found id: ""
I1122 02:51:34.837797 327960 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:34.849976 327960 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:34Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:34.850037 327960 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:34.858633 327960 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:34.858646 327960 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:34.858702 327960 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:34.866840 327960 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:34.870118 327960 kubeconfig.go:47] verify endpoint returned: get endpoint: "embed-certs-153115" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.870434 327960 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "embed-certs-153115" cluster setting kubeconfig missing "embed-certs-153115" context setting]
I1122 02:51:34.871098 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.872766 327960 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:34.880234 327960 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.76.2
I1122 02:51:34.880263 327960 kubeadm.go:602] duration metric: took 21.610639ms to restartPrimaryControlPlane
I1122 02:51:34.880272 327960 kubeadm.go:403] duration metric: took 75.818579ms to StartCluster
I1122 02:51:34.880288 327960 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.880344 327960 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.881853 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.882098 327960 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:34.882167 327960 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:34.882274 327960 addons.go:70] Setting storage-provisioner=true in profile "embed-certs-153115"
I1122 02:51:34.882296 327960 addons.go:70] Setting dashboard=true in profile "embed-certs-153115"
I1122 02:51:34.882311 327960 addons.go:239] Setting addon storage-provisioner=true in "embed-certs-153115"
I1122 02:51:34.882316 327960 addons.go:239] Setting addon dashboard=true in "embed-certs-153115"
W1122 02:51:34.882319 327960 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:34.882318 327960 addons.go:70] Setting default-storageclass=true in profile "embed-certs-153115"
I1122 02:51:34.882327 327960 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:34.882347 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882352 327960 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-153115"
W1122 02:51:34.882325 327960 addons.go:248] addon dashboard should already be in state true
I1122 02:51:34.882443 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882675 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.882878 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.883057 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.884392 327960 out.go:179] * Verifying Kubernetes components...
I1122 02:51:34.886921 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.911466 327960 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:34.911523 327960 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:34.911898 327960 addons.go:239] Setting addon default-storageclass=true in "embed-certs-153115"
W1122 02:51:34.911934 327960 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:34.911961 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.912424 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.912938 327960 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:34.912957 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:34.913007 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.913995 327960 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:34.915941 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:34.915959 327960 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:34.916008 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.944068 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.947046 327960 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:34.947068 327960 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:34.947264 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.956178 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.973759 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:35.050045 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:35.066242 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:35.067551 327960 node_ready.go:35] waiting up to 6m0s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:35.080204 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:35.080225 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:35.089121 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:35.095997 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:35.096015 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:35.112983 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:35.113005 327960 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:35.129055 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:35.129078 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:35.144601 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:35.144620 327960 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:35.160289 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:35.160304 327960 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:35.175854 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:35.175876 327960 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:35.188348 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:35.188368 327960 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:35.200442 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:35.200459 327960 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:35.213676 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:36.450666 327960 node_ready.go:49] node "embed-certs-153115" is "Ready"
I1122 02:51:36.450712 327960 node_ready.go:38] duration metric: took 1.383125895s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:36.450729 327960 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:36.450786 327960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:36.968538 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.902260952s)
I1122 02:51:36.968607 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.879455326s)
I1122 02:51:36.968726 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.754999504s)
I1122 02:51:36.968787 327960 api_server.go:72] duration metric: took 2.086658227s to wait for apiserver process to appear ...
I1122 02:51:36.968849 327960 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:36.968872 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:36.970439 327960 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p embed-certs-153115 addons enable metrics-server
I1122 02:51:36.975277 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:36.975300 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:36.980766 327960 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
I1122 02:51:32.944974 327113 out.go:252] - Generating certificates and keys ...
I1122 02:51:32.945087 327113 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:51:32.945183 327113 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:51:33.463695 327113 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:51:33.654473 327113 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:51:34.283220 327113 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:51:34.658725 327113 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:51:34.991210 327113 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:51:34.991380 327113 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.348113 327113 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:51:35.348291 327113 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.729080 327113 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:51:35.838398 327113 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:51:36.135928 327113 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:51:36.136205 327113 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:51:36.489488 327113 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:51:36.746954 327113 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:51:37.381597 327113 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:51:37.828548 327113 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:51:38.113827 327113 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:51:38.114496 327113 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:51:38.119336 327113 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:51:34.042619 331164 out.go:252] * Restarting existing docker container for "default-k8s-diff-port-714134" ...
I1122 02:51:34.042686 331164 cli_runner.go:164] Run: docker start default-k8s-diff-port-714134
I1122 02:51:34.328691 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.350055 331164 kic.go:430] container "default-k8s-diff-port-714134" state is running.
I1122 02:51:34.350463 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:34.372170 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.372397 331164 machine.go:94] provisionDockerMachine start ...
I1122 02:51:34.372468 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:34.394122 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:34.394363 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:34.394379 331164 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:34.395096 331164 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34084->127.0.0.1:33128: read: connection reset by peer
I1122 02:51:37.540642 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.540728 331164 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-714134"
I1122 02:51:37.540882 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.566239 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.566544 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.566566 331164 main.go:143] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-714134 && echo "default-k8s-diff-port-714134" | sudo tee /etc/hostname
I1122 02:51:37.716876 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.716974 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.736603 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.736881 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.736922 331164 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-714134' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-714134/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-714134' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:37.875013 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:37.875043 331164 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:37.875074 331164 ubuntu.go:190] setting up certificates
I1122 02:51:37.875088 331164 provision.go:84] configureAuth start
I1122 02:51:37.875151 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:37.894002 331164 provision.go:143] copyHostCerts
I1122 02:51:37.894074 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:37.894094 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:37.894175 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:37.894311 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:37.894326 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:37.894371 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:37.894468 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:37.894487 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:37.894536 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:37.894625 331164 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-714134 san=[127.0.0.1 192.168.94.2 default-k8s-diff-port-714134 localhost minikube]
I1122 02:51:38.230740 331164 provision.go:177] copyRemoteCerts
I1122 02:51:38.230805 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:38.230849 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.249368 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.344588 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1122 02:51:38.361871 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:38.378711 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:38.395414 331164 provision.go:87] duration metric: took 520.309788ms to configureAuth
I1122 02:51:38.395438 331164 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:38.395615 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:38.395716 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.412782 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:38.413035 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:38.413054 331164 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:38.753526 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:38.753556 331164 machine.go:97] duration metric: took 4.381140927s to provisionDockerMachine
I1122 02:51:38.753571 331164 start.go:293] postStartSetup for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:51:38.753584 331164 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:38.753654 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:38.753704 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.774405 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.868582 331164 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:38.871897 331164 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:38.871961 331164 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:38.871973 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:38.872020 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:38.872087 331164 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:38.872531 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:38.881103 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:38.897768 331164 start.go:296] duration metric: took 144.184538ms for postStartSetup
I1122 02:51:38.897838 331164 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:38.897885 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.918344 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.010096 331164 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:39.014852 331164 fix.go:56] duration metric: took 4.991072115s for fixHost
I1122 02:51:39.014877 331164 start.go:83] releasing machines lock for "default-k8s-diff-port-714134", held for 4.991117201s
I1122 02:51:39.014966 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:39.033303 331164 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:39.033326 331164 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:39.033342 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.033395 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.050441 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.050812 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.212840 331164 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:39.219292 331164 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:39.263559 331164 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:39.270708 331164 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:39.270787 331164 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:39.279711 331164 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:39.279732 331164 start.go:496] detecting cgroup driver to use...
I1122 02:51:39.279768 331164 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:39.279817 331164 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:39.293134 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:39.304848 331164 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:39.304886 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:39.318093 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:39.329420 331164 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:39.417688 331164 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:39.499488 331164 docker.go:234] disabling docker service ...
I1122 02:51:39.499540 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:39.514311 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:39.525537 331164 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:39.608234 331164 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:39.684819 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:39.698122 331164 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:39.715088 331164 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:39.715149 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.724344 331164 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:39.724404 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.733704 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.743549 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.754797 331164 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:39.768466 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.785172 331164 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.798984 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.815655 331164 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:39.826134 331164 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:39.834804 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:39.928023 331164 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:40.072992 331164 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:40.073057 331164 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:40.076854 331164 start.go:564] Will wait 60s for crictl version
I1122 02:51:40.076922 331164 ssh_runner.go:195] Run: which crictl
I1122 02:51:40.080523 331164 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:40.106629 331164 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:40.106701 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.134559 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.165236 331164 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:36.981657 327960 addons.go:530] duration metric: took 2.099497416s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:51:37.469048 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.474530 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:37.474599 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:37.968988 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.973175 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1122 02:51:37.974331 327960 api_server.go:141] control plane version: v1.34.1
I1122 02:51:37.974362 327960 api_server.go:131] duration metric: took 1.005503785s to wait for apiserver health ...
I1122 02:51:37.974373 327960 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:37.978271 327960 system_pods.go:59] 8 kube-system pods found
I1122 02:51:37.978304 327960 system_pods.go:61] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.978314 327960 system_pods.go:61] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.978326 327960 system_pods.go:61] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.978513 327960 system_pods.go:61] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.978530 327960 system_pods.go:61] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.978539 327960 system_pods.go:61] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.978549 327960 system_pods.go:61] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.978557 327960 system_pods.go:61] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.978565 327960 system_pods.go:74] duration metric: took 4.183329ms to wait for pod list to return data ...
I1122 02:51:37.978577 327960 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:37.981059 327960 default_sa.go:45] found service account: "default"
I1122 02:51:37.981081 327960 default_sa.go:55] duration metric: took 2.496462ms for default service account to be created ...
I1122 02:51:37.981092 327960 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:37.984066 327960 system_pods.go:86] 8 kube-system pods found
I1122 02:51:37.984095 327960 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.984107 327960 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.984117 327960 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.984126 327960 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.984134 327960 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.984144 327960 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.984157 327960 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.984166 327960 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.984176 327960 system_pods.go:126] duration metric: took 3.078342ms to wait for k8s-apps to be running ...
I1122 02:51:37.984185 327960 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:37.984220 327960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:37.997569 327960 system_svc.go:56] duration metric: took 13.37647ms WaitForService to wait for kubelet
I1122 02:51:37.997591 327960 kubeadm.go:587] duration metric: took 3.115464866s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:37.997610 327960 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:38.000283 327960 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:38.000311 327960 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:38.000324 327960 node_conditions.go:105] duration metric: took 2.707917ms to run NodePressure ...
I1122 02:51:38.000338 327960 start.go:242] waiting for startup goroutines ...
I1122 02:51:38.000348 327960 start.go:247] waiting for cluster config update ...
I1122 02:51:38.000365 327960 start.go:256] writing updated cluster config ...
I1122 02:51:38.000631 327960 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:38.004168 327960 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:38.007292 327960 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:51:40.013015 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:40.166556 331164 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:40.185778 331164 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:51:40.189793 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.200293 331164 kubeadm.go:884] updating cluster {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT
ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:40.200431 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:40.200486 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.239242 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.239264 331164 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:40.239319 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.267336 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.267354 331164 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:40.267361 331164 kubeadm.go:935] updating node { 192.168.94.2 8444 v1.34.1 crio true true} ...
I1122 02:51:40.267451 331164 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-714134 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:40.267510 331164 ssh_runner.go:195] Run: crio config
I1122 02:51:40.318652 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:40.318673 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:40.318710 331164 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:40.318732 331164 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8444 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-714134 NodeName:default-k8s-diff-port-714134 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:40.318849 331164 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-714134"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:40.318936 331164 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:40.326997 331164 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:40.327054 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:40.334920 331164 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
I1122 02:51:40.349662 331164 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:40.365416 331164 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
I1122 02:51:40.384621 331164 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:40.389758 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.404895 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:40.503365 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:40.535438 331164 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134 for IP: 192.168.94.2
I1122 02:51:40.535459 331164 certs.go:195] generating shared ca certs ...
I1122 02:51:40.535476 331164 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:40.535643 331164 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:40.535708 331164 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:40.535725 331164 certs.go:257] generating profile certs ...
I1122 02:51:40.535839 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key
I1122 02:51:40.535930 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0
I1122 02:51:40.535996 331164 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key
I1122 02:51:40.536125 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:40.536166 331164 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:40.536181 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:40.536213 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:40.536250 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:40.536281 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:40.536336 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:40.537005 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:40.556550 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:40.576988 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:40.595219 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:40.622479 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I1122 02:51:40.645160 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:40.664363 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:40.681995 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:40.701586 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:40.723799 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:40.742435 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:40.761869 331164 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:40.773956 331164 ssh_runner.go:195] Run: openssl version
I1122 02:51:40.779823 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:40.787771 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791306 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791357 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:40.828463 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:40.836647 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:40.846093 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850356 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850395 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.889185 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:40.897675 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:40.906531 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910170 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910217 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:40.968186 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:40.979463 331164 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:40.985694 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:41.046839 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:41.108795 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:41.170881 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:41.242292 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:41.306878 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:41.400984 331164 kubeadm.go:401] StartCluster: {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:41.401089 331164 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:41.401156 331164 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:41.468811 331164 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:51:41.468892 331164 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:51:41.468928 331164 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:51:41.468957 331164 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:51:41.468972 331164 cri.go:89] found id: ""
I1122 02:51:41.469060 331164 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:41.494570 331164 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:41Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:41.494642 331164 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:41.507835 331164 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:41.507929 331164 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:41.507992 331164 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:41.531866 331164 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:41.533234 331164 kubeconfig.go:47] verify endpoint returned: get endpoint: "default-k8s-diff-port-714134" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.534277 331164 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "default-k8s-diff-port-714134" cluster setting kubeconfig missing "default-k8s-diff-port-714134" context setting]
I1122 02:51:41.535566 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.538207 331164 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:41.551210 331164 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.94.2
I1122 02:51:41.551236 331164 kubeadm.go:602] duration metric: took 43.297745ms to restartPrimaryControlPlane
I1122 02:51:41.551246 331164 kubeadm.go:403] duration metric: took 150.272079ms to StartCluster
I1122 02:51:41.551261 331164 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.551310 331164 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.553345 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.553565 331164 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:41.554035 331164 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:41.554123 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:41.554163 331164 addons.go:70] Setting storage-provisioner=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554173 331164 addons.go:70] Setting dashboard=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554183 331164 addons.go:239] Setting addon storage-provisioner=true in "default-k8s-diff-port-714134"
I1122 02:51:41.554199 331164 addons.go:70] Setting default-storageclass=true in profile "default-k8s-diff-port-714134"
W1122 02:51:41.554203 331164 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:41.554218 331164 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-714134"
I1122 02:51:41.554234 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.554519 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554187 331164 addons.go:239] Setting addon dashboard=true in "default-k8s-diff-port-714134"
W1122 02:51:41.554698 331164 addons.go:248] addon dashboard should already be in state true
I1122 02:51:41.554717 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554725 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.555180 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.556766 331164 out.go:179] * Verifying Kubernetes components...
I1122 02:51:41.561428 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:41.588610 331164 addons.go:239] Setting addon default-storageclass=true in "default-k8s-diff-port-714134"
W1122 02:51:41.590403 331164 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:41.590469 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.591052 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.592886 331164 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:41.592967 331164 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:41.594059 331164 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.594079 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:41.594195 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.595187 331164 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:38.120630 327113 out.go:252] - Booting up control plane ...
I1122 02:51:38.120796 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:51:38.120926 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:51:38.121614 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:51:38.134669 327113 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:51:38.134802 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:51:38.141938 327113 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:51:38.142274 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:51:38.142332 327113 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:51:38.253726 327113 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:51:38.253914 327113 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:51:39.755611 327113 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.501826871s
I1122 02:51:39.759624 327113 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:51:39.759764 327113 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.85.2:8443/livez
I1122 02:51:39.760175 327113 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:51:39.760561 327113 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:51:41.560999 327113 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 1.797435952s
I1122 02:51:41.598029 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:41.598070 331164 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:41.598119 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.630170 331164 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.630280 331164 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:41.630392 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.644561 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.648021 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.670326 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.784765 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:41.818289 331164 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:41.820889 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.823013 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.829399 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:41.829418 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:41.871182 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:41.871292 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:41.908781 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:41.908824 331164 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:41.961331 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:41.961355 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:41.996454 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:41.996486 331164 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:42.022318 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:42.022341 331164 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:42.044132 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:42.044171 331164 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:42.068895 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:42.068931 331164 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:42.094902 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:42.095167 331164 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:42.115750 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:43.273067 331164 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:43.273107 331164 node_ready.go:38] duration metric: took 1.454695177s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:43.273127 331164 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:43.273189 331164 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:43.346488 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.52555272s)
I1122 02:51:43.982658 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.159583631s)
I1122 02:51:43.982798 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.86700228s)
I1122 02:51:43.982886 331164 api_server.go:72] duration metric: took 2.42929171s to wait for apiserver process to appear ...
I1122 02:51:43.982964 331164 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:43.982996 331164 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:43.987024 331164 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p default-k8s-diff-port-714134 addons enable metrics-server
I1122 02:51:43.988326 331164 out.go:179] * Enabled addons: default-storageclass, storage-provisioner, dashboard
I1122 02:51:43.021138 327113 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 3.26139895s
I1122 02:51:44.761232 327113 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 5.001296243s
I1122 02:51:44.772246 327113 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:51:44.781163 327113 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:51:44.789615 327113 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:51:44.789898 327113 kubeadm.go:319] [mark-control-plane] Marking the node newest-cni-021912 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:51:44.798008 327113 kubeadm.go:319] [bootstrap-token] Using token: omniu2.5k9g6ns41l8h6qyz
I1122 02:51:44.799648 327113 out.go:252] - Configuring RBAC rules ...
I1122 02:51:44.799822 327113 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:51:44.802932 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:51:44.807795 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:51:44.810078 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:51:44.813275 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:51:44.816877 327113 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:51:45.169660 327113 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:51:45.583174 327113 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:51:46.167427 327113 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:51:46.168639 327113 kubeadm.go:319]
I1122 02:51:46.168738 327113 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:51:46.168750 327113 kubeadm.go:319]
I1122 02:51:46.168867 327113 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:51:46.168877 327113 kubeadm.go:319]
I1122 02:51:46.168941 327113 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:51:46.169023 327113 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:51:46.169093 327113 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:51:46.169103 327113 kubeadm.go:319]
I1122 02:51:46.169173 327113 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:51:46.169182 327113 kubeadm.go:319]
I1122 02:51:46.169243 327113 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:51:46.169253 327113 kubeadm.go:319]
I1122 02:51:46.169357 327113 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:51:46.169469 327113 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:51:46.169570 327113 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:51:46.169577 327113 kubeadm.go:319]
I1122 02:51:46.169728 327113 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:51:46.169845 327113 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:51:46.169856 327113 kubeadm.go:319]
I1122 02:51:46.169995 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170166 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:51:46.170206 327113 kubeadm.go:319] --control-plane
I1122 02:51:46.170230 327113 kubeadm.go:319]
I1122 02:51:46.170357 327113 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:51:46.170369 327113 kubeadm.go:319]
I1122 02:51:46.170482 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170623 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:51:46.173803 327113 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:51:46.174024 327113 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:51:46.174052 327113 cni.go:84] Creating CNI manager for ""
I1122 02:51:46.174061 327113 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:46.176516 327113 out.go:179] * Configuring CNI (Container Networking Interface) ...
W1122 02:51:42.018105 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:51:44.513440 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:46.177605 327113 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:51:46.182770 327113 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:51:46.182789 327113 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:51:46.198648 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:51:46.480371 327113 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:51:46.480473 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:46.480545 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes newest-cni-021912 minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=newest-cni-021912 minikube.k8s.io/primary=true
I1122 02:51:46.492989 327113 ops.go:34] apiserver oom_adj: -16
I1122 02:51:46.593992 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:47.094019 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:43.989687 331164 addons.go:530] duration metric: took 2.435653994s for enable addons: enabled=[default-storageclass storage-provisioner dashboard]
I1122 02:51:43.990390 331164 api_server.go:279] https://192.168.94.2:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:43.990452 331164 api_server.go:103] status: https://192.168.94.2:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:44.483998 331164 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:44.489144 331164 api_server.go:279] https://192.168.94.2:8444/healthz returned 200:
ok
I1122 02:51:44.490276 331164 api_server.go:141] control plane version: v1.34.1
I1122 02:51:44.490306 331164 api_server.go:131] duration metric: took 507.32508ms to wait for apiserver health ...
I1122 02:51:44.490318 331164 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:44.494073 331164 system_pods.go:59] 8 kube-system pods found
I1122 02:51:44.494108 331164 system_pods.go:61] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:44.494120 331164 system_pods.go:61] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:44.494137 331164 system_pods.go:61] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:44.494151 331164 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:44.494164 331164 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:44.494176 331164 system_pods.go:61] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:44.494186 331164 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:44.494198 331164 system_pods.go:61] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:44.494209 331164 system_pods.go:74] duration metric: took 3.882876ms to wait for pod list to return data ...
I1122 02:51:44.494223 331164 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:44.496628 331164 default_sa.go:45] found service account: "default"
I1122 02:51:44.496657 331164 default_sa.go:55] duration metric: took 2.415314ms for default service account to be created ...
I1122 02:51:44.496668 331164 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:44.499330 331164 system_pods.go:86] 8 kube-system pods found
I1122 02:51:44.499362 331164 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:44.499375 331164 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:44.499387 331164 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:44.499399 331164 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:44.499414 331164 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:44.499425 331164 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:44.499438 331164 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:44.499449 331164 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:44.499463 331164 system_pods.go:126] duration metric: took 2.788259ms to wait for k8s-apps to be running ...
I1122 02:51:44.499476 331164 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:44.499524 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:44.515318 331164 system_svc.go:56] duration metric: took 15.832544ms WaitForService to wait for kubelet
I1122 02:51:44.515365 331164 kubeadm.go:587] duration metric: took 2.961770959s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:44.515393 331164 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:44.518426 331164 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:44.518457 331164 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:44.518470 331164 node_conditions.go:105] duration metric: took 3.069886ms to run NodePressure ...
I1122 02:51:44.518484 331164 start.go:242] waiting for startup goroutines ...
I1122 02:51:44.518494 331164 start.go:247] waiting for cluster config update ...
I1122 02:51:44.518509 331164 start.go:256] writing updated cluster config ...
I1122 02:51:44.518781 331164 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:44.523092 331164 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:44.526920 331164 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:51:46.535376 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
==> CRI-O <==
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.611271983Z" level=info msg="Created container c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper" id=ec6a481f-80fb-4cdf-97fa-458c6226e8be name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.61182812Z" level=info msg="Starting container: c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85" id=4446f0e5-54b8-4f32-92e6-6978b08c9282 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:29 no-preload-346270 crio[566]: time="2025-11-22T02:51:29.614224458Z" level=info msg="Started container" PID=1712 containerID=c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper id=4446f0e5-54b8-4f32-92e6-6978b08c9282 name=/runtime.v1.RuntimeService/StartContainer sandboxID=b6e375da019d8c18300875222d891fb30c7b69f6f7b88fdb63c84e17ccd9403e
Nov 22 02:51:30 no-preload-346270 crio[566]: time="2025-11-22T02:51:30.573647312Z" level=info msg="Removing container: 9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879" id=cd20415c-5929-4d58-af77-4b50e6e177dc name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:30 no-preload-346270 crio[566]: time="2025-11-22T02:51:30.585047483Z" level=info msg="Removed container 9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m/dashboard-metrics-scraper" id=cd20415c-5929-4d58-af77-4b50e6e177dc name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.466147985Z" level=info msg="Pulled image: docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029" id=862dcc38-f158-437c-9a32-88f3eb01d85d name=/runtime.v1.ImageService/PullImage
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.466961027Z" level=info msg="Checking image status: docker.io/kubernetesui/dashboard:v2.7.0@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" id=d53ed89d-8ed3-47d2-8102-a0a070772ce4 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.469050458Z" level=info msg="Checking image status: docker.io/kubernetesui/dashboard:v2.7.0@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" id=92fc294e-40f2-4bbd-bd56-3aaf157f1f45 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.472860835Z" level=info msg="Creating container: kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard" id=6b02ce96-a488-47a8-964b-13175199a81e name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.473024321Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478371511Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478566644Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/c10e20b2164a7b111612e530aa158e66a49c74fb80a1ec7fd7050cbeb1a22f2d/merged/etc/group: no such file or directory"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.478925976Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.496157825Z" level=info msg="Created container 70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa: kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard" id=6b02ce96-a488-47a8-964b-13175199a81e name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.496680818Z" level=info msg="Starting container: 70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa" id=6366f030-e6aa-42f7-a90e-94245bce39f5 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:33 no-preload-346270 crio[566]: time="2025-11-22T02:51:33.498490281Z" level=info msg="Started container" PID=1752 containerID=70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa description=kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w/kubernetes-dashboard id=6366f030-e6aa-42f7-a90e-94245bce39f5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=311e4dbd4659c9ac3c86fe8e7ab0ef01a05c748069720f85a7d3a76ea976cfa3
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.623417783Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=a78acbdc-4af6-420c-a66f-648b1843f84c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.624435293Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=4d09495d-3988-49b2-a87c-f95561379458 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.625657493Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=761cf0a8-4192-45c9-a613-e429a2efa1e7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.625766338Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630050146Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630220326Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/45ddab7cfa07e7edf288139db2e9e17f76a6ed8e88ddb5f6e986e992ad24e1d3/merged/etc/passwd: no such file or directory"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630245503Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/45ddab7cfa07e7edf288139db2e9e17f76a6ed8e88ddb5f6e986e992ad24e1d3/merged/etc/group: no such file or directory"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.630446495Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:45 no-preload-346270 crio[566]: time="2025-11-22T02:51:45.705761052Z" level=info msg="CreateCtr: context was either canceled or the deadline was exceeded: context canceled" id=761cf0a8-4192-45c9-a613-e429a2efa1e7 name=/runtime.v1.RuntimeService/CreateContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
70cb5fad3a68e docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 16 seconds ago Running kubernetes-dashboard 0 311e4dbd4659c kubernetes-dashboard-855c9754f9-h2f2w kubernetes-dashboard
c38891ca75de2 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 20 seconds ago Exited dashboard-metrics-scraper 1 b6e375da019d8 dashboard-metrics-scraper-6ffb444bf9-9727m kubernetes-dashboard
6f3a9abdd01af 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 32 seconds ago Running busybox 1 cda05a24c8e3a busybox default
c9c7339c17947 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 32 seconds ago Running coredns 0 ce60e0f25fb90 coredns-66bc5c9577-6tsqs kube-system
29d9eeb45ea5d fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 35 seconds ago Running kube-proxy 0 1a087b8754507 kube-proxy-lpft6 kube-system
f9bac6a5b7121 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 35 seconds ago Running kindnet-cni 0 bd140c716f028 kindnet-8r9j8 kube-system
10b82e028f448 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 35 seconds ago Exited storage-provisioner 0 99bcfb016ed53 storage-provisioner kube-system
dd4a333886960 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 38 seconds ago Running kube-controller-manager 0 42bd702fee1b3 kube-controller-manager-no-preload-346270 kube-system
46c1cb6849739 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 38 seconds ago Running kube-apiserver 0 c21033ffc5757 kube-apiserver-no-preload-346270 kube-system
1361889d7d62e 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 38 seconds ago Running etcd 0 d9c0769bc7b66 etcd-no-preload-346270 kube-system
4f664442dad51 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 38 seconds ago Running kube-scheduler 0 687593ee3c672 kube-scheduler-no-preload-346270 kube-system
==> coredns [c9c7339c17947a0fd12c23bd778cf8477baf7d7022c6b20e8c04148e7509eb5e] <==
maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
.:53
[INFO] plugin/reload: Running configuration SHA512 = 66f0a748f44f6317a6b122af3f457c9dd0ecaed8718ffbf95a69434523efd9ec4992e71f54c7edd5753646fe9af89ac2138b9c3ce14d4a0ba9d2372a55f120bb
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:38571 - 17922 "HINFO IN 3451011737149478271.6560173198976961452. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.558887975s
==> describe nodes <==
Name: no-preload-346270
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=no-preload-346270
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=no-preload-346270
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_14_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:11 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: no-preload-346270
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:44 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:50:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:51:44 +0000 Sat, 22 Nov 2025 02:51:24 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.103.2
Hostname: no-preload-346270
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: af672df9-348e-4762-9b18-ecdbaf28da25
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 75s
kube-system coredns-66bc5c9577-6tsqs 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 91s
kube-system etcd-no-preload-346270 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 96s
kube-system kindnet-8r9j8 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 91s
kube-system kube-apiserver-no-preload-346270 250m (3%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system kube-controller-manager-no-preload-346270 200m (2%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system kube-proxy-lpft6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 91s
kube-system kube-scheduler-no-preload-346270 100m (1%) 0 (0%) 0 (0%) 0 (0%) 96s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 90s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-9727m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 33s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-h2f2w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 33s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 90s kube-proxy
Normal Starting 35s kube-proxy
Normal Starting 97s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 96s kubelet Node no-preload-346270 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 96s kubelet Node no-preload-346270 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 96s kubelet Node no-preload-346270 status is now: NodeHasSufficientPID
Normal RegisteredNode 92s node-controller Node no-preload-346270 event: Registered Node no-preload-346270 in Controller
Normal NodeReady 77s kubelet Node no-preload-346270 status is now: NodeReady
Normal Starting 39s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 39s (x8 over 39s) kubelet Node no-preload-346270 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 39s (x8 over 39s) kubelet Node no-preload-346270 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 39s (x8 over 39s) kubelet Node no-preload-346270 status is now: NodeHasSufficientPID
Normal RegisteredNode 33s node-controller Node no-preload-346270 event: Registered Node no-preload-346270 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [1361889d7d62ea3cd5f37a90a501d0b7e189a19c3e303317bd763cc4b6eeb46c] <==
{"level":"warn","ts":"2025-11-22T02:51:13.040312Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35900","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.054205Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35940","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.061640Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35950","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.069759Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35962","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.078026Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:35984","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.085977Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36014","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.092269Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36026","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.098317Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36050","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.104720Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36064","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.110634Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36078","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.126875Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36092","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.132876Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36112","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.139016Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36136","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:13.206328Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36150","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:24.371416Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"100.673089ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-66bc5c9577-6tsqs\" limit:1 ","response":"range_response_count:1 size:5757"}
{"level":"info","ts":"2025-11-22T02:51:24.371533Z","caller":"traceutil/trace.go:172","msg":"trace[1648513989] range","detail":"{range_begin:/registry/pods/kube-system/coredns-66bc5c9577-6tsqs; range_end:; response_count:1; response_revision:599; }","duration":"100.808939ms","start":"2025-11-22T02:51:24.270708Z","end":"2025-11-22T02:51:24.371517Z","steps":["trace[1648513989] 'agreement among raft nodes before linearized reading' (duration: 37.984552ms)","trace[1648513989] 'range keys from in-memory index tree' (duration: 62.575166ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:24.371466Z","caller":"traceutil/trace.go:172","msg":"trace[946781506] transaction","detail":"{read_only:false; response_revision:600; number_of_response:1; }","duration":"184.038429ms","start":"2025-11-22T02:51:24.187405Z","end":"2025-11-22T02:51:24.371443Z","steps":["trace[946781506] 'process raft request' (duration: 121.30702ms)","trace[946781506] 'compare' (duration: 62.617466ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:24.511227Z","caller":"traceutil/trace.go:172","msg":"trace[1771941874] transaction","detail":"{read_only:false; response_revision:602; number_of_response:1; }","duration":"127.542885ms","start":"2025-11-22T02:51:24.383665Z","end":"2025-11-22T02:51:24.511208Z","steps":["trace[1771941874] 'process raft request' (duration: 127.018312ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:51:24.917346Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"135.849048ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard\" limit:1 ","response":"range_response_count:1 size:957"}
{"level":"info","ts":"2025-11-22T02:51:24.917412Z","caller":"traceutil/trace.go:172","msg":"trace[1457512624] range","detail":"{range_begin:/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard; range_end:; response_count:1; response_revision:609; }","duration":"135.926368ms","start":"2025-11-22T02:51:24.781471Z","end":"2025-11-22T02:51:24.917398Z","steps":["trace[1457512624] 'range keys from in-memory index tree' (duration: 135.62898ms)"],"step_count":1}
{"level":"warn","ts":"2025-11-22T02:51:25.193034Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"141.154716ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/no-preload-346270\" limit:1 ","response":"range_response_count:1 size:4876"}
{"level":"info","ts":"2025-11-22T02:51:25.193101Z","caller":"traceutil/trace.go:172","msg":"trace[988084431] range","detail":"{range_begin:/registry/minions/no-preload-346270; range_end:; response_count:1; response_revision:609; }","duration":"141.236972ms","start":"2025-11-22T02:51:25.051847Z","end":"2025-11-22T02:51:25.193084Z","steps":["trace[988084431] 'agreement among raft nodes before linearized reading' (duration: 74.825977ms)","trace[988084431] 'range keys from in-memory index tree' (duration: 66.197631ms)"],"step_count":2}
{"level":"info","ts":"2025-11-22T02:51:25.193165Z","caller":"traceutil/trace.go:172","msg":"trace[1712077879] transaction","detail":"{read_only:false; response_revision:610; number_of_response:1; }","duration":"142.869507ms","start":"2025-11-22T02:51:25.050276Z","end":"2025-11-22T02:51:25.193146Z","steps":["trace[1712077879] 'process raft request' (duration: 76.426776ms)","trace[1712077879] 'compare' (duration: 66.245841ms)"],"step_count":2}
{"level":"warn","ts":"2025-11-22T02:51:25.472126Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"150.249551ms","expected-duration":"100ms","prefix":"","request":"header:<ID:13873790179762061558 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m.187a3475f0361438\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m.187a3475f0361438\" value_size:746 lease:4650418142907285499 >> failure:<>>","response":"size:16"}
{"level":"info","ts":"2025-11-22T02:51:25.472309Z","caller":"traceutil/trace.go:172","msg":"trace[1238311492] transaction","detail":"{read_only:false; response_revision:611; number_of_response:1; }","duration":"255.121258ms","start":"2025-11-22T02:51:25.217171Z","end":"2025-11-22T02:51:25.472293Z","steps":["trace[1238311492] 'process raft request' (duration: 104.250929ms)","trace[1238311492] 'compare' (duration: 150.13266ms)"],"step_count":2}
==> kernel <==
02:51:50 up 1:34, 0 user, load average: 6.01, 4.19, 2.42
Linux no-preload-346270 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [f9bac6a5b7121e33df35418702e434766200300826f6bc80d6d7cce1af9870f2] <==
I1122 02:51:15.087181 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:15.087452 1 main.go:139] hostIP = 192.168.103.2
podIP = 192.168.103.2
I1122 02:51:15.087576 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:15.087591 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:15.087610 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:15Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:15.289249 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:15.289339 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:15.289351 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:15.289504 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:51:15.490169 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:51:15.490199 1 metrics.go:72] Registering metrics
I1122 02:51:15.490291 1 controller.go:711] "Syncing nftables rules"
I1122 02:51:25.289839 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:25.289954 1 main.go:301] handling current node
I1122 02:51:35.290006 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:35.290043 1 main.go:301] handling current node
I1122 02:51:45.289440 1 main.go:297] Handling node with IPs: map[192.168.103.2:{}]
I1122 02:51:45.289537 1 main.go:301] handling current node
==> kube-apiserver [46c1cb68497391691a37b464aa1d0e7abc01ecf3ee56d148258afcf097ca6127] <==
I1122 02:51:13.770843 1 cache.go:39] Caches are synced for RemoteAvailability controller
I1122 02:51:13.770985 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:51:13.771261 1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
I1122 02:51:13.771312 1 aggregator.go:171] initial CRD sync complete...
I1122 02:51:13.771325 1 autoregister_controller.go:144] Starting autoregister controller
I1122 02:51:13.771331 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:51:13.771338 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:51:13.771351 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:13.771432 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:13.771468 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:13.778357 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
I1122 02:51:13.804209 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:13.836311 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:14.022838 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:14.047185 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:14.062559 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:14.073357 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:14.079555 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:14.107673 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.104.51.166"}
I1122 02:51:14.116869 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.105.82.161"}
I1122 02:51:14.679279 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:17.097427 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:17.496254 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:51:17.597512 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:51:17.694994 1 controller.go:667] quota admission added evaluator for: endpoints
==> kube-controller-manager [dd4a33388696080a8c1b03c8d3c289c23c326800b878600e2164e6c42b1c49c9] <==
I1122 02:51:17.068058 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:51:17.084241 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1122 02:51:17.086734 1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
I1122 02:51:17.092473 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:51:17.092588 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:51:17.093076 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:51:17.093129 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:51:17.093191 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:51:17.093246 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:51:17.093350 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:17.093514 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:51:17.093568 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:17.095554 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:51:17.097779 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:17.100408 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:17.102533 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:51:17.105684 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:51:17.106889 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:51:17.112136 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:17.132298 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:51:17.138546 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:51:17.144484 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:17.144506 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:17.144520 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:51:27.062524 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
==> kube-proxy [29d9eeb45ea5d45dddc97d4396e06f7162dc0002085d9ea51ef8f7c840edd886] <==
I1122 02:51:14.899478 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:14.954932 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:15.055220 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:15.055267 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.103.2"]
E1122 02:51:15.055353 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:15.072870 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:15.072963 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:15.077967 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:15.078323 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:15.078352 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:15.079733 1 config.go:200] "Starting service config controller"
I1122 02:51:15.079757 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:15.079763 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:15.079778 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:15.079804 1 config.go:309] "Starting node config controller"
I1122 02:51:15.079810 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:15.079857 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:15.080005 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:15.180762 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:15.180792 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:51:15.180863 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:15.180894 1 shared_informer.go:356] "Caches are synced" controller="service config"
==> kube-scheduler [4f664442dad5183f400a914ee239979eb48c4017ae14d3d8f6c7f70facb1bc32] <==
I1122 02:51:13.573685 1 serving.go:386] Generated self-signed cert in-memory
I1122 02:51:13.767666 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:13.767695 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:13.773642 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I1122 02:51:13.773925 1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
I1122 02:51:13.773869 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.774118 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.774162 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:13.773812 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.774276 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.774142 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:13.875022 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:13.875062 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:13.875071 1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
==> kubelet <==
Nov 22 02:51:15 no-preload-346270 kubelet[720]: E1122 02:51:15.224385 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8 podName:ac002b55-1114-4073-9f4b-aa618203638d nodeName:}" failed. No retries permitted until 2025-11-22 02:51:16.224352954 +0000 UTC m=+4.807355977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5stg8" (UniqueName: "kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8") pod "busybox" (UID: "ac002b55-1114-4073-9f4b-aa618203638d") : object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.129357 720 configmap.go:193] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.129469 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d8b5acd-6ff5-401d-b10b-b0215610f89f-config-volume podName:1d8b5acd-6ff5-401d-b10b-b0215610f89f nodeName:}" failed. No retries permitted until 2025-11-22 02:51:18.129447809 +0000 UTC m=+6.712450829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/1d8b5acd-6ff5-401d-b10b-b0215610f89f-config-volume") pod "coredns-66bc5c9577-6tsqs" (UID: "1d8b5acd-6ff5-401d-b10b-b0215610f89f") : object "kube-system"/"coredns" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.229863 720 projected.go:291] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.229897 720 projected.go:196] Error preparing data for projected volume kube-api-access-5stg8 for pod default/busybox: object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:16 no-preload-346270 kubelet[720]: E1122 02:51:16.230023 720 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8 podName:ac002b55-1114-4073-9f4b-aa618203638d nodeName:}" failed. No retries permitted until 2025-11-22 02:51:18.230000009 +0000 UTC m=+6.813003028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5stg8" (UniqueName: "kubernetes.io/projected/ac002b55-1114-4073-9f4b-aa618203638d-kube-api-access-5stg8") pod "busybox" (UID: "ac002b55-1114-4073-9f4b-aa618203638d") : object "default"/"kube-root-ca.crt" not registered
Nov 22 02:51:21 no-preload-346270 kubelet[720]: I1122 02:51:21.054885 720 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.678603 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec27387-5a7f-4691-9ef9-7081e676846c-tmp-volume\") pod \"kubernetes-dashboard-855c9754f9-h2f2w\" (UID: \"4ec27387-5a7f-4691-9ef9-7081e676846c\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.678663 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfzm5\" (UniqueName: \"kubernetes.io/projected/4ec27387-5a7f-4691-9ef9-7081e676846c-kube-api-access-cfzm5\") pod \"kubernetes-dashboard-855c9754f9-h2f2w\" (UID: \"4ec27387-5a7f-4691-9ef9-7081e676846c\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.779158 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/f741125d-c9f4-495e-bf40-8f1c9228a97e-tmp-volume\") pod \"dashboard-metrics-scraper-6ffb444bf9-9727m\" (UID: \"f741125d-c9f4-495e-bf40-8f1c9228a97e\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m"
Nov 22 02:51:24 no-preload-346270 kubelet[720]: I1122 02:51:24.779219 720 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl44c\" (UniqueName: \"kubernetes.io/projected/f741125d-c9f4-495e-bf40-8f1c9228a97e-kube-api-access-cl44c\") pod \"dashboard-metrics-scraper-6ffb444bf9-9727m\" (UID: \"f741125d-c9f4-495e-bf40-8f1c9228a97e\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m"
Nov 22 02:51:29 no-preload-346270 kubelet[720]: I1122 02:51:29.566321 720 scope.go:117] "RemoveContainer" containerID="9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: I1122 02:51:30.571990 720 scope.go:117] "RemoveContainer" containerID="9968fd171d85fcf5947e897016b32f618d5b4a3c2eba955d43acd2910b981879"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: I1122 02:51:30.572126 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:30 no-preload-346270 kubelet[720]: E1122 02:51:30.572311 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:31 no-preload-346270 kubelet[720]: I1122 02:51:31.576756 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:31 no-preload-346270 kubelet[720]: E1122 02:51:31.577432 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:34 no-preload-346270 kubelet[720]: I1122 02:51:34.964994 720 scope.go:117] "RemoveContainer" containerID="c38891ca75de2ae0b8d0462829c8ed1e8d29d5a0298f349e1e1e0f1feb14ba85"
Nov 22 02:51:34 no-preload-346270 kubelet[720]: E1122 02:51:34.966735 720 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-9727m_kubernetes-dashboard(f741125d-c9f4-495e-bf40-8f1c9228a97e)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-9727m" podUID="f741125d-c9f4-495e-bf40-8f1c9228a97e"
Nov 22 02:51:45 no-preload-346270 kubelet[720]: I1122 02:51:45.623026 720 scope.go:117] "RemoveContainer" containerID="10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6"
Nov 22 02:51:45 no-preload-346270 kubelet[720]: I1122 02:51:45.634670 720 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-h2f2w" podStartSLOduration=20.768973686 podStartE2EDuration="28.63464938s" podCreationTimestamp="2025-11-22 02:51:17 +0000 UTC" firstStartedPulling="2025-11-22 02:51:25.602713979 +0000 UTC m=+14.185716997" lastFinishedPulling="2025-11-22 02:51:33.468389674 +0000 UTC m=+22.051392691" observedRunningTime="2025-11-22 02:51:33.598867061 +0000 UTC m=+22.181870125" watchObservedRunningTime="2025-11-22 02:51:45.63464938 +0000 UTC m=+34.217652392"
Nov 22 02:51:45 no-preload-346270 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:51:45 no-preload-346270 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:51:45 no-preload-346270 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:51:45 no-preload-346270 systemd[1]: kubelet.service: Consumed 1.285s CPU time.
==> kubernetes-dashboard [70cb5fad3a68e98a4805154510d8131fa37841dc5671838d1122f864584121fa] <==
2025/11/22 02:51:33 Using namespace: kubernetes-dashboard
2025/11/22 02:51:33 Using in-cluster config to connect to apiserver
2025/11/22 02:51:33 Using secret token for csrf signing
2025/11/22 02:51:33 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:33 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:33 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:33 Generating JWE encryption key
2025/11/22 02:51:33 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:33 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:33 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:33 Creating in-cluster Sidecar client
2025/11/22 02:51:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:33 Serving insecurely on HTTP port: 9090
2025/11/22 02:51:33 Starting overwatch
==> storage-provisioner [10b82e028f448109f684bd69a9436788a43865f0a19fa218eeb1e353ddef57c6] <==
I1122 02:51:14.854511 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:51:44.859358 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-346270 -n no-preload-346270
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-346270 -n no-preload-346270: exit status 2 (411.218211ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context no-preload-346270 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/no-preload/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/no-preload/serial/Pause (6.33s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 11 (255.698065ms)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:52Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:205: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 11
start_stop_delete_test.go:209: WARNING: cni mode requires additional setup before pods can schedule :(
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/newest-cni/serial/EnableAddonWhileActive]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/newest-cni/serial/EnableAddonWhileActive]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect newest-cni-021912
helpers_test.go:243: (dbg) docker inspect newest-cni-021912:
-- stdout --
[
{
"Id": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"Created": "2025-11-22T02:51:26.422480693Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 328143,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:26.470966748Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hostname",
"HostsPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hosts",
"LogPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5-json.log",
"Name": "/newest-cni-021912",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"newest-cni-021912:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "newest-cni-021912",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"LowerDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/merged",
"UpperDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/diff",
"WorkDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "newest-cni-021912",
"Source": "/var/lib/docker/volumes/newest-cni-021912/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "newest-cni-021912",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "newest-cni-021912",
"name.minikube.sigs.k8s.io": "newest-cni-021912",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "f020953cda6e7ff5977f589816887229cfbf0f59897ab269637279e2d22a67ef",
"SandboxKey": "/var/run/docker/netns/f020953cda6e",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33118"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33119"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33122"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33120"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33121"
}
]
},
"Networks": {
"newest-cni-021912": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "4c9c9b0926e76905a707e1cdffdaa6c8fe86b3bf292f05d43e6eac753680ca10",
"EndpointID": "a1c3ca1e4a513ddd89bcde47ccc63ac25280e0a50f9466ad81444b5eb03b9251",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "0e:97:09:e1:61:56",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"newest-cni-021912",
"183827e63067"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912
helpers_test.go:252: <<< TestStartStop/group/newest-cni/serial/EnableAddonWhileActive FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/newest-cni/serial/EnableAddonWhileActive]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-021912 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p newest-cni-021912 logs -n 25: (1.837860692s)
helpers_test.go:260: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ ssh │ -p bridge-430524 sudo crio config │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p bridge-430524 │ bridge-430524 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ delete │ -p disable-driver-mounts-212164 │ disable-driver-mounts-212164 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:50 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p no-preload-346270 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ │
│ stop │ -p no-preload-346270 --alsologtostderr -v=3 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:50 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:33
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:33.808120 331164 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:33.808429 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808440 331164 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:33.808447 331164 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:33.808699 331164 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:33.809239 331164 out.go:368] Setting JSON to false
I1122 02:51:33.810667 331164 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5637,"bootTime":1763774257,"procs":295,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:33.810733 331164 start.go:143] virtualization: kvm guest
I1122 02:51:33.817123 331164 out.go:179] * [default-k8s-diff-port-714134] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:33.818705 331164 notify.go:221] Checking for updates...
I1122 02:51:33.818743 331164 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:33.822389 331164 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:33.823661 331164 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:33.824783 331164 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:33.825764 331164 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:33.826754 331164 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:33.828520 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:33.829196 331164 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:33.857369 331164 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:33.857562 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.920077 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.910365077 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.920186 331164 docker.go:319] overlay module found
I1122 02:51:33.922011 331164 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:33.923075 331164 start.go:309] selected driver: docker
I1122 02:51:33.923090 331164 start.go:927] validating driver "docker" against &{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.923198 331164 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:33.923985 331164 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:33.996972 331164 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:77 SystemTime:2025-11-22 02:51:33.986760851 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:33.997265 331164 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:33.997302 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.997351 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.997382 331164 start.go:353] cluster config:
{Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:33.999198 331164 out.go:179] * Starting "default-k8s-diff-port-714134" primary control-plane node in "default-k8s-diff-port-714134" cluster
I1122 02:51:34.000156 331164 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:34.001284 331164 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:34.002331 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:34.002366 331164 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:34.002380 331164 cache.go:65] Caching tarball of preloaded images
I1122 02:51:34.002411 331164 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:34.002468 331164 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:34.002478 331164 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:34.002600 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.023601 331164 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:34.023621 331164 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:34.023641 331164 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:34.023666 331164 start.go:360] acquireMachinesLock for default-k8s-diff-port-714134: {Name:mk7e1a12e2fa8aced0c98248f29bf8f0364ff72a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:34.023746 331164 start.go:364] duration metric: took 44.96µs to acquireMachinesLock for "default-k8s-diff-port-714134"
I1122 02:51:34.023769 331164 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:34.023775 331164 fix.go:54] fixHost starting:
I1122 02:51:34.024069 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.041134 331164 fix.go:112] recreateIfNeeded on default-k8s-diff-port-714134: state=Stopped err=<nil>
W1122 02:51:34.041193 331164 fix.go:138] unexpected machine state, will restart: <nil>
I1122 02:51:33.703692 327960 cli_runner.go:164] Run: docker network inspect embed-certs-153115 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:33.722074 327960 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1122 02:51:33.725954 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.735738 327960 kubeadm.go:884] updating cluster {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:33.735890 327960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:33.735990 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.775864 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.775888 327960 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:33.775945 327960 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:33.803499 327960 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:33.803521 327960 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:33.803530 327960 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.34.1 crio true true} ...
I1122 02:51:33.803634 327960 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-153115 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:33.803708 327960 ssh_runner.go:195] Run: crio config
I1122 02:51:33.859877 327960 cni.go:84] Creating CNI manager for ""
I1122 02:51:33.859923 327960 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:33.859948 327960 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:33.859982 327960 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-153115 NodeName:embed-certs-153115 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/et
c/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:33.860206 327960 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-153115"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:33.860275 327960 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:33.869804 327960 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:33.869931 327960 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:33.879000 327960 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I1122 02:51:33.892987 327960 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:33.909568 327960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2214 bytes)
I1122 02:51:33.923811 327960 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:33.927547 327960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:33.937743 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.038162 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:34.064574 327960 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115 for IP: 192.168.76.2
I1122 02:51:34.064592 327960 certs.go:195] generating shared ca certs ...
I1122 02:51:34.064608 327960 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.064762 327960 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:34.064809 327960 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:34.064819 327960 certs.go:257] generating profile certs ...
I1122 02:51:34.064963 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/client.key
I1122 02:51:34.065021 327960 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key.a2dcd911
I1122 02:51:34.065079 327960 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key
I1122 02:51:34.065209 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:34.065245 327960 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:34.065253 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:34.065282 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:34.065308 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:34.065334 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:34.065385 327960 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:34.066195 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:34.087518 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:34.107591 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:34.127804 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:34.150798 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I1122 02:51:34.172965 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:34.200246 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:34.219605 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/embed-certs-153115/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1122 02:51:34.237481 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:34.257690 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:34.276956 327960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:34.294622 327960 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:34.306511 327960 ssh_runner.go:195] Run: openssl version
I1122 02:51:34.312288 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:34.320109 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324197 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:34.324278 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:34.367392 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:34.377010 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:34.387536 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.391975 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.392022 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:34.429653 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:34.438043 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:34.447315 327960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451034 327960 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:34.451086 327960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:34.491615 327960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:34.499711 327960 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:34.503423 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:34.541936 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:34.589295 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:34.648308 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:34.707752 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:34.760015 327960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:34.804463 327960 kubeadm.go:401] StartCluster: {Name:embed-certs-153115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:embed-certs-153115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:34.804572 327960 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:34.804626 327960 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:34.837717 327960 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:51:34.837741 327960 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:51:34.837746 327960 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:51:34.837751 327960 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:51:34.837755 327960 cri.go:89] found id: ""
I1122 02:51:34.837797 327960 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:34.849976 327960 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:34Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:34.850037 327960 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:34.858633 327960 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:34.858646 327960 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:34.858702 327960 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:34.866840 327960 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:34.870118 327960 kubeconfig.go:47] verify endpoint returned: get endpoint: "embed-certs-153115" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.870434 327960 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "embed-certs-153115" cluster setting kubeconfig missing "embed-certs-153115" context setting]
I1122 02:51:34.871098 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.872766 327960 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:34.880234 327960 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.76.2
I1122 02:51:34.880263 327960 kubeadm.go:602] duration metric: took 21.610639ms to restartPrimaryControlPlane
I1122 02:51:34.880272 327960 kubeadm.go:403] duration metric: took 75.818579ms to StartCluster
I1122 02:51:34.880288 327960 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.880344 327960 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:34.881853 327960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:34.882098 327960 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:34.882167 327960 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:34.882274 327960 addons.go:70] Setting storage-provisioner=true in profile "embed-certs-153115"
I1122 02:51:34.882296 327960 addons.go:70] Setting dashboard=true in profile "embed-certs-153115"
I1122 02:51:34.882311 327960 addons.go:239] Setting addon storage-provisioner=true in "embed-certs-153115"
I1122 02:51:34.882316 327960 addons.go:239] Setting addon dashboard=true in "embed-certs-153115"
W1122 02:51:34.882319 327960 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:34.882318 327960 addons.go:70] Setting default-storageclass=true in profile "embed-certs-153115"
I1122 02:51:34.882327 327960 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:34.882347 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882352 327960 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-153115"
W1122 02:51:34.882325 327960 addons.go:248] addon dashboard should already be in state true
I1122 02:51:34.882443 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.882675 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.882878 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.883057 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.884392 327960 out.go:179] * Verifying Kubernetes components...
I1122 02:51:34.886921 327960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:34.911466 327960 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:34.911523 327960 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:34.911898 327960 addons.go:239] Setting addon default-storageclass=true in "embed-certs-153115"
W1122 02:51:34.911934 327960 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:34.911961 327960 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:51:34.912424 327960 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:51:34.912938 327960 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:34.912957 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:34.913007 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.913995 327960 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:34.915941 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:34.915959 327960 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:34.916008 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.944068 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.947046 327960 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:34.947068 327960 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:34.947264 327960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:51:34.956178 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:34.973759 327960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:51:35.050045 327960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:35.066242 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:35.067551 327960 node_ready.go:35] waiting up to 6m0s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:35.080204 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:35.080225 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:35.089121 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:35.095997 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:35.096015 327960 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:35.112983 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:35.113005 327960 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:35.129055 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:35.129078 327960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:35.144601 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:35.144620 327960 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:35.160289 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:35.160304 327960 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:35.175854 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:35.175876 327960 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:35.188348 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:35.188368 327960 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:35.200442 327960 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:35.200459 327960 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:35.213676 327960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:36.450666 327960 node_ready.go:49] node "embed-certs-153115" is "Ready"
I1122 02:51:36.450712 327960 node_ready.go:38] duration metric: took 1.383125895s for node "embed-certs-153115" to be "Ready" ...
I1122 02:51:36.450729 327960 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:36.450786 327960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:36.968538 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.902260952s)
I1122 02:51:36.968607 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.879455326s)
I1122 02:51:36.968726 327960 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.754999504s)
I1122 02:51:36.968787 327960 api_server.go:72] duration metric: took 2.086658227s to wait for apiserver process to appear ...
I1122 02:51:36.968849 327960 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:36.968872 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:36.970439 327960 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p embed-certs-153115 addons enable metrics-server
I1122 02:51:36.975277 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:36.975300 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:36.980766 327960 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
I1122 02:51:32.944974 327113 out.go:252] - Generating certificates and keys ...
I1122 02:51:32.945087 327113 kubeadm.go:319] [certs] Using existing ca certificate authority
I1122 02:51:32.945183 327113 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1122 02:51:33.463695 327113 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1122 02:51:33.654473 327113 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1122 02:51:34.283220 327113 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1122 02:51:34.658725 327113 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1122 02:51:34.991210 327113 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1122 02:51:34.991380 327113 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.348113 327113 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1122 02:51:35.348291 327113 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [localhost newest-cni-021912] and IPs [192.168.85.2 127.0.0.1 ::1]
I1122 02:51:35.729080 327113 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1122 02:51:35.838398 327113 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1122 02:51:36.135928 327113 kubeadm.go:319] [certs] Generating "sa" key and public key
I1122 02:51:36.136205 327113 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1122 02:51:36.489488 327113 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1122 02:51:36.746954 327113 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1122 02:51:37.381597 327113 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1122 02:51:37.828548 327113 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1122 02:51:38.113827 327113 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1122 02:51:38.114496 327113 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1122 02:51:38.119336 327113 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1122 02:51:34.042619 331164 out.go:252] * Restarting existing docker container for "default-k8s-diff-port-714134" ...
I1122 02:51:34.042686 331164 cli_runner.go:164] Run: docker start default-k8s-diff-port-714134
I1122 02:51:34.328691 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:34.350055 331164 kic.go:430] container "default-k8s-diff-port-714134" state is running.
I1122 02:51:34.350463 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:34.372170 331164 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/config.json ...
I1122 02:51:34.372397 331164 machine.go:94] provisionDockerMachine start ...
I1122 02:51:34.372468 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:34.394122 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:34.394363 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:34.394379 331164 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:34.395096 331164 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34084->127.0.0.1:33128: read: connection reset by peer
I1122 02:51:37.540642 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.540728 331164 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-714134"
I1122 02:51:37.540882 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.566239 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.566544 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.566566 331164 main.go:143] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-714134 && echo "default-k8s-diff-port-714134" | sudo tee /etc/hostname
I1122 02:51:37.716876 331164 main.go:143] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-714134
I1122 02:51:37.716974 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:37.736603 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:37.736881 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:37.736922 331164 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-714134' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-714134/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-714134' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:51:37.875013 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:51:37.875043 331164 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:51:37.875074 331164 ubuntu.go:190] setting up certificates
I1122 02:51:37.875088 331164 provision.go:84] configureAuth start
I1122 02:51:37.875151 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:37.894002 331164 provision.go:143] copyHostCerts
I1122 02:51:37.894074 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:51:37.894094 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:51:37.894175 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:51:37.894311 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:51:37.894326 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:51:37.894371 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:51:37.894468 331164 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:51:37.894487 331164 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:51:37.894536 331164 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:51:37.894625 331164 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-714134 san=[127.0.0.1 192.168.94.2 default-k8s-diff-port-714134 localhost minikube]
I1122 02:51:38.230740 331164 provision.go:177] copyRemoteCerts
I1122 02:51:38.230805 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:51:38.230849 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.249368 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.344588 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1122 02:51:38.361871 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:51:38.378711 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:51:38.395414 331164 provision.go:87] duration metric: took 520.309788ms to configureAuth
I1122 02:51:38.395438 331164 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:51:38.395615 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:38.395716 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.412782 331164 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:38.413035 331164 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I1122 02:51:38.413054 331164 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:51:38.753526 331164 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:51:38.753556 331164 machine.go:97] duration metric: took 4.381140927s to provisionDockerMachine
I1122 02:51:38.753571 331164 start.go:293] postStartSetup for "default-k8s-diff-port-714134" (driver="docker")
I1122 02:51:38.753584 331164 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:51:38.753654 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:51:38.753704 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.774405 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:38.868582 331164 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:51:38.871897 331164 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:51:38.871961 331164 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:51:38.871973 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:51:38.872020 331164 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:51:38.872087 331164 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:51:38.872531 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:51:38.881103 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:38.897768 331164 start.go:296] duration metric: took 144.184538ms for postStartSetup
I1122 02:51:38.897838 331164 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:51:38.897885 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:38.918344 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.010096 331164 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:51:39.014852 331164 fix.go:56] duration metric: took 4.991072115s for fixHost
I1122 02:51:39.014877 331164 start.go:83] releasing machines lock for "default-k8s-diff-port-714134", held for 4.991117201s
I1122 02:51:39.014966 331164 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-714134
I1122 02:51:39.033303 331164 ssh_runner.go:195] Run: cat /version.json
I1122 02:51:39.033326 331164 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:51:39.033342 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.033395 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:39.050441 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.050812 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:39.212840 331164 ssh_runner.go:195] Run: systemctl --version
I1122 02:51:39.219292 331164 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:51:39.263559 331164 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:51:39.270708 331164 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:51:39.270787 331164 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:51:39.279711 331164 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:51:39.279732 331164 start.go:496] detecting cgroup driver to use...
I1122 02:51:39.279768 331164 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:51:39.279817 331164 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:51:39.293134 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:51:39.304848 331164 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:51:39.304886 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:51:39.318093 331164 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:51:39.329420 331164 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:51:39.417688 331164 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:51:39.499488 331164 docker.go:234] disabling docker service ...
I1122 02:51:39.499540 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:51:39.514311 331164 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:51:39.525537 331164 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:51:39.608234 331164 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:51:39.684819 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:51:39.698122 331164 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:51:39.715088 331164 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:51:39.715149 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.724344 331164 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:51:39.724404 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.733704 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.743549 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.754797 331164 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:51:39.768466 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.785172 331164 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.798984 331164 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:51:39.815655 331164 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:51:39.826134 331164 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:51:39.834804 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:39.928023 331164 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:51:40.072992 331164 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:51:40.073057 331164 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:51:40.076854 331164 start.go:564] Will wait 60s for crictl version
I1122 02:51:40.076922 331164 ssh_runner.go:195] Run: which crictl
I1122 02:51:40.080523 331164 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:51:40.106629 331164 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:51:40.106701 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.134559 331164 ssh_runner.go:195] Run: crio --version
I1122 02:51:40.165236 331164 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:51:36.981657 327960 addons.go:530] duration metric: took 2.099497416s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:51:37.469048 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.474530 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:37.474599 327960 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:37.968988 327960 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1122 02:51:37.973175 327960 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1122 02:51:37.974331 327960 api_server.go:141] control plane version: v1.34.1
I1122 02:51:37.974362 327960 api_server.go:131] duration metric: took 1.005503785s to wait for apiserver health ...
I1122 02:51:37.974373 327960 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:37.978271 327960 system_pods.go:59] 8 kube-system pods found
I1122 02:51:37.978304 327960 system_pods.go:61] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.978314 327960 system_pods.go:61] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.978326 327960 system_pods.go:61] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.978513 327960 system_pods.go:61] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.978530 327960 system_pods.go:61] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.978539 327960 system_pods.go:61] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.978549 327960 system_pods.go:61] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.978557 327960 system_pods.go:61] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.978565 327960 system_pods.go:74] duration metric: took 4.183329ms to wait for pod list to return data ...
I1122 02:51:37.978577 327960 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:37.981059 327960 default_sa.go:45] found service account: "default"
I1122 02:51:37.981081 327960 default_sa.go:55] duration metric: took 2.496462ms for default service account to be created ...
I1122 02:51:37.981092 327960 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:37.984066 327960 system_pods.go:86] 8 kube-system pods found
I1122 02:51:37.984095 327960 system_pods.go:89] "coredns-66bc5c9577-bq64j" [48137095-0f96-4219-bffa-33209e851046] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:37.984107 327960 system_pods.go:89] "etcd-embed-certs-153115" [25d8531a-6c9a-41a7-95e7-08b620ec77f7] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:37.984117 327960 system_pods.go:89] "kindnet-hpnj7" [2ccf409a-3708-4cf1-834d-d74d3d1895dd] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:37.984126 327960 system_pods.go:89] "kube-apiserver-embed-certs-153115" [510cb1be-d0fb-40bd-9de4-5149af24a48d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:37.984134 327960 system_pods.go:89] "kube-controller-manager-embed-certs-153115" [9c8606ae-1a01-47a8-b117-533af5fb602c] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:37.984144 327960 system_pods.go:89] "kube-proxy-vw5ph" [fd3757e0-7e12-4db9-a74e-8a12d177ecb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:37.984157 327960 system_pods.go:89] "kube-scheduler-embed-certs-153115" [f8139496-5a5e-43fa-941d-872fbaa9da58] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:37.984166 327960 system_pods.go:89] "storage-provisioner" [d2533f69-8428-47af-9e33-0a6aeb136e11] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:37.984176 327960 system_pods.go:126] duration metric: took 3.078342ms to wait for k8s-apps to be running ...
I1122 02:51:37.984185 327960 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:37.984220 327960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:37.997569 327960 system_svc.go:56] duration metric: took 13.37647ms WaitForService to wait for kubelet
I1122 02:51:37.997591 327960 kubeadm.go:587] duration metric: took 3.115464866s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:37.997610 327960 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:38.000283 327960 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:38.000311 327960 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:38.000324 327960 node_conditions.go:105] duration metric: took 2.707917ms to run NodePressure ...
I1122 02:51:38.000338 327960 start.go:242] waiting for startup goroutines ...
I1122 02:51:38.000348 327960 start.go:247] waiting for cluster config update ...
I1122 02:51:38.000365 327960 start.go:256] writing updated cluster config ...
I1122 02:51:38.000631 327960 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:38.004168 327960 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:38.007292 327960 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:51:40.013015 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:40.166556 331164 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-714134 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:51:40.185778 331164 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1122 02:51:40.189793 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.200293 331164 kubeadm.go:884] updating cluster {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT
ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:51:40.200431 331164 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:40.200486 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.239242 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.239264 331164 crio.go:433] Images already preloaded, skipping extraction
I1122 02:51:40.239319 331164 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:51:40.267336 331164 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:51:40.267354 331164 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:51:40.267361 331164 kubeadm.go:935] updating node { 192.168.94.2 8444 v1.34.1 crio true true} ...
I1122 02:51:40.267451 331164 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-714134 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:51:40.267510 331164 ssh_runner.go:195] Run: crio config
I1122 02:51:40.318652 331164 cni.go:84] Creating CNI manager for ""
I1122 02:51:40.318673 331164 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:40.318710 331164 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1122 02:51:40.318732 331164 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8444 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-714134 NodeName:default-k8s-diff-port-714134 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:51:40.318849 331164 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-714134"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:51:40.318936 331164 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:51:40.326997 331164 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:51:40.327054 331164 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:51:40.334920 331164 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
I1122 02:51:40.349662 331164 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:51:40.365416 331164 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
I1122 02:51:40.384621 331164 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:51:40.389758 331164 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:51:40.404895 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:40.503365 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:40.535438 331164 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134 for IP: 192.168.94.2
I1122 02:51:40.535459 331164 certs.go:195] generating shared ca certs ...
I1122 02:51:40.535476 331164 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:40.535643 331164 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:51:40.535708 331164 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:51:40.535725 331164 certs.go:257] generating profile certs ...
I1122 02:51:40.535839 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/client.key
I1122 02:51:40.535930 331164 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key.3f67d7f0
I1122 02:51:40.535996 331164 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key
I1122 02:51:40.536125 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:51:40.536166 331164 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:51:40.536181 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:51:40.536213 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:51:40.536250 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:51:40.536281 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:51:40.536336 331164 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:51:40.537005 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:51:40.556550 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:51:40.576988 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:51:40.595219 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:51:40.622479 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I1122 02:51:40.645160 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:51:40.664363 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:51:40.681995 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/default-k8s-diff-port-714134/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:51:40.701586 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:51:40.723799 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:51:40.742435 331164 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:51:40.761869 331164 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:51:40.773956 331164 ssh_runner.go:195] Run: openssl version
I1122 02:51:40.779823 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:51:40.787771 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791306 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:51:40.791357 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:51:40.828463 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:51:40.836647 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:51:40.846093 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850356 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.850395 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:51:40.889185 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:51:40.897675 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:51:40.906531 331164 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910170 331164 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:51:40.910217 331164 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:51:40.968186 331164 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:51:40.979463 331164 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:51:40.985694 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:51:41.046839 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:51:41.108795 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:51:41.170881 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:51:41.242292 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:51:41.306878 331164 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:51:41.400984 331164 kubeadm.go:401] StartCluster: {Name:default-k8s-diff-port-714134 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:default-k8s-diff-port-714134 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:41.401089 331164 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:51:41.401156 331164 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:51:41.468811 331164 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:51:41.468892 331164 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:51:41.468928 331164 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:51:41.468957 331164 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:51:41.468972 331164 cri.go:89] found id: ""
I1122 02:51:41.469060 331164 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:51:41.494570 331164 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:51:41Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:51:41.494642 331164 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:51:41.507835 331164 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:51:41.507929 331164 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:51:41.507992 331164 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:51:41.531866 331164 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:51:41.533234 331164 kubeconfig.go:47] verify endpoint returned: get endpoint: "default-k8s-diff-port-714134" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.534277 331164 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "default-k8s-diff-port-714134" cluster setting kubeconfig missing "default-k8s-diff-port-714134" context setting]
I1122 02:51:41.535566 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.538207 331164 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:51:41.551210 331164 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.94.2
I1122 02:51:41.551236 331164 kubeadm.go:602] duration metric: took 43.297745ms to restartPrimaryControlPlane
I1122 02:51:41.551246 331164 kubeadm.go:403] duration metric: took 150.272079ms to StartCluster
I1122 02:51:41.551261 331164 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.551310 331164 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:41.553345 331164 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:41.553565 331164 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8444 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:41.554035 331164 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:41.554123 331164 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:41.554163 331164 addons.go:70] Setting storage-provisioner=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554173 331164 addons.go:70] Setting dashboard=true in profile "default-k8s-diff-port-714134"
I1122 02:51:41.554183 331164 addons.go:239] Setting addon storage-provisioner=true in "default-k8s-diff-port-714134"
I1122 02:51:41.554199 331164 addons.go:70] Setting default-storageclass=true in profile "default-k8s-diff-port-714134"
W1122 02:51:41.554203 331164 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:51:41.554218 331164 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-714134"
I1122 02:51:41.554234 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.554519 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554187 331164 addons.go:239] Setting addon dashboard=true in "default-k8s-diff-port-714134"
W1122 02:51:41.554698 331164 addons.go:248] addon dashboard should already be in state true
I1122 02:51:41.554717 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.554725 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.555180 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.556766 331164 out.go:179] * Verifying Kubernetes components...
I1122 02:51:41.561428 331164 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:41.588610 331164 addons.go:239] Setting addon default-storageclass=true in "default-k8s-diff-port-714134"
W1122 02:51:41.590403 331164 addons.go:248] addon default-storageclass should already be in state true
I1122 02:51:41.590469 331164 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:51:41.591052 331164 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:51:41.592886 331164 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:51:41.592967 331164 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:51:41.594059 331164 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.594079 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:41.594195 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.595187 331164 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I1122 02:51:38.120630 327113 out.go:252] - Booting up control plane ...
I1122 02:51:38.120796 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1122 02:51:38.120926 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1122 02:51:38.121614 327113 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1122 02:51:38.134669 327113 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1122 02:51:38.134802 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1122 02:51:38.141938 327113 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1122 02:51:38.142274 327113 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1122 02:51:38.142332 327113 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1122 02:51:38.253726 327113 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1122 02:51:38.253914 327113 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1122 02:51:39.755611 327113 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.501826871s
I1122 02:51:39.759624 327113 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1122 02:51:39.759764 327113 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.85.2:8443/livez
I1122 02:51:39.760175 327113 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1122 02:51:39.760561 327113 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1122 02:51:41.560999 327113 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 1.797435952s
I1122 02:51:41.598029 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:51:41.598070 331164 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:51:41.598119 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.630170 331164 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.630280 331164 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:41.630392 331164 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:51:41.644561 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.648021 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.670326 331164 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:51:41.784765 331164 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:41.818289 331164 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:41.820889 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:41.823013 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:41.829399 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:51:41.829418 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:51:41.871182 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:51:41.871292 331164 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:51:41.908781 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:51:41.908824 331164 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:51:41.961331 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:51:41.961355 331164 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:51:41.996454 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:51:41.996486 331164 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:51:42.022318 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:51:42.022341 331164 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:51:42.044132 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:51:42.044171 331164 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:51:42.068895 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:51:42.068931 331164 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:51:42.094902 331164 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:42.095167 331164 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:51:42.115750 331164 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:51:43.273067 331164 node_ready.go:49] node "default-k8s-diff-port-714134" is "Ready"
I1122 02:51:43.273107 331164 node_ready.go:38] duration metric: took 1.454695177s for node "default-k8s-diff-port-714134" to be "Ready" ...
I1122 02:51:43.273127 331164 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:43.273189 331164 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:43.346488 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.52555272s)
I1122 02:51:43.982658 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.159583631s)
I1122 02:51:43.982798 331164 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.86700228s)
I1122 02:51:43.982886 331164 api_server.go:72] duration metric: took 2.42929171s to wait for apiserver process to appear ...
I1122 02:51:43.982964 331164 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:43.982996 331164 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:43.987024 331164 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p default-k8s-diff-port-714134 addons enable metrics-server
I1122 02:51:43.988326 331164 out.go:179] * Enabled addons: default-storageclass, storage-provisioner, dashboard
I1122 02:51:43.021138 327113 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 3.26139895s
I1122 02:51:44.761232 327113 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 5.001296243s
I1122 02:51:44.772246 327113 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1122 02:51:44.781163 327113 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1122 02:51:44.789615 327113 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1122 02:51:44.789898 327113 kubeadm.go:319] [mark-control-plane] Marking the node newest-cni-021912 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1122 02:51:44.798008 327113 kubeadm.go:319] [bootstrap-token] Using token: omniu2.5k9g6ns41l8h6qyz
I1122 02:51:44.799648 327113 out.go:252] - Configuring RBAC rules ...
I1122 02:51:44.799822 327113 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1122 02:51:44.802932 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1122 02:51:44.807795 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1122 02:51:44.810078 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1122 02:51:44.813275 327113 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1122 02:51:44.816877 327113 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1122 02:51:45.169660 327113 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1122 02:51:45.583174 327113 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1122 02:51:46.167427 327113 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1122 02:51:46.168639 327113 kubeadm.go:319]
I1122 02:51:46.168738 327113 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1122 02:51:46.168750 327113 kubeadm.go:319]
I1122 02:51:46.168867 327113 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1122 02:51:46.168877 327113 kubeadm.go:319]
I1122 02:51:46.168941 327113 kubeadm.go:319] mkdir -p $HOME/.kube
I1122 02:51:46.169023 327113 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1122 02:51:46.169093 327113 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1122 02:51:46.169103 327113 kubeadm.go:319]
I1122 02:51:46.169173 327113 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1122 02:51:46.169182 327113 kubeadm.go:319]
I1122 02:51:46.169243 327113 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1122 02:51:46.169253 327113 kubeadm.go:319]
I1122 02:51:46.169357 327113 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1122 02:51:46.169469 327113 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1122 02:51:46.169570 327113 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1122 02:51:46.169577 327113 kubeadm.go:319]
I1122 02:51:46.169728 327113 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1122 02:51:46.169845 327113 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1122 02:51:46.169856 327113 kubeadm.go:319]
I1122 02:51:46.169995 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170166 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357 \
I1122 02:51:46.170206 327113 kubeadm.go:319] --control-plane
I1122 02:51:46.170230 327113 kubeadm.go:319]
I1122 02:51:46.170357 327113 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1122 02:51:46.170369 327113 kubeadm.go:319]
I1122 02:51:46.170482 327113 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token omniu2.5k9g6ns41l8h6qyz \
I1122 02:51:46.170623 327113 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:b7fecd86f59c23aa0bf7fc87452dbcaafadc49b897c9b22dd51428dfa8125357
I1122 02:51:46.173803 327113 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1044-gcp\n", err: exit status 1
I1122 02:51:46.174024 327113 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1122 02:51:46.174052 327113 cni.go:84] Creating CNI manager for ""
I1122 02:51:46.174061 327113 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:46.176516 327113 out.go:179] * Configuring CNI (Container Networking Interface) ...
W1122 02:51:42.018105 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:51:44.513440 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:46.177605 327113 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1122 02:51:46.182770 327113 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1122 02:51:46.182789 327113 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1122 02:51:46.198648 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1122 02:51:46.480371 327113 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1122 02:51:46.480473 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:46.480545 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes newest-cni-021912 minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a minikube.k8s.io/name=newest-cni-021912 minikube.k8s.io/primary=true
I1122 02:51:46.492989 327113 ops.go:34] apiserver oom_adj: -16
I1122 02:51:46.593992 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:47.094019 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:43.989687 331164 addons.go:530] duration metric: took 2.435653994s for enable addons: enabled=[default-storageclass storage-provisioner dashboard]
I1122 02:51:43.990390 331164 api_server.go:279] https://192.168.94.2:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:51:43.990452 331164 api_server.go:103] status: https://192.168.94.2:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:51:44.483998 331164 api_server.go:253] Checking apiserver healthz at https://192.168.94.2:8444/healthz ...
I1122 02:51:44.489144 331164 api_server.go:279] https://192.168.94.2:8444/healthz returned 200:
ok
I1122 02:51:44.490276 331164 api_server.go:141] control plane version: v1.34.1
I1122 02:51:44.490306 331164 api_server.go:131] duration metric: took 507.32508ms to wait for apiserver health ...
I1122 02:51:44.490318 331164 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:44.494073 331164 system_pods.go:59] 8 kube-system pods found
I1122 02:51:44.494108 331164 system_pods.go:61] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:44.494120 331164 system_pods.go:61] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:44.494137 331164 system_pods.go:61] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:44.494151 331164 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:44.494164 331164 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:44.494176 331164 system_pods.go:61] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:44.494186 331164 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:44.494198 331164 system_pods.go:61] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:44.494209 331164 system_pods.go:74] duration metric: took 3.882876ms to wait for pod list to return data ...
I1122 02:51:44.494223 331164 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:44.496628 331164 default_sa.go:45] found service account: "default"
I1122 02:51:44.496657 331164 default_sa.go:55] duration metric: took 2.415314ms for default service account to be created ...
I1122 02:51:44.496668 331164 system_pods.go:116] waiting for k8s-apps to be running ...
I1122 02:51:44.499330 331164 system_pods.go:86] 8 kube-system pods found
I1122 02:51:44.499362 331164 system_pods.go:89] "coredns-66bc5c9577-d74g5" [4b9c4fb7-8643-4a65-a1d1-39a187413744] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1122 02:51:44.499375 331164 system_pods.go:89] "etcd-default-k8s-diff-port-714134" [f37eb7c9-d40d-454a-9674-b2ee6d972179] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:44.499387 331164 system_pods.go:89] "kindnet-jzn9z" [bd1a1993-721e-4ad8-8b2e-483f7223c084] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:44.499399 331164 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-714134" [783b9707-92d7-4f18-b4d3-3129cbbc88e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:44.499414 331164 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-714134" [31fa75f3-ac0a-470d-a696-ba924a1d18e5] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:44.499425 331164 system_pods.go:89] "kube-proxy-ppn8j" [4cde99fd-ddcb-4210-b7e9-e2c960bf34ae] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:44.499438 331164 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-714134" [84b050be-4ac3-42de-b59a-ca28a70714a1] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:44.499449 331164 system_pods.go:89] "storage-provisioner" [675367a5-8e5e-4257-90af-e021e0555ed5] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1122 02:51:44.499463 331164 system_pods.go:126] duration metric: took 2.788259ms to wait for k8s-apps to be running ...
I1122 02:51:44.499476 331164 system_svc.go:44] waiting for kubelet service to be running ....
I1122 02:51:44.499524 331164 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:51:44.515318 331164 system_svc.go:56] duration metric: took 15.832544ms WaitForService to wait for kubelet
I1122 02:51:44.515365 331164 kubeadm.go:587] duration metric: took 2.961770959s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1122 02:51:44.515393 331164 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:44.518426 331164 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:44.518457 331164 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:44.518470 331164 node_conditions.go:105] duration metric: took 3.069886ms to run NodePressure ...
I1122 02:51:44.518484 331164 start.go:242] waiting for startup goroutines ...
I1122 02:51:44.518494 331164 start.go:247] waiting for cluster config update ...
I1122 02:51:44.518509 331164 start.go:256] writing updated cluster config ...
I1122 02:51:44.518781 331164 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:44.523092 331164 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:51:44.526920 331164 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
W1122 02:51:46.535376 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:51:47.595580 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:48.095013 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:48.594677 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:49.094381 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:49.594962 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:50.094700 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:50.594031 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:51.094682 327113 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1122 02:51:51.175186 327113 kubeadm.go:1114] duration metric: took 4.694773652s to wait for elevateKubeSystemPrivileges
I1122 02:51:51.175227 327113 kubeadm.go:403] duration metric: took 18.557185941s to StartCluster
I1122 02:51:51.175249 327113 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:51.175324 327113 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:51.178326 327113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:51:51.178611 327113 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1122 02:51:51.178642 327113 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:51:51.178953 327113 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:51.178778 327113 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:51:51.179171 327113 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:51:51.179189 327113 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:51:51.179198 327113 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
I1122 02:51:51.179231 327113 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:51:51.179235 327113 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:51:51.179588 327113 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:51.179722 327113 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:51.180271 327113 out.go:179] * Verifying Kubernetes components...
I1122 02:51:51.182209 327113 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:51:51.206878 327113 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
W1122 02:51:46.518174 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:51:49.013299 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:51:51.014089 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:51.208232 327113 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:51.208251 327113 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:51:51.208399 327113 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:51.208931 327113 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
I1122 02:51:51.208971 327113 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:51:51.209512 327113 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:51.242762 327113 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:51.242792 327113 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:51:51.242854 327113 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:51.246085 327113 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33118 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:51:51.275960 327113 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33118 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:51:51.312407 327113 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1122 02:51:51.367052 327113 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:51:51.380581 327113 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:51:51.421715 327113 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:51:51.566663 327113 start.go:977] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS's ConfigMap
I1122 02:51:51.569626 327113 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:51:51.569683 327113 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:51:51.797279 327113 api_server.go:72] duration metric: took 618.599015ms to wait for apiserver process to appear ...
I1122 02:51:51.797302 327113 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:51:51.797330 327113 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:51:51.803327 327113 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:51:51.804435 327113 api_server.go:141] control plane version: v1.34.1
I1122 02:51:51.804461 327113 api_server.go:131] duration metric: took 7.150996ms to wait for apiserver health ...
I1122 02:51:51.804471 327113 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:51:51.805024 327113 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
I1122 02:51:51.806008 327113 addons.go:530] duration metric: took 627.305023ms for enable addons: enabled=[storage-provisioner default-storageclass]
I1122 02:51:51.808163 327113 system_pods.go:59] 8 kube-system pods found
I1122 02:51:51.808202 327113 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:51:51.808221 327113 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:51:51.808232 327113 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Pending / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
I1122 02:51:51.808240 327113 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:51:51.808249 327113 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:51:51.808256 327113 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I1122 02:51:51.808263 327113 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:51:51.808269 327113 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:51:51.808277 327113 system_pods.go:74] duration metric: took 3.798909ms to wait for pod list to return data ...
I1122 02:51:51.808291 327113 default_sa.go:34] waiting for default service account to be created ...
I1122 02:51:51.810852 327113 default_sa.go:45] found service account: "default"
I1122 02:51:51.810866 327113 default_sa.go:55] duration metric: took 2.569705ms for default service account to be created ...
I1122 02:51:51.810876 327113 kubeadm.go:587] duration metric: took 632.202402ms to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:51.810889 327113 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:51:51.814073 327113 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:51:51.814105 327113 node_conditions.go:123] node cpu capacity is 8
I1122 02:51:51.814120 327113 node_conditions.go:105] duration metric: took 3.226898ms to run NodePressure ...
I1122 02:51:51.814134 327113 start.go:242] waiting for startup goroutines ...
I1122 02:51:52.076031 327113 kapi.go:214] "coredns" deployment in "kube-system" namespace and "newest-cni-021912" context rescaled to 1 replicas
I1122 02:51:52.076092 327113 start.go:247] waiting for cluster config update ...
I1122 02:51:52.076110 327113 start.go:256] writing updated cluster config ...
I1122 02:51:52.076421 327113 ssh_runner.go:195] Run: rm -f paused
I1122 02:51:52.148771 327113 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:51:52.150533 327113 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.587238249Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.592737829Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=a6bb08ec-4dd1-46d0-b4d4-a3699efc42eb name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.593458282Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=b1f69368-e467-4c91-8e8f-399113ba1eab name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.594567209Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.595605919Z" level=info msg="Ran pod sandbox b51a8e7dac247f8cc567adf6303a39059d316f7365e3751472c005000955cc12 with infra container: kube-system/kube-proxy-mbdks/POD" id=a6bb08ec-4dd1-46d0-b4d4-a3699efc42eb name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.596333026Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.597453444Z" level=info msg="Ran pod sandbox 9d7080ff71476651eafe048a7e6b4d134c2b6d2ca61804491d3e4550865927a5 with infra container: kube-system/kindnet-qlk6r/POD" id=b1f69368-e467-4c91-8e8f-399113ba1eab name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.598369418Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=b7e8439c-0111-493d-9bb3-76a94d20a64e name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.598725181Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=0f49451c-cf1f-435c-ae2b-9f8c4987e326 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.599474557Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=3db7d59d-375a-4e11-bdd9-4fec9b7bebe0 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.599670429Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=14c8a698-d992-4e03-833e-035651c7be5e name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.606203448Z" level=info msg="Creating container: kube-system/kindnet-qlk6r/kindnet-cni" id=86a53fca-6ab8-418f-bf65-baa98974905a name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.607221803Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.608050814Z" level=info msg="Creating container: kube-system/kube-proxy-mbdks/kube-proxy" id=2884511c-a34f-41e2-afa9-48e4f76f7986 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.6081673Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.618767048Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.62005364Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.622559816Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.623101718Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.655631208Z" level=info msg="Created container a8bbdcbcecd7cd7d4eb7307365ea6ff7384dd31d02387fc3322e3a2057a52a82: kube-system/kindnet-qlk6r/kindnet-cni" id=86a53fca-6ab8-418f-bf65-baa98974905a name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.656341719Z" level=info msg="Starting container: a8bbdcbcecd7cd7d4eb7307365ea6ff7384dd31d02387fc3322e3a2057a52a82" id=bfc190b8-1f25-43bd-b045-d0626358db76 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.658736864Z" level=info msg="Started container" PID=1622 containerID=a8bbdcbcecd7cd7d4eb7307365ea6ff7384dd31d02387fc3322e3a2057a52a82 description=kube-system/kindnet-qlk6r/kindnet-cni id=bfc190b8-1f25-43bd-b045-d0626358db76 name=/runtime.v1.RuntimeService/StartContainer sandboxID=9d7080ff71476651eafe048a7e6b4d134c2b6d2ca61804491d3e4550865927a5
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.661626027Z" level=info msg="Created container fe3fa20495d589684bd2f91c7878b046b51fabad8bd776745873e24df24517d2: kube-system/kube-proxy-mbdks/kube-proxy" id=2884511c-a34f-41e2-afa9-48e4f76f7986 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.662383808Z" level=info msg="Starting container: fe3fa20495d589684bd2f91c7878b046b51fabad8bd776745873e24df24517d2" id=92e424e3-1e78-4b1b-bbe9-1e74711c0d3f name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:51:51 newest-cni-021912 crio[770]: time="2025-11-22T02:51:51.665455405Z" level=info msg="Started container" PID=1621 containerID=fe3fa20495d589684bd2f91c7878b046b51fabad8bd776745873e24df24517d2 description=kube-system/kube-proxy-mbdks/kube-proxy id=92e424e3-1e78-4b1b-bbe9-1e74711c0d3f name=/runtime.v1.RuntimeService/StartContainer sandboxID=b51a8e7dac247f8cc567adf6303a39059d316f7365e3751472c005000955cc12
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
a8bbdcbcecd7c 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 1 second ago Running kindnet-cni 0 9d7080ff71476 kindnet-qlk6r kube-system
fe3fa20495d58 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 1 second ago Running kube-proxy 0 b51a8e7dac247 kube-proxy-mbdks kube-system
070ff4aa6e0cc c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 13 seconds ago Running kube-controller-manager 0 6a8509b0d431f kube-controller-manager-newest-cni-021912 kube-system
fdf23ccf7587a c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 13 seconds ago Running kube-apiserver 0 f910218fcfe63 kube-apiserver-newest-cni-021912 kube-system
d4f8098010cec 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 13 seconds ago Running kube-scheduler 0 902e1f6d87cc3 kube-scheduler-newest-cni-021912 kube-system
71b68440b4966 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 13 seconds ago Running etcd 0 3cd7f5f42e71e etcd-newest-cni-021912 kube-system
==> describe nodes <==
Name: newest-cni-021912
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=newest-cni-021912
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=newest-cni-021912
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:51:43 +0000
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: newest-cni-021912
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:51:45 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:51:45 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:51:45 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:51:45 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sat, 22 Nov 2025 02:51:45 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Addresses:
InternalIP: 192.168.85.2
Hostname: newest-cni-021912
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: d954d443-b3f3-4e41-b175-c9784e49e78e
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.42.0.0/24
PodCIDRs: 10.42.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system etcd-newest-cni-021912 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 8s
kube-system kindnet-qlk6r 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 3s
kube-system kube-apiserver-newest-cni-021912 250m (3%) 0 (0%) 0 (0%) 0 (0%) 8s
kube-system kube-controller-manager-newest-cni-021912 200m (2%) 0 (0%) 0 (0%) 0 (0%) 9s
kube-system kube-proxy-mbdks 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3s
kube-system kube-scheduler-newest-cni-021912 100m (1%) 0 (0%) 0 (0%) 0 (0%) 8s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 100m (1%)
memory 150Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 1s kube-proxy
Normal Starting 14s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 14s (x8 over 14s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 14s (x8 over 14s) kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 14s (x8 over 14s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal Starting 8s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8s kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8s kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8s kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal RegisteredNode 3s node-controller Node newest-cni-021912 event: Registered Node newest-cni-021912 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [71b68440b496664f4a5287258d37269b8cf1fcb1199f9cc88c4175d61c9fe3d5] <==
{"level":"warn","ts":"2025-11-22T02:51:42.046250Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40332","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.057711Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40364","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.068520Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40386","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.082989Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40426","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.100045Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40450","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.110861Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40468","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.124414Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40500","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.135989Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40536","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.148553Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40564","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.163069Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40594","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.170547Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40640","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.180258Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40658","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.189234Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40696","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.198308Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40698","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.210370Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40730","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.221371Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40778","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.229944Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40808","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.238379Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40826","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.247555Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40888","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.256976Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40914","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.272105Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:40982","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.281833Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41010","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.293615Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41030","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.370132Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41164","server-name":"","error":"EOF"}
{"level":"info","ts":"2025-11-22T02:51:53.917247Z","caller":"traceutil/trace.go:172","msg":"trace[1324489349] transaction","detail":"{read_only:false; response_revision:424; number_of_response:1; }","duration":"149.519492ms","start":"2025-11-22T02:51:53.767706Z","end":"2025-11-22T02:51:53.917225Z","steps":["trace[1324489349] 'process raft request' (duration: 149.350761ms)"],"step_count":1}
==> kernel <==
02:51:54 up 1:34, 0 user, load average: 6.33, 4.29, 2.46
Linux newest-cni-021912 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [a8bbdcbcecd7cd7d4eb7307365ea6ff7384dd31d02387fc3322e3a2057a52a82] <==
I1122 02:51:51.942802 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:51.943096 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:51:51.943251 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:51.943270 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:51.943298 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:52Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:52.147368 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:52.147404 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:52.147415 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:52.147526 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:51:52.541074 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:51:52.541109 1 metrics.go:72] Registering metrics
I1122 02:51:52.541182 1 controller.go:711] "Syncing nftables rules"
==> kube-apiserver [fdf23ccf7587a1caf92bd511d2b5b5eafb52740a74b26632415606d1ebe3e497] <==
I1122 02:51:43.037601 1 default_servicecidr_controller.go:166] Creating default ServiceCIDR with CIDRs: [10.96.0.0/12]
I1122 02:51:43.040764 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:43.046612 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:43.047652 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1122 02:51:43.056489 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:43.057232 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:43.099739 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:43.104338 1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
I1122 02:51:43.928629 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1122 02:51:43.935619 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1122 02:51:43.935648 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:44.469002 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:44.507447 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:44.633041 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1122 02:51:44.638540 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I1122 02:51:44.639417 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:51:44.642879 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:51:45.008944 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:45.572698 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:45.582161 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1122 02:51:45.590310 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:51:50.612090 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:50.660447 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1122 02:51:50.962863 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:50.968299 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
==> kube-controller-manager [070ff4aa6e0cc81a24892df6c01b9408eea4b65938e0cd3f09b4955a02bcfa36] <==
I1122 02:51:50.007472 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:51:50.007522 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:51:50.007615 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:51:50.007695 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="newest-cni-021912"
I1122 02:51:50.007744 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:51:50.007987 1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
I1122 02:51:50.008311 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
I1122 02:51:50.008620 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:51:50.009039 1 shared_informer.go:356] "Caches are synced" controller="service account"
I1122 02:51:50.009201 1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
I1122 02:51:50.009562 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:51:50.010008 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:51:50.011559 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:51:50.011720 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:51:50.012859 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:51:50.012884 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:51:50.013564 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
I1122 02:51:50.014845 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:51:50.015320 1 shared_informer.go:356] "Caches are synced" controller="ClusterRoleAggregator"
I1122 02:51:50.019551 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:50.020633 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:51:50.026941 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:51:50.034491 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:50.037743 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:50.040876 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
==> kube-proxy [fe3fa20495d589684bd2f91c7878b046b51fabad8bd776745873e24df24517d2] <==
I1122 02:51:51.704311 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:51.782867 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:51.886250 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:51.886337 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.85.2"]
E1122 02:51:51.886483 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:51.904976 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:51.905049 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:51.910467 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:51.910915 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:51.910934 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:51.912338 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:51.912367 1 config.go:200] "Starting service config controller"
I1122 02:51:51.912380 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:51.912385 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:51.912422 1 config.go:309] "Starting node config controller"
I1122 02:51:51.912432 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:51.912651 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:51.912661 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:52.013403 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:52.013429 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:52.013451 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:51:52.013432 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [d4f8098010cecb2ed25c7a44b5e0a1d1632fcd0d3469d6983b412d757d5d22c6] <==
E1122 02:51:43.033532 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1122 02:51:43.033573 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1122 02:51:43.033654 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1122 02:51:43.033894 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:51:43.033957 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:51:43.034265 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1122 02:51:43.035253 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1122 02:51:43.035339 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:51:43.035413 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1122 02:51:43.035490 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1122 02:51:43.037145 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1122 02:51:43.037309 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:51:43.041303 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1122 02:51:43.041394 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:51:43.855306 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1122 02:51:43.860580 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1122 02:51:43.877238 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1122 02:51:43.896481 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1122 02:51:43.932434 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1122 02:51:44.053879 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1122 02:51:44.091395 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1122 02:51:44.161920 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1122 02:51:44.218542 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1122 02:51:44.291212 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
I1122 02:51:46.215372 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: E1122 02:51:46.516335 1330 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-controller-manager-newest-cni-021912\" already exists" pod="kube-system/kube-controller-manager-newest-cni-021912"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: E1122 02:51:46.519200 1330 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-scheduler-newest-cni-021912\" already exists" pod="kube-system/kube-scheduler-newest-cni-021912"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: I1122 02:51:46.519319 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-newest-cni-021912" podStartSLOduration=1.519300362 podStartE2EDuration="1.519300362s" podCreationTimestamp="2025-11-22 02:51:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:46.502359557 +0000 UTC m=+1.127499807" watchObservedRunningTime="2025-11-22 02:51:46.519300362 +0000 UTC m=+1.144440614"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: E1122 02:51:46.520627 1330 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-apiserver-newest-cni-021912\" already exists" pod="kube-system/kube-apiserver-newest-cni-021912"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: I1122 02:51:46.531253 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-newest-cni-021912" podStartSLOduration=1.531235812 podStartE2EDuration="1.531235812s" podCreationTimestamp="2025-11-22 02:51:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:46.520357022 +0000 UTC m=+1.145497282" watchObservedRunningTime="2025-11-22 02:51:46.531235812 +0000 UTC m=+1.156376060"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: I1122 02:51:46.543337 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-newest-cni-021912" podStartSLOduration=2.54329339 podStartE2EDuration="2.54329339s" podCreationTimestamp="2025-11-22 02:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:46.532727928 +0000 UTC m=+1.157868179" watchObservedRunningTime="2025-11-22 02:51:46.54329339 +0000 UTC m=+1.168433643"
Nov 22 02:51:46 newest-cni-021912 kubelet[1330]: I1122 02:51:46.556091 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/etcd-newest-cni-021912" podStartSLOduration=1.556072716 podStartE2EDuration="1.556072716s" podCreationTimestamp="2025-11-22 02:51:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:46.543180776 +0000 UTC m=+1.168321026" watchObservedRunningTime="2025-11-22 02:51:46.556072716 +0000 UTC m=+1.181212969"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.032673 1330 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.033590 1330 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698501 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-kube-proxy\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698540 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwstn\" (UniqueName: \"kubernetes.io/projected/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-kube-api-access-gwstn\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698556 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-xtables-lock\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698573 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-xtables-lock\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698644 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-lib-modules\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698710 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-lib-modules\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698736 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-cni-cfg\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: I1122 02:51:50.698770 1330 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxtvr\" (UniqueName: \"kubernetes.io/projected/52fa3624-6a80-451b-bf42-5ca57e756651-kube-api-access-dxtvr\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806628 1330 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806666 1330 projected.go:196] Error preparing data for projected volume kube-api-access-dxtvr for pod kube-system/kindnet-qlk6r: configmap "kube-root-ca.crt" not found
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806758 1330 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52fa3624-6a80-451b-bf42-5ca57e756651-kube-api-access-dxtvr podName:52fa3624-6a80-451b-bf42-5ca57e756651 nodeName:}" failed. No retries permitted until 2025-11-22 02:51:51.306722976 +0000 UTC m=+5.931863222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dxtvr" (UniqueName: "kubernetes.io/projected/52fa3624-6a80-451b-bf42-5ca57e756651-kube-api-access-dxtvr") pod "kindnet-qlk6r" (UID: "52fa3624-6a80-451b-bf42-5ca57e756651") : configmap "kube-root-ca.crt" not found
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806761 1330 projected.go:291] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806803 1330 projected.go:196] Error preparing data for projected volume kube-api-access-gwstn for pod kube-system/kube-proxy-mbdks: configmap "kube-root-ca.crt" not found
Nov 22 02:51:50 newest-cni-021912 kubelet[1330]: E1122 02:51:50.806863 1330 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-kube-api-access-gwstn podName:4e0b545b-1f11-4ab9-98e8-61a533e7ef4a nodeName:}" failed. No retries permitted until 2025-11-22 02:51:51.306842526 +0000 UTC m=+5.931982771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwstn" (UniqueName: "kubernetes.io/projected/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-kube-api-access-gwstn") pod "kube-proxy-mbdks" (UID: "4e0b545b-1f11-4ab9-98e8-61a533e7ef4a") : configmap "kube-root-ca.crt" not found
Nov 22 02:51:52 newest-cni-021912 kubelet[1330]: I1122 02:51:52.553166 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-mbdks" podStartSLOduration=2.553142182 podStartE2EDuration="2.553142182s" podCreationTimestamp="2025-11-22 02:51:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:52.536981245 +0000 UTC m=+7.162121497" watchObservedRunningTime="2025-11-22 02:51:52.553142182 +0000 UTC m=+7.178282435"
Nov 22 02:51:53 newest-cni-021912 kubelet[1330]: I1122 02:51:53.919104 1330 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-qlk6r" podStartSLOduration=3.919078831 podStartE2EDuration="3.919078831s" podCreationTimestamp="2025-11-22 02:51:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-22 02:51:52.553287622 +0000 UTC m=+7.178427883" watchObservedRunningTime="2025-11-22 02:51:53.919078831 +0000 UTC m=+8.544219084"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-021912 -n newest-cni-021912
E1122 02:51:54.865154 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:54.871535 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:54.882960 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:54.904341 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:54.945819 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:55.028207 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:269: (dbg) Run: kubectl --context newest-cni-021912 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: coredns-66bc5c9577-f6gl7 storage-provisioner
helpers_test.go:282: ======> post-mortem[TestStartStop/group/newest-cni/serial/EnableAddonWhileActive]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner
E1122 02:51:55.189676 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner: exit status 1 (61.162342ms)
** stderr **
Error from server (NotFound): pods "coredns-66bc5c9577-f6gl7" not found
Error from server (NotFound): pods "storage-provisioner" not found
** /stderr **
helpers_test.go:287: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (3.05s)
=== RUN TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p newest-cni-021912 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p newest-cni-021912 --alsologtostderr -v=1: exit status 80 (2.322345158s)
-- stdout --
* Pausing node newest-cni-021912 ...
-- /stdout --
** stderr **
I1122 02:52:10.018375 340609 out.go:360] Setting OutFile to fd 1 ...
I1122 02:52:10.018625 340609 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:10.018635 340609 out.go:374] Setting ErrFile to fd 2...
I1122 02:52:10.018640 340609 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:10.018841 340609 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:52:10.019072 340609 out.go:368] Setting JSON to false
I1122 02:52:10.019123 340609 mustload.go:66] Loading cluster: newest-cni-021912
I1122 02:52:10.019438 340609 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:10.019823 340609 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:10.038281 340609 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:10.038546 340609 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:52:10.097781 340609 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:52:10.088401688 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:52:10.098418 340609 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:newest-cni-021912 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true)
wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:52:10.100066 340609 out.go:179] * Pausing node newest-cni-021912 ...
I1122 02:52:10.101030 340609 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:10.101255 340609 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:10.101290 340609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:10.118546 340609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:10.210990 340609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:10.222891 340609 pause.go:52] kubelet running: true
I1122 02:52:10.222977 340609 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:10.362390 340609 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:10.362487 340609 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:10.425580 340609 cri.go:89] found id: "750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696"
I1122 02:52:10.425608 340609 cri.go:89] found id: "b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560"
I1122 02:52:10.425614 340609 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:10.425619 340609 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:10.425623 340609 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:10.425628 340609 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:10.425632 340609 cri.go:89] found id: ""
I1122 02:52:10.425678 340609 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:10.436811 340609 retry.go:31] will retry after 290.456231ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:10Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:10.728364 340609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:10.741304 340609 pause.go:52] kubelet running: false
I1122 02:52:10.741383 340609 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:10.852642 340609 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:10.852742 340609 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:10.928079 340609 cri.go:89] found id: "750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696"
I1122 02:52:10.928106 340609 cri.go:89] found id: "b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560"
I1122 02:52:10.928112 340609 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:10.928117 340609 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:10.928121 340609 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:10.928125 340609 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:10.928129 340609 cri.go:89] found id: ""
I1122 02:52:10.928174 340609 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:10.939878 340609 retry.go:31] will retry after 472.384175ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:10Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:11.413205 340609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:11.426218 340609 pause.go:52] kubelet running: false
I1122 02:52:11.426282 340609 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:11.539593 340609 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:11.539663 340609 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:11.602208 340609 cri.go:89] found id: "750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696"
I1122 02:52:11.602232 340609 cri.go:89] found id: "b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560"
I1122 02:52:11.602236 340609 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:11.602240 340609 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:11.602244 340609 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:11.602249 340609 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:11.602254 340609 cri.go:89] found id: ""
I1122 02:52:11.602298 340609 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:11.613670 340609 retry.go:31] will retry after 456.129077ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:11Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:12.070300 340609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:12.083362 340609 pause.go:52] kubelet running: false
I1122 02:52:12.083410 340609 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:12.195327 340609 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:12.195421 340609 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:12.258085 340609 cri.go:89] found id: "750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696"
I1122 02:52:12.258111 340609 cri.go:89] found id: "b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560"
I1122 02:52:12.258115 340609 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:12.258118 340609 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:12.258121 340609 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:12.258124 340609 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:12.258126 340609 cri.go:89] found id: ""
I1122 02:52:12.258162 340609 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:12.271782 340609 out.go:203]
W1122 02:52:12.272842 340609 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:12Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:12Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:52:12.272857 340609 out.go:285] *
*
W1122 02:52:12.276983 340609 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:52:12.278184 340609 out.go:203]
** /stderr **
start_stop_delete_test.go:309: out/minikube-linux-amd64 pause -p newest-cni-021912 --alsologtostderr -v=1 failed: exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect newest-cni-021912
helpers_test.go:243: (dbg) docker inspect newest-cni-021912:
-- stdout --
[
{
"Id": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"Created": "2025-11-22T02:51:26.422480693Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 338768,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:58.569212357Z",
"FinishedAt": "2025-11-22T02:51:57.69842882Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hostname",
"HostsPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hosts",
"LogPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5-json.log",
"Name": "/newest-cni-021912",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"newest-cni-021912:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "newest-cni-021912",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"LowerDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/merged",
"UpperDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/diff",
"WorkDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "newest-cni-021912",
"Source": "/var/lib/docker/volumes/newest-cni-021912/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "newest-cni-021912",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "newest-cni-021912",
"name.minikube.sigs.k8s.io": "newest-cni-021912",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "ab820e70912c286573871d052de0f9c2d2f09fdacfa36124d60ed15178edc408",
"SandboxKey": "/var/run/docker/netns/ab820e70912c",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33133"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33134"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33137"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33135"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33136"
}
]
},
"Networks": {
"newest-cni-021912": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "4c9c9b0926e76905a707e1cdffdaa6c8fe86b3bf292f05d43e6eac753680ca10",
"EndpointID": "686a210e0c4185ffa01da3ef5c8054b5fc0bdff21992eba13edd94c7e93135ca",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "32:b9:3d:2f:63:6f",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"newest-cni-021912",
"183827e63067"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912: exit status 2 (324.919744ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/newest-cni/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-021912 logs -n 25
helpers_test.go:260: TestStartStop/group/newest-cni/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.601494867Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.60496024Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=d8b96a32-016b-48a8-ba1d-03b87b218e46 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.605315397Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=c4325ae1-1a18-4c74-be9f-6b3d41776e6e name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606339084Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606799592Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606957048Z" level=info msg="Ran pod sandbox 7aebb1051ac4da0eff3dbea14fcf2f8d3f9f812168d3514f3fb9da6023290edd with infra container: kube-system/kube-proxy-mbdks/POD" id=d8b96a32-016b-48a8-ba1d-03b87b218e46 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.607498284Z" level=info msg="Ran pod sandbox bc052942a606d216e6eb2aed5e361bf051c166753019cc4c15dafb2701ecb25b with infra container: kube-system/kindnet-qlk6r/POD" id=c4325ae1-1a18-4c74-be9f-6b3d41776e6e name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.607942415Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=69250cf3-ce4c-470f-bf22-8274fb19bb30 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.608468954Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=56e950b0-405c-41c8-9b28-054f01a614c9 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.608895627Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=dfc44f0d-6912-403f-bd15-bb0b1fc1af5b name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609348759Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=2c26f290-161c-452c-b83e-cb4fd02aabd7 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609820314Z" level=info msg="Creating container: kube-system/kube-proxy-mbdks/kube-proxy" id=6dd47731-670d-42f5-a4d0-b72a3e21fe76 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609970767Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.610305541Z" level=info msg="Creating container: kube-system/kindnet-qlk6r/kindnet-cni" id=fb896775-e637-41d4-b35b-6e0a8afc5661 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.610385598Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.617141427Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.617761016Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.618931318Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.61943558Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.646637452Z" level=info msg="Created container 750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696: kube-system/kindnet-qlk6r/kindnet-cni" id=fb896775-e637-41d4-b35b-6e0a8afc5661 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.647146589Z" level=info msg="Starting container: 750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696" id=3f5fcbd5-20a1-408d-ba34-f3827b5f8d5e name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.648867145Z" level=info msg="Started container" PID=1051 containerID=750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696 description=kube-system/kindnet-qlk6r/kindnet-cni id=3f5fcbd5-20a1-408d-ba34-f3827b5f8d5e name=/runtime.v1.RuntimeService/StartContainer sandboxID=bc052942a606d216e6eb2aed5e361bf051c166753019cc4c15dafb2701ecb25b
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.649636546Z" level=info msg="Created container b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560: kube-system/kube-proxy-mbdks/kube-proxy" id=6dd47731-670d-42f5-a4d0-b72a3e21fe76 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.650157033Z" level=info msg="Starting container: b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560" id=d2a7b4ba-3dbd-46cc-afb7-3d5b2b8e955f name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.653387209Z" level=info msg="Started container" PID=1050 containerID=b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560 description=kube-system/kube-proxy-mbdks/kube-proxy id=d2a7b4ba-3dbd-46cc-afb7-3d5b2b8e955f name=/runtime.v1.RuntimeService/StartContainer sandboxID=7aebb1051ac4da0eff3dbea14fcf2f8d3f9f812168d3514f3fb9da6023290edd
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
750c5580edff2 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 4 seconds ago Running kindnet-cni 1 bc052942a606d kindnet-qlk6r kube-system
b85943a107e0d fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 4 seconds ago Running kube-proxy 1 7aebb1051ac4d kube-proxy-mbdks kube-system
1def51ecc6a61 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 7 seconds ago Running kube-scheduler 1 6339b09a93592 kube-scheduler-newest-cni-021912 kube-system
91390a510a9b0 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 7 seconds ago Running kube-controller-manager 1 243c0d9cd7b52 kube-controller-manager-newest-cni-021912 kube-system
6ef479412c61c c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 7 seconds ago Running kube-apiserver 1 55f02d648da36 kube-apiserver-newest-cni-021912 kube-system
f16d03ae2337a 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 7 seconds ago Running etcd 1 b1f000a3e88a8 etcd-newest-cni-021912 kube-system
==> describe nodes <==
Name: newest-cni-021912
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=newest-cni-021912
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=newest-cni-021912
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:51:43 +0000
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: newest-cni-021912
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Addresses:
InternalIP: 192.168.85.2
Hostname: newest-cni-021912
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: d954d443-b3f3-4e41-b175-c9784e49e78e
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.42.0.0/24
PodCIDRs: 10.42.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system etcd-newest-cni-021912 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 28s
kube-system kindnet-qlk6r 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 23s
kube-system kube-apiserver-newest-cni-021912 250m (3%) 0 (0%) 0 (0%) 0 (0%) 28s
kube-system kube-controller-manager-newest-cni-021912 200m (2%) 0 (0%) 0 (0%) 0 (0%) 29s
kube-system kube-proxy-mbdks 0 (0%) 0 (0%) 0 (0%) 0 (0%) 23s
kube-system kube-scheduler-newest-cni-021912 100m (1%) 0 (0%) 0 (0%) 0 (0%) 28s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 100m (1%)
memory 150Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 21s kube-proxy
Normal Starting 4s kube-proxy
Normal Starting 34s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 34s (x8 over 34s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 34s (x8 over 34s) kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 34s (x8 over 34s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 28s kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 28s kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 28s kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal Starting 28s kubelet Starting kubelet.
Normal RegisteredNode 23s node-controller Node newest-cni-021912 event: Registered Node newest-cni-021912 in Controller
Normal Starting 9s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8s (x8 over 8s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8s (x8 over 8s) kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8s (x8 over 8s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal RegisteredNode 2s node-controller Node newest-cni-021912 event: Registered Node newest-cni-021912 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001] <==
{"level":"warn","ts":"2025-11-22T02:52:07.310577Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56060","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.319152Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56078","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.325008Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56094","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.330977Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56112","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.337114Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56128","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.344563Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56148","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.350377Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56176","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.356401Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56190","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.362562Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56218","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.370019Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56224","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.376756Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56228","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.385409Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56246","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.391139Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56264","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.396754Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56282","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.402829Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56306","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.408666Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56320","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.414350Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56336","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.419987Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56358","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.425837Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56380","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.432269Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56402","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.438308Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56416","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.454692Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56432","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.460362Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56444","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.466182Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56470","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.511499Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56494","server-name":"","error":"EOF"}
==> kernel <==
02:52:13 up 1:34, 0 user, load average: 5.67, 4.24, 2.48
Linux newest-cni-021912 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696] <==
I1122 02:52:08.810062 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:52:08.810310 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:52:08.810438 1 main.go:148] setting mtu 1500 for CNI
I1122 02:52:08.810456 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:52:08.810486 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:52:09Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:52:09.107240 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:52:09.107311 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:52:09.107323 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:52:09.107476 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:52:09.508194 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:52:09.508226 1 metrics.go:72] Registering metrics
I1122 02:52:09.508284 1 controller.go:711] "Syncing nftables rules"
==> kube-apiserver [6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8] <==
I1122 02:52:07.981486 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:52:07.981503 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:52:07.981574 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:52:07.981584 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:52:07.981597 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:52:07.981777 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:52:07.981872 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:52:07.981656 1 cache.go:39] Caches are synced for RemoteAvailability controller
I1122 02:52:07.985632 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:52:07.988881 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
E1122 02:52:07.989476 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I1122 02:52:08.011546 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:52:08.200337 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:52:08.200337 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:52:08.232235 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:52:08.258491 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:52:08.275318 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:52:08.281949 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:52:08.330336 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.110.99.136"}
I1122 02:52:08.346642 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.98.129.7"}
I1122 02:52:08.885219 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:52:11.521455 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:52:11.770790 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:52:11.872886 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:52:11.921627 1 controller.go:667] quota admission added evaluator for: replicasets.apps
==> kube-controller-manager [91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf] <==
I1122 02:52:11.282024 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:52:11.318080 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:52:11.319192 1 shared_informer.go:356] "Caches are synced" controller="disruption"
I1122 02:52:11.319220 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:52:11.319224 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:52:11.319246 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:52:11.319327 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:52:11.319330 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:52:11.319375 1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
I1122 02:52:11.319427 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="newest-cni-021912"
I1122 02:52:11.319503 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:52:11.319505 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:52:11.321549 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:52:11.321690 1 shared_informer.go:356] "Caches are synced" controller="PVC protection"
I1122 02:52:11.322841 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:52:11.324095 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:52:11.326836 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:52:11.328931 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:52:11.331222 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:52:11.333379 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:52:11.334552 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:52:11.339860 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:52:11.339874 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:52:11.339880 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:52:11.342204 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
==> kube-proxy [b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560] <==
I1122 02:52:08.685862 1 server_linux.go:53] "Using iptables proxy"
I1122 02:52:08.764505 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:52:08.865529 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:52:08.865565 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.85.2"]
E1122 02:52:08.865638 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:52:08.884714 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:52:08.884773 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:52:08.890646 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:52:08.891194 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:52:08.891239 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:52:08.892919 1 config.go:200] "Starting service config controller"
I1122 02:52:08.892949 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:52:08.892993 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:52:08.893017 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:52:08.893074 1 config.go:309] "Starting node config controller"
I1122 02:52:08.893085 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:52:08.892921 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:52:08.893134 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:52:08.993164 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:52:08.993267 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:52:08.993274 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:52:08.993307 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4] <==
I1122 02:52:06.411797 1 serving.go:386] Generated self-signed cert in-memory
W1122 02:52:07.905728 1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:52:07.905763 1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:52:07.905781 1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:52:07.905791 1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:52:07.943108 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:52:07.943139 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:52:07.945116 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:52:07.945160 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:52:07.945447 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:52:07.945708 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:52:08.045731 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030478 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030723 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030956 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: I1122 02:52:07.896076 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: I1122 02:52:07.993850 677 apiserver.go:52] "Watching apiserver"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002328 677 kubelet_node_status.go:124] "Node was previously registered" node="newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002418 677 kubelet_node_status.go:78] "Successfully registered node" node="newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002448 677 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.003347 677 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.009323 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-controller-manager-newest-cni-021912\" already exists" pod="kube-system/kube-controller-manager-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.009353 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.014788 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-scheduler-newest-cni-021912\" already exists" pod="kube-system/kube-scheduler-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.014955 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/etcd-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.020696 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"etcd-newest-cni-021912\" already exists" pod="kube-system/etcd-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.020725 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.028174 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-apiserver-newest-cni-021912\" already exists" pod="kube-system/kube-apiserver-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.096879 677 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197613 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-cni-cfg\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197649 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-xtables-lock\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197671 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-lib-modules\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197735 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-xtables-lock\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197778 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-lib-modules\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:10 newest-cni-021912 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:10 newest-cni-021912 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:10 newest-cni-021912 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-021912 -n newest-cni-021912
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-021912 -n newest-cni-021912: exit status 2 (314.202675ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context newest-cni-021912 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc
helpers_test.go:282: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc: exit status 1 (58.579329ms)
** stderr **
Error from server (NotFound): pods "coredns-66bc5c9577-f6gl7" not found
Error from server (NotFound): pods "storage-provisioner" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-6ffb444bf9-9bwfd" not found
Error from server (NotFound): pods "kubernetes-dashboard-855c9754f9-nsrmc" not found
** /stderr **
helpers_test.go:287: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect newest-cni-021912
helpers_test.go:243: (dbg) docker inspect newest-cni-021912:
-- stdout --
[
{
"Id": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"Created": "2025-11-22T02:51:26.422480693Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 338768,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:58.569212357Z",
"FinishedAt": "2025-11-22T02:51:57.69842882Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hostname",
"HostsPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/hosts",
"LogPath": "/var/lib/docker/containers/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5/183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5-json.log",
"Name": "/newest-cni-021912",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"newest-cni-021912:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "newest-cni-021912",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "183827e63067b3df34828828311456b4bb999a7b83bb9f9a07b98d5c029381b5",
"LowerDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/merged",
"UpperDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/diff",
"WorkDir": "/var/lib/docker/overlay2/341c43fdf8195ff71c783f580706970699274c5713d60a1c05b5e76bca41b24b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "newest-cni-021912",
"Source": "/var/lib/docker/volumes/newest-cni-021912/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "newest-cni-021912",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "newest-cni-021912",
"name.minikube.sigs.k8s.io": "newest-cni-021912",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "ab820e70912c286573871d052de0f9c2d2f09fdacfa36124d60ed15178edc408",
"SandboxKey": "/var/run/docker/netns/ab820e70912c",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33133"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33134"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33137"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33135"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33136"
}
]
},
"Networks": {
"newest-cni-021912": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "4c9c9b0926e76905a707e1cdffdaa6c8fe86b3bf292f05d43e6eac753680ca10",
"EndpointID": "686a210e0c4185ffa01da3ef5c8054b5fc0bdff21992eba13edd94c7e93135ca",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"MacAddress": "32:b9:3d:2f:63:6f",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"newest-cni-021912",
"183827e63067"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912: exit status 2 (311.026988ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/newest-cni/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-021912 logs -n 25
helpers_test.go:260: TestStartStop/group/newest-cni/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ addons │ enable metrics-server -p embed-certs-153115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ stop │ -p embed-certs-153115 --alsologtostderr -v=3 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
W1122 02:52:09.532516 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:12.033636 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
==> CRI-O <==
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.601494867Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.60496024Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=d8b96a32-016b-48a8-ba1d-03b87b218e46 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.605315397Z" level=warning msg="Skipping invalid sysctl specified by config {net.ipv4.ip_unprivileged_port_start 0}: \"net.ipv4.ip_unprivileged_port_start\" not allowed with host net enabled" id=c4325ae1-1a18-4c74-be9f-6b3d41776e6e name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606339084Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606799592Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.606957048Z" level=info msg="Ran pod sandbox 7aebb1051ac4da0eff3dbea14fcf2f8d3f9f812168d3514f3fb9da6023290edd with infra container: kube-system/kube-proxy-mbdks/POD" id=d8b96a32-016b-48a8-ba1d-03b87b218e46 name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.607498284Z" level=info msg="Ran pod sandbox bc052942a606d216e6eb2aed5e361bf051c166753019cc4c15dafb2701ecb25b with infra container: kube-system/kindnet-qlk6r/POD" id=c4325ae1-1a18-4c74-be9f-6b3d41776e6e name=/runtime.v1.RuntimeService/RunPodSandbox
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.607942415Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=69250cf3-ce4c-470f-bf22-8274fb19bb30 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.608468954Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=56e950b0-405c-41c8-9b28-054f01a614c9 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.608895627Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.1" id=dfc44f0d-6912-403f-bd15-bb0b1fc1af5b name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609348759Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250512-df8de77b" id=2c26f290-161c-452c-b83e-cb4fd02aabd7 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609820314Z" level=info msg="Creating container: kube-system/kube-proxy-mbdks/kube-proxy" id=6dd47731-670d-42f5-a4d0-b72a3e21fe76 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.609970767Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.610305541Z" level=info msg="Creating container: kube-system/kindnet-qlk6r/kindnet-cni" id=fb896775-e637-41d4-b35b-6e0a8afc5661 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.610385598Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.617141427Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.617761016Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.618931318Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.61943558Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.646637452Z" level=info msg="Created container 750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696: kube-system/kindnet-qlk6r/kindnet-cni" id=fb896775-e637-41d4-b35b-6e0a8afc5661 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.647146589Z" level=info msg="Starting container: 750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696" id=3f5fcbd5-20a1-408d-ba34-f3827b5f8d5e name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.648867145Z" level=info msg="Started container" PID=1051 containerID=750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696 description=kube-system/kindnet-qlk6r/kindnet-cni id=3f5fcbd5-20a1-408d-ba34-f3827b5f8d5e name=/runtime.v1.RuntimeService/StartContainer sandboxID=bc052942a606d216e6eb2aed5e361bf051c166753019cc4c15dafb2701ecb25b
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.649636546Z" level=info msg="Created container b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560: kube-system/kube-proxy-mbdks/kube-proxy" id=6dd47731-670d-42f5-a4d0-b72a3e21fe76 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.650157033Z" level=info msg="Starting container: b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560" id=d2a7b4ba-3dbd-46cc-afb7-3d5b2b8e955f name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 newest-cni-021912 crio[523]: time="2025-11-22T02:52:08.653387209Z" level=info msg="Started container" PID=1050 containerID=b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560 description=kube-system/kube-proxy-mbdks/kube-proxy id=d2a7b4ba-3dbd-46cc-afb7-3d5b2b8e955f name=/runtime.v1.RuntimeService/StartContainer sandboxID=7aebb1051ac4da0eff3dbea14fcf2f8d3f9f812168d3514f3fb9da6023290edd
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
750c5580edff2 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 6 seconds ago Running kindnet-cni 1 bc052942a606d kindnet-qlk6r kube-system
b85943a107e0d fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 6 seconds ago Running kube-proxy 1 7aebb1051ac4d kube-proxy-mbdks kube-system
1def51ecc6a61 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 9 seconds ago Running kube-scheduler 1 6339b09a93592 kube-scheduler-newest-cni-021912 kube-system
91390a510a9b0 c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 9 seconds ago Running kube-controller-manager 1 243c0d9cd7b52 kube-controller-manager-newest-cni-021912 kube-system
6ef479412c61c c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 9 seconds ago Running kube-apiserver 1 55f02d648da36 kube-apiserver-newest-cni-021912 kube-system
f16d03ae2337a 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 9 seconds ago Running etcd 1 b1f000a3e88a8 etcd-newest-cni-021912 kube-system
==> describe nodes <==
Name: newest-cni-021912
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=newest-cni-021912
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=newest-cni-021912
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_51_46_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:51:43 +0000
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: newest-cni-021912
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sat, 22 Nov 2025 02:52:08 +0000 Sat, 22 Nov 2025 02:51:39 +0000 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Addresses:
InternalIP: 192.168.85.2
Hostname: newest-cni-021912
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: d954d443-b3f3-4e41-b175-c9784e49e78e
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.42.0.0/24
PodCIDRs: 10.42.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system etcd-newest-cni-021912 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 29s
kube-system kindnet-qlk6r 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 24s
kube-system kube-apiserver-newest-cni-021912 250m (3%) 0 (0%) 0 (0%) 0 (0%) 29s
kube-system kube-controller-manager-newest-cni-021912 200m (2%) 0 (0%) 0 (0%) 0 (0%) 30s
kube-system kube-proxy-mbdks 0 (0%) 0 (0%) 0 (0%) 0 (0%) 24s
kube-system kube-scheduler-newest-cni-021912 100m (1%) 0 (0%) 0 (0%) 0 (0%) 29s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 100m (1%)
memory 150Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 23s kube-proxy
Normal Starting 6s kube-proxy
Normal Starting 35s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 35s (x8 over 35s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 35s (x8 over 35s) kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 35s (x8 over 35s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 29s kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 29s kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 29s kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal Starting 29s kubelet Starting kubelet.
Normal RegisteredNode 24s node-controller Node newest-cni-021912 event: Registered Node newest-cni-021912 in Controller
Normal Starting 10s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9s (x8 over 9s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9s (x8 over 9s) kubelet Node newest-cni-021912 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9s (x8 over 9s) kubelet Node newest-cni-021912 status is now: NodeHasSufficientPID
Normal RegisteredNode 3s node-controller Node newest-cni-021912 event: Registered Node newest-cni-021912 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001] <==
{"level":"warn","ts":"2025-11-22T02:52:07.310577Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56060","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.319152Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56078","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.325008Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56094","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.330977Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56112","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.337114Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56128","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.344563Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56148","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.350377Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56176","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.356401Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56190","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.362562Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56218","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.370019Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56224","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.376756Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56228","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.385409Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56246","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.391139Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56264","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.396754Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56282","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.402829Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56306","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.408666Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56320","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.414350Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56336","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.419987Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56358","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.425837Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56380","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.432269Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56402","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.438308Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56416","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.454692Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56432","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.460362Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56444","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.466182Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56470","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:52:07.511499Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56494","server-name":"","error":"EOF"}
==> kernel <==
02:52:15 up 1:34, 0 user, load average: 5.70, 4.27, 2.50
Linux newest-cni-021912 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [750c5580edff2ba46b4dbf12ac233def50845ccfd7385c37eb4eff0f3e4c1696] <==
I1122 02:52:08.810062 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:52:08.810310 1 main.go:139] hostIP = 192.168.85.2
podIP = 192.168.85.2
I1122 02:52:08.810438 1 main.go:148] setting mtu 1500 for CNI
I1122 02:52:08.810456 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:52:08.810486 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:52:09Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:52:09.107240 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:52:09.107311 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:52:09.107323 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:52:09.107476 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:52:09.508194 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:52:09.508226 1 metrics.go:72] Registering metrics
I1122 02:52:09.508284 1 controller.go:711] "Syncing nftables rules"
==> kube-apiserver [6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8] <==
I1122 02:52:07.981486 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:52:07.981503 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:52:07.981574 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:52:07.981584 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:52:07.981597 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:52:07.981777 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:52:07.981872 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:52:07.981656 1 cache.go:39] Caches are synced for RemoteAvailability controller
I1122 02:52:07.985632 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:52:07.988881 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
E1122 02:52:07.989476 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I1122 02:52:08.011546 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:52:08.200337 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:52:08.200337 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:52:08.232235 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:52:08.258491 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:52:08.275318 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:52:08.281949 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:52:08.330336 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.110.99.136"}
I1122 02:52:08.346642 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.98.129.7"}
I1122 02:52:08.885219 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:52:11.521455 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:52:11.770790 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:52:11.872886 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1122 02:52:11.921627 1 controller.go:667] quota admission added evaluator for: replicasets.apps
==> kube-controller-manager [91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf] <==
I1122 02:52:11.282024 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:52:11.318080 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:52:11.319192 1 shared_informer.go:356] "Caches are synced" controller="disruption"
I1122 02:52:11.319220 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:52:11.319224 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:52:11.319246 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:52:11.319327 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:52:11.319330 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:52:11.319375 1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
I1122 02:52:11.319427 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="newest-cni-021912"
I1122 02:52:11.319503 1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
I1122 02:52:11.319505 1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
I1122 02:52:11.321549 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1122 02:52:11.321690 1 shared_informer.go:356] "Caches are synced" controller="PVC protection"
I1122 02:52:11.322841 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:52:11.324095 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:52:11.326836 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:52:11.328931 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1122 02:52:11.331222 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:52:11.333379 1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
I1122 02:52:11.334552 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:52:11.339860 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:52:11.339874 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:52:11.339880 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:52:11.342204 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
==> kube-proxy [b85943a107e0dd620797554da56c29aed9af78579c933266abebd466a337c560] <==
I1122 02:52:08.685862 1 server_linux.go:53] "Using iptables proxy"
I1122 02:52:08.764505 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:52:08.865529 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:52:08.865565 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.85.2"]
E1122 02:52:08.865638 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:52:08.884714 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:52:08.884773 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:52:08.890646 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:52:08.891194 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:52:08.891239 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:52:08.892919 1 config.go:200] "Starting service config controller"
I1122 02:52:08.892949 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:52:08.892993 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:52:08.893017 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:52:08.893074 1 config.go:309] "Starting node config controller"
I1122 02:52:08.893085 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:52:08.892921 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:52:08.893134 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:52:08.993164 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:52:08.993267 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:52:08.993274 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:52:08.993307 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4] <==
I1122 02:52:06.411797 1 serving.go:386] Generated self-signed cert in-memory
W1122 02:52:07.905728 1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:52:07.905763 1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:52:07.905781 1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:52:07.905791 1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:52:07.943108 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:52:07.943139 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:52:07.945116 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:52:07.945160 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:52:07.945447 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:52:07.945708 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:52:08.045731 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030478 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030723 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: E1122 02:52:07.030956 677 kubelet.go:3215] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"newest-cni-021912\" not found" node="newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: I1122 02:52:07.896076 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-newest-cni-021912"
Nov 22 02:52:07 newest-cni-021912 kubelet[677]: I1122 02:52:07.993850 677 apiserver.go:52] "Watching apiserver"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002328 677 kubelet_node_status.go:124] "Node was previously registered" node="newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002418 677 kubelet_node_status.go:78] "Successfully registered node" node="newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.002448 677 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.003347 677 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.009323 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-controller-manager-newest-cni-021912\" already exists" pod="kube-system/kube-controller-manager-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.009353 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.014788 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-scheduler-newest-cni-021912\" already exists" pod="kube-system/kube-scheduler-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.014955 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/etcd-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.020696 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"etcd-newest-cni-021912\" already exists" pod="kube-system/etcd-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.020725 677 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: E1122 02:52:08.028174 677 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-apiserver-newest-cni-021912\" already exists" pod="kube-system/kube-apiserver-newest-cni-021912"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.096879 677 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197613 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-cni-cfg\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197649 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-xtables-lock\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197671 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e0b545b-1f11-4ab9-98e8-61a533e7ef4a-lib-modules\") pod \"kube-proxy-mbdks\" (UID: \"4e0b545b-1f11-4ab9-98e8-61a533e7ef4a\") " pod="kube-system/kube-proxy-mbdks"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197735 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-xtables-lock\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:08 newest-cni-021912 kubelet[677]: I1122 02:52:08.197778 677 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52fa3624-6a80-451b-bf42-5ca57e756651-lib-modules\") pod \"kindnet-qlk6r\" (UID: \"52fa3624-6a80-451b-bf42-5ca57e756651\") " pod="kube-system/kindnet-qlk6r"
Nov 22 02:52:10 newest-cni-021912 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:10 newest-cni-021912 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:10 newest-cni-021912 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-021912 -n newest-cni-021912
E1122 02:52:15.360509 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-021912 -n newest-cni-021912: exit status 2 (316.630289ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context newest-cni-021912 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc
helpers_test.go:282: ======> post-mortem[TestStartStop/group/newest-cni/serial/Pause]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc: exit status 1 (58.721437ms)
** stderr **
Error from server (NotFound): pods "coredns-66bc5c9577-f6gl7" not found
Error from server (NotFound): pods "storage-provisioner" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-6ffb444bf9-9bwfd" not found
Error from server (NotFound): pods "kubernetes-dashboard-855c9754f9-nsrmc" not found
** /stderr **
helpers_test.go:287: kubectl --context newest-cni-021912 describe pod coredns-66bc5c9577-f6gl7 storage-provisioner dashboard-metrics-scraper-6ffb444bf9-9bwfd kubernetes-dashboard-855c9754f9-nsrmc: exit status 1
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (5.68s)
=== RUN TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p embed-certs-153115 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p embed-certs-153115 --alsologtostderr -v=1: exit status 80 (1.708921517s)
-- stdout --
* Pausing node embed-certs-153115 ...
-- /stdout --
** stderr **
I1122 02:52:24.167114 343027 out.go:360] Setting OutFile to fd 1 ...
I1122 02:52:24.167432 343027 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:24.167440 343027 out.go:374] Setting ErrFile to fd 2...
I1122 02:52:24.167446 343027 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:24.167706 343027 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:52:24.167999 343027 out.go:368] Setting JSON to false
I1122 02:52:24.168025 343027 mustload.go:66] Loading cluster: embed-certs-153115
I1122 02:52:24.168451 343027 config.go:182] Loaded profile config "embed-certs-153115": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:24.169022 343027 cli_runner.go:164] Run: docker container inspect embed-certs-153115 --format={{.State.Status}}
I1122 02:52:24.186987 343027 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:52:24.187192 343027 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:52:24.241355 343027 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:false NGoroutines:65 SystemTime:2025-11-22 02:52:24.232394492 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:52:24.242001 343027 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:embed-certs-153115 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true
) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:52:24.243873 343027 out.go:179] * Pausing node embed-certs-153115 ...
I1122 02:52:24.244835 343027 host.go:66] Checking if "embed-certs-153115" exists ...
I1122 02:52:24.245094 343027 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:24.245131 343027 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-153115
I1122 02:52:24.263004 343027 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33123 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/embed-certs-153115/id_rsa Username:docker}
I1122 02:52:24.354890 343027 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:24.366277 343027 pause.go:52] kubelet running: true
I1122 02:52:24.366350 343027 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:24.522620 343027 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:24.522762 343027 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:24.587292 343027 cri.go:89] found id: "e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd"
I1122 02:52:24.587318 343027 cri.go:89] found id: "35dc950e09d9caeb4de44a797d4243fdf8950d10633f32775e3f2ceef89f4dd2"
I1122 02:52:24.587325 343027 cri.go:89] found id: "eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c"
I1122 02:52:24.587330 343027 cri.go:89] found id: "cd1ff58e0e0ba2291ac73f5c49675e47e94936bbe1638e95cc34e3bfef9ebb11"
I1122 02:52:24.587335 343027 cri.go:89] found id: "b08debeb93e8bce3f47857a595b3c6fe36adca7a5bd3006b4c8d0d9294970c22"
I1122 02:52:24.587340 343027 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:52:24.587344 343027 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:52:24.587349 343027 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:52:24.587353 343027 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:52:24.587359 343027 cri.go:89] found id: "9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
I1122 02:52:24.587362 343027 cri.go:89] found id: "9b41dfa722ebf16a4b19f2b8018e4b894b5daa169f0937ca6395a28a520bdaff"
I1122 02:52:24.587364 343027 cri.go:89] found id: ""
I1122 02:52:24.587398 343027 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:24.598825 343027 retry.go:31] will retry after 273.17044ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:24Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:24.872257 343027 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:24.884806 343027 pause.go:52] kubelet running: false
I1122 02:52:24.884849 343027 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:25.023712 343027 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:25.023797 343027 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:25.085808 343027 cri.go:89] found id: "e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd"
I1122 02:52:25.085836 343027 cri.go:89] found id: "35dc950e09d9caeb4de44a797d4243fdf8950d10633f32775e3f2ceef89f4dd2"
I1122 02:52:25.085841 343027 cri.go:89] found id: "eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c"
I1122 02:52:25.085846 343027 cri.go:89] found id: "cd1ff58e0e0ba2291ac73f5c49675e47e94936bbe1638e95cc34e3bfef9ebb11"
I1122 02:52:25.085850 343027 cri.go:89] found id: "b08debeb93e8bce3f47857a595b3c6fe36adca7a5bd3006b4c8d0d9294970c22"
I1122 02:52:25.085855 343027 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:52:25.085859 343027 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:52:25.085870 343027 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:52:25.085873 343027 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:52:25.085878 343027 cri.go:89] found id: "9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
I1122 02:52:25.085882 343027 cri.go:89] found id: "9b41dfa722ebf16a4b19f2b8018e4b894b5daa169f0937ca6395a28a520bdaff"
I1122 02:52:25.085885 343027 cri.go:89] found id: ""
I1122 02:52:25.085952 343027 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:25.097109 343027 retry.go:31] will retry after 485.242562ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:25Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:25.582788 343027 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:25.595373 343027 pause.go:52] kubelet running: false
I1122 02:52:25.595432 343027 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:25.733661 343027 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:25.733735 343027 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:25.798666 343027 cri.go:89] found id: "e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd"
I1122 02:52:25.798689 343027 cri.go:89] found id: "35dc950e09d9caeb4de44a797d4243fdf8950d10633f32775e3f2ceef89f4dd2"
I1122 02:52:25.798699 343027 cri.go:89] found id: "eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c"
I1122 02:52:25.798705 343027 cri.go:89] found id: "cd1ff58e0e0ba2291ac73f5c49675e47e94936bbe1638e95cc34e3bfef9ebb11"
I1122 02:52:25.798709 343027 cri.go:89] found id: "b08debeb93e8bce3f47857a595b3c6fe36adca7a5bd3006b4c8d0d9294970c22"
I1122 02:52:25.798714 343027 cri.go:89] found id: "d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964"
I1122 02:52:25.798718 343027 cri.go:89] found id: "9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11"
I1122 02:52:25.798722 343027 cri.go:89] found id: "04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce"
I1122 02:52:25.798725 343027 cri.go:89] found id: "47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee"
I1122 02:52:25.798734 343027 cri.go:89] found id: "9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
I1122 02:52:25.798738 343027 cri.go:89] found id: "9b41dfa722ebf16a4b19f2b8018e4b894b5daa169f0937ca6395a28a520bdaff"
I1122 02:52:25.798742 343027 cri.go:89] found id: ""
I1122 02:52:25.798789 343027 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:25.811833 343027 out.go:203]
W1122 02:52:25.812820 343027 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:25Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:25Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:52:25.812839 343027 out.go:285] *
*
W1122 02:52:25.817119 343027 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:52:25.818315 343027 out.go:203]
** /stderr **
start_stop_delete_test.go:309: out/minikube-linux-amd64 pause -p embed-certs-153115 --alsologtostderr -v=1 failed: exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect embed-certs-153115
helpers_test.go:243: (dbg) docker inspect embed-certs-153115:
-- stdout --
[
{
"Id": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"Created": "2025-11-22T02:50:16.676230577Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 328375,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:26.698410419Z",
"FinishedAt": "2025-11-22T02:51:23.588068104Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hostname",
"HostsPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hosts",
"LogPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06-json.log",
"Name": "/embed-certs-153115",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"embed-certs-153115:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "embed-certs-153115",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"LowerDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/merged",
"UpperDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/diff",
"WorkDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "embed-certs-153115",
"Source": "/var/lib/docker/volumes/embed-certs-153115/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "embed-certs-153115",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "embed-certs-153115",
"name.minikube.sigs.k8s.io": "embed-certs-153115",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "7288504cefe0eee81924acd2c34bf9e7a2e4dd48d11da566b8ac3c1ce2b0fca0",
"SandboxKey": "/var/run/docker/netns/7288504cefe0",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33123"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33124"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33127"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33125"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33126"
}
]
},
"Networks": {
"embed-certs-153115": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "96385b2a616941eaa4a4f540716b0a7c31f3fc2f2233964a08277eb14959d0b5",
"EndpointID": "725f1b8304966eed99731a8c39dfc4227ccc046ea3acf98c5bac910f58e09768",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"MacAddress": "ca:bd:ab:3d:71:f5",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"embed-certs-153115",
"6f7324ecba93"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115: exit status 2 (306.098714ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-153115 logs -n 25
helpers_test.go:260: TestStartStop/group/embed-certs/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ image │ embed-certs-153115 image list --format=json │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p embed-certs-153115 --alsologtostderr -v=1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
W1122 02:52:09.532516 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:12.033636 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:14.532859 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:16.032562 331164 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:52:16.032585 331164 pod_ready.go:86] duration metric: took 31.505644461s for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.034549 331164 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.038327 331164 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.038348 331164 pod_ready.go:86] duration metric: took 3.779346ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.040260 331164 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.043450 331164 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.043472 331164 pod_ready.go:86] duration metric: took 3.1909ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.045426 331164 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.231368 331164 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.231395 331164 pod_ready.go:86] duration metric: took 185.950836ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.431104 331164 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.830786 331164 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:52:16.830810 331164 pod_ready.go:86] duration metric: took 399.679522ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.030470 331164 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430739 331164 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:17.430770 331164 pod_ready.go:86] duration metric: took 400.273026ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430784 331164 pod_ready.go:40] duration metric: took 32.907664623s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:17.477039 331164 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:17.478852 331164 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.296236343Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=b1720918-f92b-44f3-9fb4-291efbdc4f4c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.297486366Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=3c44904b-f8a5-4c6c-a996-f3dddd43a2fc name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.297632233Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303232173Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303418313Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/ad7a0427f7a57b9a3d90442b7b825870ec82a8ec89a370bcb381148161f3a563/merged/etc/passwd: no such file or directory"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303453205Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/ad7a0427f7a57b9a3d90442b7b825870ec82a8ec89a370bcb381148161f3a563/merged/etc/group: no such file or directory"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303758247Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.334386715Z" level=info msg="Created container e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd: kube-system/storage-provisioner/storage-provisioner" id=3c44904b-f8a5-4c6c-a996-f3dddd43a2fc name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.335031497Z" level=info msg="Starting container: e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd" id=4e9007f4-833b-4da4-81df-c7aeed75ba15 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.337277732Z" level=info msg="Started container" PID=1692 containerID=e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd description=kube-system/storage-provisioner/storage-provisioner id=4e9007f4-833b-4da4-81df-c7aeed75ba15 name=/runtime.v1.RuntimeService/StartContainer sandboxID=032125ba6f389902c01edcc0ca83843a5ee0afdaa1af6e3dc4eec97e7ffa039e
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.958254934Z" level=info msg="CNI monitoring event CREATE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.96236489Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.962392873Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.962413648Z" level=info msg="CNI monitoring event WRITE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967754037Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967776982Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967794931Z" level=info msg="CNI monitoring event WRITE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971033318Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971053561Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971065771Z" level=info msg="CNI monitoring event RENAME \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974492406Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974513769Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974531587Z" level=info msg="CNI monitoring event CREATE \"/etc/cni/net.d/10-kindnet.conflist\" ← \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.978005889Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.978030184Z" level=info msg="Updated default CNI network name to kindnet"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
e49ac1852d81f 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 18 seconds ago Running storage-provisioner 1 032125ba6f389 storage-provisioner kube-system
9c6cdba455c10 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 21 seconds ago Exited dashboard-metrics-scraper 2 f8a9d5ce00125 dashboard-metrics-scraper-6ffb444bf9-zdd9r kubernetes-dashboard
9b41dfa722ebf docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 37 seconds ago Running kubernetes-dashboard 0 3d1e4c9258dca kubernetes-dashboard-855c9754f9-5z5fq kubernetes-dashboard
35dc950e09d9c 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 49 seconds ago Running coredns 0 af177fcd69c40 coredns-66bc5c9577-bq64j kube-system
376eaef90230e 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 49 seconds ago Running busybox 1 c98a9561fff8a busybox default
eb1130fd660e2 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 49 seconds ago Exited storage-provisioner 0 032125ba6f389 storage-provisioner kube-system
cd1ff58e0e0ba fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 49 seconds ago Running kube-proxy 0 2265778885c05 kube-proxy-vw5ph kube-system
b08debeb93e8b 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 49 seconds ago Running kindnet-cni 0 dbde4e187646e kindnet-hpnj7 kube-system
d8f3635eaa563 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 52 seconds ago Running kube-scheduler 0 51faf741a9190 kube-scheduler-embed-certs-153115 kube-system
9f4ba6f676eff c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 52 seconds ago Running kube-controller-manager 0 c554d52465c2d kube-controller-manager-embed-certs-153115 kube-system
04b4f03a38d45 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 52 seconds ago Running kube-apiserver 0 c22b7eeea2918 kube-apiserver-embed-certs-153115 kube-system
47af8ee1edd00 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 52 seconds ago Running etcd 0 81f573816496e etcd-embed-certs-153115 kube-system
==> coredns [35dc950e09d9caeb4de44a797d4243fdf8950d10633f32775e3f2ceef89f4dd2] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 3e2243e8b9e7116f563b83b1933f477a68ba9ad4a829ed5d7e54629fb2ce53528b9bc6023030be20be434ad805fd246296dd428c64e9bbef3a70f22b8621f560
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:53368 - 24185 "HINFO IN 2513674298656807895.1398351548112499610. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.896183348s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
==> describe nodes <==
Name: embed-certs-153115
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=embed-certs-153115
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=embed-certs-153115
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_37_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: embed-certs-153115
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:53 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: embed-certs-153115
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 7f0db3f8-f77b-42a1-a17a-928d51866ba3
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 90s
kube-system coredns-66bc5c9577-bq64j 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 104s
kube-system etcd-embed-certs-153115 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 110s
kube-system kindnet-hpnj7 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 105s
kube-system kube-apiserver-embed-certs-153115 250m (3%) 0 (0%) 0 (0%) 0 (0%) 110s
kube-system kube-controller-manager-embed-certs-153115 200m (2%) 0 (0%) 0 (0%) 0 (0%) 110s
kube-system kube-proxy-vw5ph 0 (0%) 0 (0%) 0 (0%) 0 (0%) 105s
kube-system kube-scheduler-embed-certs-153115 100m (1%) 0 (0%) 0 (0%) 0 (0%) 110s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 104s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-zdd9r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 46s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-5z5fq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 46s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 103s kube-proxy
Normal Starting 49s kube-proxy
Normal NodeHasSufficientMemory 110s kubelet Node embed-certs-153115 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 110s kubelet Node embed-certs-153115 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 110s kubelet Node embed-certs-153115 status is now: NodeHasSufficientPID
Normal Starting 110s kubelet Starting kubelet.
Normal RegisteredNode 106s node-controller Node embed-certs-153115 event: Registered Node embed-certs-153115 in Controller
Normal NodeReady 93s kubelet Node embed-certs-153115 status is now: NodeReady
Normal Starting 52s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 52s (x8 over 52s) kubelet Node embed-certs-153115 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 52s (x8 over 52s) kubelet Node embed-certs-153115 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 52s (x8 over 52s) kubelet Node embed-certs-153115 status is now: NodeHasSufficientPID
Normal RegisteredNode 47s node-controller Node embed-certs-153115 event: Registered Node embed-certs-153115 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee] <==
{"level":"warn","ts":"2025-11-22T02:51:35.770033Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56644","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.777043Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56674","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.783448Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56686","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.791693Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56704","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.799535Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56720","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.805565Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56742","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.812618Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56766","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.819738Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56782","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.826827Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56804","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.834783Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56834","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.841286Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56840","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.848940Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56852","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.856227Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56876","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.864332Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56888","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.878090Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56934","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.884887Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56950","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.892255Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56970","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.900601Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56984","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.911400Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56996","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.926700Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57024","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.932546Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57056","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.952801Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57086","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.958407Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57104","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.966084Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57114","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:36.015178Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57132","server-name":"","error":"EOF"}
==> kernel <==
02:52:26 up 1:34, 0 user, load average: 4.90, 4.15, 2.47
Linux embed-certs-153115 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [b08debeb93e8bce3f47857a595b3c6fe36adca7a5bd3006b4c8d0d9294970c22] <==
I1122 02:51:37.712319 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:37.712611 1 main.go:139] hostIP = 192.168.76.2
podIP = 192.168.76.2
I1122 02:51:37.745726 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:37.745762 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:37.745793 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:37Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:37.951666 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:37.951729 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:37.951742 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:37.951933 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
E1122 02:52:07.952882 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://10.96.0.1:443/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Node"
E1122 02:52:07.952887 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Namespace"
E1122 02:52:07.952897 1 reflector.go:200] "Failed to watch" err="failed to list *v1.NetworkPolicy: Get \"https://10.96.0.1:443/apis/networking.k8s.io/v1/networkpolicies?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.NetworkPolicy"
E1122 02:52:07.952957 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Pod: Get \"https://10.96.0.1:443/api/v1/pods?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Pod"
I1122 02:52:09.151956 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:52:09.151991 1 metrics.go:72] Registering metrics
I1122 02:52:09.152072 1 controller.go:711] "Syncing nftables rules"
I1122 02:52:17.957980 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I1122 02:52:17.958020 1 main.go:301] handling current node
==> kube-apiserver [04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce] <==
I1122 02:51:36.489802 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:51:36.489852 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:51:36.489871 1 cache.go:39] Caches are synced for LocalAvailability controller
I1122 02:51:36.490476 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:51:36.490900 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:36.497354 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
I1122 02:51:36.498855 1 shared_informer.go:356] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]"
I1122 02:51:36.498935 1 policy_source.go:240] refreshing policies
I1122 02:51:36.501550 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:36.501593 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:36.510383 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:51:36.510496 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:51:36.527813 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:36.534149 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:36.760606 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:36.788280 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:36.804619 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:36.811266 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:36.817473 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:36.846314 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.111.173.207"}
I1122 02:51:36.854566 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.109.22.132"}
I1122 02:51:37.392397 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:39.913073 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:40.414527 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:51:40.457355 1 controller.go:667] quota admission added evaluator for: endpoints
==> kube-controller-manager [9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11] <==
I1122 02:51:39.834108 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:39.836577 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:51:39.837766 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:51:39.842106 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:51:39.847306 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:39.847355 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:39.847370 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:51:39.853170 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:39.853362 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:51:39.853421 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:39.853811 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:51:39.853884 1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
I1122 02:51:39.854127 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:51:39.855451 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:51:39.855787 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:51:39.856403 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:51:39.860132 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:51:39.860243 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:51:39.860320 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:51:39.860335 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:51:39.860343 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:51:39.861696 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:39.875245 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:39.887445 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:51:39.901857 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
==> kube-proxy [cd1ff58e0e0ba2291ac73f5c49675e47e94936bbe1638e95cc34e3bfef9ebb11] <==
I1122 02:51:37.581547 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:37.651783 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:37.752285 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:37.752320 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.76.2"]
E1122 02:51:37.752425 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:37.770426 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:37.770475 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:37.775369 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:37.775837 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:37.775869 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:37.779189 1 config.go:309] "Starting node config controller"
I1122 02:51:37.779212 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:37.779221 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:37.779325 1 config.go:200] "Starting service config controller"
I1122 02:51:37.779338 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:37.779371 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:37.779377 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:37.779390 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:37.779395 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:37.880350 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:37.880389 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:51:37.880388 1 shared_informer.go:356] "Caches are synced" controller="service config"
==> kube-scheduler [d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964] <==
I1122 02:51:35.745437 1 serving.go:386] Generated self-signed cert in-memory
W1122 02:51:36.411880 1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:51:36.411930 1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:51:36.411945 1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:51:36.411954 1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:51:36.464005 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:36.464044 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:36.477782 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:36.477943 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:36.478248 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:36.479142 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:36.580016 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:51:40 embed-certs-153115 kubelet[716]: I1122 02:51:40.537863 716 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctc9\" (UniqueName: \"kubernetes.io/projected/83509696-aebe-4be6-bbf4-a6e3040f8ae5-kube-api-access-rctc9\") pod \"dashboard-metrics-scraper-6ffb444bf9-zdd9r\" (UID: \"83509696-aebe-4be6-bbf4-a6e3040f8ae5\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r"
Nov 22 02:51:40 embed-certs-153115 kubelet[716]: I1122 02:51:40.900872 716 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Nov 22 02:51:45 embed-certs-153115 kubelet[716]: I1122 02:51:45.223073 716 scope.go:117] "RemoveContainer" containerID="6d6e357c483423b3b9ff48e30ac5a52a9568bcd753ee1a6fad4fe441c2cebf4c"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: I1122 02:51:46.229462 716 scope.go:117] "RemoveContainer" containerID="6d6e357c483423b3b9ff48e30ac5a52a9568bcd753ee1a6fad4fe441c2cebf4c"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: I1122 02:51:46.229853 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: E1122 02:51:46.230142 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:51:47 embed-certs-153115 kubelet[716]: I1122 02:51:47.233658 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:47 embed-certs-153115 kubelet[716]: E1122 02:51:47.233890 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:51:50 embed-certs-153115 kubelet[716]: I1122 02:51:50.881847 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:50 embed-certs-153115 kubelet[716]: E1122 02:51:50.882184 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.165252 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.284386 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.284612 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: E1122 02:52:05.284809 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.294629 716 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-5z5fq" podStartSLOduration=16.656766379 podStartE2EDuration="25.294612037s" podCreationTimestamp="2025-11-22 02:51:40 +0000 UTC" firstStartedPulling="2025-11-22 02:51:40.723985802 +0000 UTC m=+6.656827674" lastFinishedPulling="2025-11-22 02:51:49.361831461 +0000 UTC m=+15.294673332" observedRunningTime="2025-11-22 02:51:50.256900794 +0000 UTC m=+16.189742673" watchObservedRunningTime="2025-11-22 02:52:05.294612037 +0000 UTC m=+31.227453918"
Nov 22 02:52:08 embed-certs-153115 kubelet[716]: I1122 02:52:08.294789 716 scope.go:117] "RemoveContainer" containerID="eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c"
Nov 22 02:52:10 embed-certs-153115 kubelet[716]: I1122 02:52:10.882653 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:10 embed-certs-153115 kubelet[716]: E1122 02:52:10.882868 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:23 embed-certs-153115 kubelet[716]: I1122 02:52:23.164293 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:23 embed-certs-153115 kubelet[716]: E1122 02:52:23.164463 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:24 embed-certs-153115 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:24 embed-certs-153115 kubelet[716]: I1122 02:52:24.507575 716 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
Nov 22 02:52:24 embed-certs-153115 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:24 embed-certs-153115 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:52:24 embed-certs-153115 systemd[1]: kubelet.service: Consumed 1.590s CPU time.
==> kubernetes-dashboard [9b41dfa722ebf16a4b19f2b8018e4b894b5daa169f0937ca6395a28a520bdaff] <==
2025/11/22 02:51:49 Starting overwatch
2025/11/22 02:51:49 Using namespace: kubernetes-dashboard
2025/11/22 02:51:49 Using in-cluster config to connect to apiserver
2025/11/22 02:51:49 Using secret token for csrf signing
2025/11/22 02:51:49 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:49 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:49 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:49 Generating JWE encryption key
2025/11/22 02:51:49 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:49 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:49 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:49 Creating in-cluster Sidecar client
2025/11/22 02:51:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:49 Serving insecurely on HTTP port: 9090
2025/11/22 02:52:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd] <==
I1122 02:52:08.360939 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:52:08.371009 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:52:08.371058 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:52:08.373205 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:11.827588 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:16.087870 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:19.685573 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:22.739274 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.761771 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.766281 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:25.766439 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:52:25.766505 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"84de6baa-3d26-4bd0-914f-b52013e021b0", APIVersion:"v1", ResourceVersion:"630", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c became leader
I1122 02:52:25.766586 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c!
W1122 02:52:25.768696 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.772786 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:25.866816 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c!
==> storage-provisioner [eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c] <==
I1122 02:51:37.537521 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:52:07.543300 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-153115 -n embed-certs-153115: exit status 2 (316.27581ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context embed-certs-153115 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect embed-certs-153115
helpers_test.go:243: (dbg) docker inspect embed-certs-153115:
-- stdout --
[
{
"Id": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"Created": "2025-11-22T02:50:16.676230577Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 328375,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:26.698410419Z",
"FinishedAt": "2025-11-22T02:51:23.588068104Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hostname",
"HostsPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/hosts",
"LogPath": "/var/lib/docker/containers/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06/6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06-json.log",
"Name": "/embed-certs-153115",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"embed-certs-153115:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "embed-certs-153115",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "6f7324ecba937c8dd5e27af1e0d19db7ed50573ed557e11e90a2c77fe4df5c06",
"LowerDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/merged",
"UpperDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/diff",
"WorkDir": "/var/lib/docker/overlay2/f0c35291240eba01381369f3275efa55b3e4e2cc058d034d17eaa4989ef080fe/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "embed-certs-153115",
"Source": "/var/lib/docker/volumes/embed-certs-153115/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "embed-certs-153115",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "embed-certs-153115",
"name.minikube.sigs.k8s.io": "embed-certs-153115",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "7288504cefe0eee81924acd2c34bf9e7a2e4dd48d11da566b8ac3c1ce2b0fca0",
"SandboxKey": "/var/run/docker/netns/7288504cefe0",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33123"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33124"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33127"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33125"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33126"
}
]
},
"Networks": {
"embed-certs-153115": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "96385b2a616941eaa4a4f540716b0a7c31f3fc2f2233964a08277eb14959d0b5",
"EndpointID": "725f1b8304966eed99731a8c39dfc4227ccc046ea3acf98c5bac910f58e09768",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"MacAddress": "ca:bd:ab:3d:71:f5",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"embed-certs-153115",
"6f7324ecba93"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115: exit status 2 (309.860394ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-153115 logs -n 25
E1122 02:52:27.917937 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:260: TestStartStop/group/embed-certs/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ image │ old-k8s-version-169878 image list --format=json │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p old-k8s-version-169878 --alsologtostderr -v=1 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ addons │ enable metrics-server -p default-k8s-diff-port-714134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ image │ embed-certs-153115 image list --format=json │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p embed-certs-153115 --alsologtostderr -v=1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
W1122 02:52:09.532516 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:12.033636 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:14.532859 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:16.032562 331164 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:52:16.032585 331164 pod_ready.go:86] duration metric: took 31.505644461s for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.034549 331164 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.038327 331164 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.038348 331164 pod_ready.go:86] duration metric: took 3.779346ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.040260 331164 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.043450 331164 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.043472 331164 pod_ready.go:86] duration metric: took 3.1909ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.045426 331164 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.231368 331164 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.231395 331164 pod_ready.go:86] duration metric: took 185.950836ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.431104 331164 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.830786 331164 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:52:16.830810 331164 pod_ready.go:86] duration metric: took 399.679522ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.030470 331164 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430739 331164 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:17.430770 331164 pod_ready.go:86] duration metric: took 400.273026ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430784 331164 pod_ready.go:40] duration metric: took 32.907664623s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:17.477039 331164 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:17.478852 331164 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.296236343Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=b1720918-f92b-44f3-9fb4-291efbdc4f4c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.297486366Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=3c44904b-f8a5-4c6c-a996-f3dddd43a2fc name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.297632233Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303232173Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303418313Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/ad7a0427f7a57b9a3d90442b7b825870ec82a8ec89a370bcb381148161f3a563/merged/etc/passwd: no such file or directory"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303453205Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/ad7a0427f7a57b9a3d90442b7b825870ec82a8ec89a370bcb381148161f3a563/merged/etc/group: no such file or directory"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.303758247Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.334386715Z" level=info msg="Created container e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd: kube-system/storage-provisioner/storage-provisioner" id=3c44904b-f8a5-4c6c-a996-f3dddd43a2fc name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.335031497Z" level=info msg="Starting container: e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd" id=4e9007f4-833b-4da4-81df-c7aeed75ba15 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:08 embed-certs-153115 crio[561]: time="2025-11-22T02:52:08.337277732Z" level=info msg="Started container" PID=1692 containerID=e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd description=kube-system/storage-provisioner/storage-provisioner id=4e9007f4-833b-4da4-81df-c7aeed75ba15 name=/runtime.v1.RuntimeService/StartContainer sandboxID=032125ba6f389902c01edcc0ca83843a5ee0afdaa1af6e3dc4eec97e7ffa039e
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.958254934Z" level=info msg="CNI monitoring event CREATE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.96236489Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.962392873Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.962413648Z" level=info msg="CNI monitoring event WRITE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967754037Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967776982Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.967794931Z" level=info msg="CNI monitoring event WRITE \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971033318Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971053561Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.971065771Z" level=info msg="CNI monitoring event RENAME \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974492406Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974513769Z" level=info msg="Updated default CNI network name to kindnet"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.974531587Z" level=info msg="CNI monitoring event CREATE \"/etc/cni/net.d/10-kindnet.conflist\" ← \"/etc/cni/net.d/10-kindnet.conflist.temp\""
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.978005889Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
Nov 22 02:52:17 embed-certs-153115 crio[561]: time="2025-11-22T02:52:17.978030184Z" level=info msg="Updated default CNI network name to kindnet"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
e49ac1852d81f 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 20 seconds ago Running storage-provisioner 1 032125ba6f389 storage-provisioner kube-system
9c6cdba455c10 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 23 seconds ago Exited dashboard-metrics-scraper 2 f8a9d5ce00125 dashboard-metrics-scraper-6ffb444bf9-zdd9r kubernetes-dashboard
9b41dfa722ebf docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 39 seconds ago Running kubernetes-dashboard 0 3d1e4c9258dca kubernetes-dashboard-855c9754f9-5z5fq kubernetes-dashboard
35dc950e09d9c 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 50 seconds ago Running coredns 0 af177fcd69c40 coredns-66bc5c9577-bq64j kube-system
376eaef90230e 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 50 seconds ago Running busybox 1 c98a9561fff8a busybox default
eb1130fd660e2 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 50 seconds ago Exited storage-provisioner 0 032125ba6f389 storage-provisioner kube-system
cd1ff58e0e0ba fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 50 seconds ago Running kube-proxy 0 2265778885c05 kube-proxy-vw5ph kube-system
b08debeb93e8b 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 50 seconds ago Running kindnet-cni 0 dbde4e187646e kindnet-hpnj7 kube-system
d8f3635eaa563 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 53 seconds ago Running kube-scheduler 0 51faf741a9190 kube-scheduler-embed-certs-153115 kube-system
9f4ba6f676eff c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 53 seconds ago Running kube-controller-manager 0 c554d52465c2d kube-controller-manager-embed-certs-153115 kube-system
04b4f03a38d45 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 53 seconds ago Running kube-apiserver 0 c22b7eeea2918 kube-apiserver-embed-certs-153115 kube-system
47af8ee1edd00 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 53 seconds ago Running etcd 0 81f573816496e etcd-embed-certs-153115 kube-system
==> coredns [35dc950e09d9caeb4de44a797d4243fdf8950d10633f32775e3f2ceef89f4dd2] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 3e2243e8b9e7116f563b83b1933f477a68ba9ad4a829ed5d7e54629fb2ce53528b9bc6023030be20be434ad805fd246296dd428c64e9bbef3a70f22b8621f560
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:53368 - 24185 "HINFO IN 2513674298656807895.1398351548112499610. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.896183348s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
==> describe nodes <==
Name: embed-certs-153115
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=embed-certs-153115
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=embed-certs-153115
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_37_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: embed-certs-153115
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:32 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:52:06 +0000 Sat, 22 Nov 2025 02:50:53 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: embed-certs-153115
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 7f0db3f8-f77b-42a1-a17a-928d51866ba3
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 92s
kube-system coredns-66bc5c9577-bq64j 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 106s
kube-system etcd-embed-certs-153115 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 112s
kube-system kindnet-hpnj7 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 107s
kube-system kube-apiserver-embed-certs-153115 250m (3%) 0 (0%) 0 (0%) 0 (0%) 112s
kube-system kube-controller-manager-embed-certs-153115 200m (2%) 0 (0%) 0 (0%) 0 (0%) 112s
kube-system kube-proxy-vw5ph 0 (0%) 0 (0%) 0 (0%) 0 (0%) 107s
kube-system kube-scheduler-embed-certs-153115 100m (1%) 0 (0%) 0 (0%) 0 (0%) 112s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 106s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-zdd9r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 48s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-5z5fq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 48s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 105s kube-proxy
Normal Starting 50s kube-proxy
Normal NodeHasSufficientMemory 112s kubelet Node embed-certs-153115 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 112s kubelet Node embed-certs-153115 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 112s kubelet Node embed-certs-153115 status is now: NodeHasSufficientPID
Normal Starting 112s kubelet Starting kubelet.
Normal RegisteredNode 108s node-controller Node embed-certs-153115 event: Registered Node embed-certs-153115 in Controller
Normal NodeReady 95s kubelet Node embed-certs-153115 status is now: NodeReady
Normal Starting 54s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 54s (x8 over 54s) kubelet Node embed-certs-153115 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 54s (x8 over 54s) kubelet Node embed-certs-153115 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 54s (x8 over 54s) kubelet Node embed-certs-153115 status is now: NodeHasSufficientPID
Normal RegisteredNode 49s node-controller Node embed-certs-153115 event: Registered Node embed-certs-153115 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [47af8ee1edd00997a7756f0dc90843a387364dafadcf08419e958be0ed9696ee] <==
{"level":"warn","ts":"2025-11-22T02:51:35.770033Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56644","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.777043Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56674","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.783448Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56686","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.791693Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56704","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.799535Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56720","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.805565Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56742","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.812618Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56766","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.819738Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56782","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.826827Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56804","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.834783Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56834","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.841286Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56840","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.848940Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56852","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.856227Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56876","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.864332Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56888","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.878090Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56934","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.884887Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56950","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.892255Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56970","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.900601Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56984","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.911400Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:56996","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.926700Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57024","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.932546Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57056","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.952801Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57086","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.958407Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57104","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:35.966084Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57114","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:36.015178Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:57132","server-name":"","error":"EOF"}
==> kernel <==
02:52:28 up 1:34, 0 user, load average: 4.90, 4.15, 2.47
Linux embed-certs-153115 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [b08debeb93e8bce3f47857a595b3c6fe36adca7a5bd3006b4c8d0d9294970c22] <==
I1122 02:51:37.712319 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:37.712611 1 main.go:139] hostIP = 192.168.76.2
podIP = 192.168.76.2
I1122 02:51:37.745726 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:37.745762 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:37.745793 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:37Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:37.951666 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:37.951729 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:37.951742 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:37.951933 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
E1122 02:52:07.952882 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://10.96.0.1:443/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Node"
E1122 02:52:07.952887 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Namespace"
E1122 02:52:07.952897 1 reflector.go:200] "Failed to watch" err="failed to list *v1.NetworkPolicy: Get \"https://10.96.0.1:443/apis/networking.k8s.io/v1/networkpolicies?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.NetworkPolicy"
E1122 02:52:07.952957 1 reflector.go:200] "Failed to watch" err="failed to list *v1.Pod: Get \"https://10.96.0.1:443/api/v1/pods?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Pod"
I1122 02:52:09.151956 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:52:09.151991 1 metrics.go:72] Registering metrics
I1122 02:52:09.152072 1 controller.go:711] "Syncing nftables rules"
I1122 02:52:17.957980 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I1122 02:52:17.958020 1 main.go:301] handling current node
I1122 02:52:27.961044 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I1122 02:52:27.961085 1 main.go:301] handling current node
==> kube-apiserver [04b4f03a38d450f06aa326d7e699c49e080ea65c35c1e0f31b82cdc8cc8b11ce] <==
I1122 02:51:36.489802 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:51:36.489852 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:51:36.489871 1 cache.go:39] Caches are synced for LocalAvailability controller
I1122 02:51:36.490476 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1122 02:51:36.490900 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:36.497354 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
I1122 02:51:36.498855 1 shared_informer.go:356] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]"
I1122 02:51:36.498935 1 policy_source.go:240] refreshing policies
I1122 02:51:36.501550 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:36.501593 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:36.510383 1 shared_informer.go:356] "Caches are synced" controller="cluster_authentication_trust_controller"
I1122 02:51:36.510496 1 shared_informer.go:356] "Caches are synced" controller="configmaps"
I1122 02:51:36.527813 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:36.534149 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:36.760606 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:36.788280 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:36.804619 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:36.811266 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:36.817473 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:36.846314 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.111.173.207"}
I1122 02:51:36.854566 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.109.22.132"}
I1122 02:51:37.392397 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:39.913073 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:40.414527 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1122 02:51:40.457355 1 controller.go:667] quota admission added evaluator for: endpoints
==> kube-controller-manager [9f4ba6f676eff9b75a13f399af17727557f5fe4cf84ae561f915d55cf5b26e11] <==
I1122 02:51:39.834108 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:39.836577 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:51:39.837766 1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
I1122 02:51:39.842106 1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
I1122 02:51:39.847306 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:39.847355 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:39.847370 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
I1122 02:51:39.853170 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:39.853362 1 shared_informer.go:356] "Caches are synced" controller="endpoint"
I1122 02:51:39.853421 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:39.853811 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1122 02:51:39.853884 1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
I1122 02:51:39.854127 1 shared_informer.go:356] "Caches are synced" controller="persistent volume"
I1122 02:51:39.855451 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:51:39.855787 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:51:39.856403 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:51:39.860132 1 shared_informer.go:356] "Caches are synced" controller="node"
I1122 02:51:39.860243 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1122 02:51:39.860320 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1122 02:51:39.860335 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1122 02:51:39.860343 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1122 02:51:39.861696 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:39.875245 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:39.887445 1 shared_informer.go:356] "Caches are synced" controller="cronjob"
I1122 02:51:39.901857 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
==> kube-proxy [cd1ff58e0e0ba2291ac73f5c49675e47e94936bbe1638e95cc34e3bfef9ebb11] <==
I1122 02:51:37.581547 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:37.651783 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:37.752285 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:37.752320 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.76.2"]
E1122 02:51:37.752425 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:37.770426 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:37.770475 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:37.775369 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:37.775837 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:37.775869 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:37.779189 1 config.go:309] "Starting node config controller"
I1122 02:51:37.779212 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:37.779221 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:37.779325 1 config.go:200] "Starting service config controller"
I1122 02:51:37.779338 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:37.779371 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:37.779377 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:37.779390 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:37.779395 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:37.880350 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:37.880389 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1122 02:51:37.880388 1 shared_informer.go:356] "Caches are synced" controller="service config"
==> kube-scheduler [d8f3635eaa563a2c0b3d7f5bf53b311c84b8ff659481b08cbcde444e6b8a2964] <==
I1122 02:51:35.745437 1 serving.go:386] Generated self-signed cert in-memory
W1122 02:51:36.411880 1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1122 02:51:36.411930 1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1122 02:51:36.411945 1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
W1122 02:51:36.411954 1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1122 02:51:36.464005 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:36.464044 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:36.477782 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:36.477943 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:36.478248 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:36.479142 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:36.580016 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 22 02:51:40 embed-certs-153115 kubelet[716]: I1122 02:51:40.537863 716 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctc9\" (UniqueName: \"kubernetes.io/projected/83509696-aebe-4be6-bbf4-a6e3040f8ae5-kube-api-access-rctc9\") pod \"dashboard-metrics-scraper-6ffb444bf9-zdd9r\" (UID: \"83509696-aebe-4be6-bbf4-a6e3040f8ae5\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r"
Nov 22 02:51:40 embed-certs-153115 kubelet[716]: I1122 02:51:40.900872 716 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Nov 22 02:51:45 embed-certs-153115 kubelet[716]: I1122 02:51:45.223073 716 scope.go:117] "RemoveContainer" containerID="6d6e357c483423b3b9ff48e30ac5a52a9568bcd753ee1a6fad4fe441c2cebf4c"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: I1122 02:51:46.229462 716 scope.go:117] "RemoveContainer" containerID="6d6e357c483423b3b9ff48e30ac5a52a9568bcd753ee1a6fad4fe441c2cebf4c"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: I1122 02:51:46.229853 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:46 embed-certs-153115 kubelet[716]: E1122 02:51:46.230142 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:51:47 embed-certs-153115 kubelet[716]: I1122 02:51:47.233658 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:47 embed-certs-153115 kubelet[716]: E1122 02:51:47.233890 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:51:50 embed-certs-153115 kubelet[716]: I1122 02:51:50.881847 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:51:50 embed-certs-153115 kubelet[716]: E1122 02:51:50.882184 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.165252 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.284386 716 scope.go:117] "RemoveContainer" containerID="9242e08bbb150d22d83ca658950d3589df8154b10961a50c2cfedc3e1db017ce"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.284612 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: E1122 02:52:05.284809 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:05 embed-certs-153115 kubelet[716]: I1122 02:52:05.294629 716 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-5z5fq" podStartSLOduration=16.656766379 podStartE2EDuration="25.294612037s" podCreationTimestamp="2025-11-22 02:51:40 +0000 UTC" firstStartedPulling="2025-11-22 02:51:40.723985802 +0000 UTC m=+6.656827674" lastFinishedPulling="2025-11-22 02:51:49.361831461 +0000 UTC m=+15.294673332" observedRunningTime="2025-11-22 02:51:50.256900794 +0000 UTC m=+16.189742673" watchObservedRunningTime="2025-11-22 02:52:05.294612037 +0000 UTC m=+31.227453918"
Nov 22 02:52:08 embed-certs-153115 kubelet[716]: I1122 02:52:08.294789 716 scope.go:117] "RemoveContainer" containerID="eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c"
Nov 22 02:52:10 embed-certs-153115 kubelet[716]: I1122 02:52:10.882653 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:10 embed-certs-153115 kubelet[716]: E1122 02:52:10.882868 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:23 embed-certs-153115 kubelet[716]: I1122 02:52:23.164293 716 scope.go:117] "RemoveContainer" containerID="9c6cdba455c10e8541de91efce1b5cb22028fc4e1d7d4368240e6555e87a082a"
Nov 22 02:52:23 embed-certs-153115 kubelet[716]: E1122 02:52:23.164463 716 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-zdd9r_kubernetes-dashboard(83509696-aebe-4be6-bbf4-a6e3040f8ae5)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-zdd9r" podUID="83509696-aebe-4be6-bbf4-a6e3040f8ae5"
Nov 22 02:52:24 embed-certs-153115 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:24 embed-certs-153115 kubelet[716]: I1122 02:52:24.507575 716 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
Nov 22 02:52:24 embed-certs-153115 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:24 embed-certs-153115 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:52:24 embed-certs-153115 systemd[1]: kubelet.service: Consumed 1.590s CPU time.
==> kubernetes-dashboard [9b41dfa722ebf16a4b19f2b8018e4b894b5daa169f0937ca6395a28a520bdaff] <==
2025/11/22 02:51:49 Starting overwatch
2025/11/22 02:51:49 Using namespace: kubernetes-dashboard
2025/11/22 02:51:49 Using in-cluster config to connect to apiserver
2025/11/22 02:51:49 Using secret token for csrf signing
2025/11/22 02:51:49 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:49 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:49 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:49 Generating JWE encryption key
2025/11/22 02:51:49 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:49 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:49 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:49 Creating in-cluster Sidecar client
2025/11/22 02:51:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:49 Serving insecurely on HTTP port: 9090
2025/11/22 02:52:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [e49ac1852d81f540ddc4862e58f61139369c7a0ed2d71f6d635e0a790db575fd] <==
I1122 02:52:08.360939 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:52:08.371009 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:52:08.371058 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:52:08.373205 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:11.827588 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:16.087870 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:19.685573 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:22.739274 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.761771 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.766281 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:25.766439 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:52:25.766505 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"84de6baa-3d26-4bd0-914f-b52013e021b0", APIVersion:"v1", ResourceVersion:"630", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c became leader
I1122 02:52:25.766586 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c!
W1122 02:52:25.768696 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:25.772786 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:25.866816 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-153115_5538c658-1f3b-4dac-8f77-9cc6fdda838c!
W1122 02:52:27.775205 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:27.779372 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
==> storage-provisioner [eb1130fd660e28aa1e6ea7691adf39c053c4034bec202731f566d8a3c4a3571c] <==
I1122 02:51:37.537521 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:52:07.543300 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-153115 -n embed-certs-153115
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-153115 -n embed-certs-153115: exit status 2 (333.410936ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context embed-certs-153115 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (5.15s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p default-k8s-diff-port-714134 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p default-k8s-diff-port-714134 --alsologtostderr -v=1: exit status 80 (1.877263843s)
-- stdout --
* Pausing node default-k8s-diff-port-714134 ...
-- /stdout --
** stderr **
I1122 02:52:29.214369 344637 out.go:360] Setting OutFile to fd 1 ...
I1122 02:52:29.214486 344637 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:29.214498 344637 out.go:374] Setting ErrFile to fd 2...
I1122 02:52:29.214504 344637 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:52:29.214763 344637 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:52:29.215013 344637 out.go:368] Setting JSON to false
I1122 02:52:29.215058 344637 mustload.go:66] Loading cluster: default-k8s-diff-port-714134
I1122 02:52:29.215379 344637 config.go:182] Loaded profile config "default-k8s-diff-port-714134": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:29.215807 344637 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-714134 --format={{.State.Status}}
I1122 02:52:29.234260 344637 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:52:29.234503 344637 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:52:29.294529 344637 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:false NGoroutines:65 SystemTime:2025-11-22 02:52:29.283554454 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:52:29.295130 344637 pause.go:60] "namespaces" [kube-system kubernetes-dashboard istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-pause-interval:1m0s auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-coredns-log:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-
cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) gpus: ha:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.37.0-1763503576-21924/minikube-v1.37.0-1763503576-21924-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.37.0-1763503576-21924-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qe
mu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string: mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:default-k8s-diff-port-714134 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 skip-audit:%!s(bool=false) socket-vmnet-client-path: socket-vmnet-path: ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s
(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
I1122 02:52:29.297618 344637 out.go:179] * Pausing node default-k8s-diff-port-714134 ...
I1122 02:52:29.298591 344637 host.go:66] Checking if "default-k8s-diff-port-714134" exists ...
I1122 02:52:29.298859 344637 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:29.298900 344637 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-714134
I1122 02:52:29.317257 344637 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/default-k8s-diff-port-714134/id_rsa Username:docker}
I1122 02:52:29.411219 344637 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:29.422781 344637 pause.go:52] kubelet running: true
I1122 02:52:29.422841 344637 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:29.582864 344637 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:29.582963 344637 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:29.646890 344637 cri.go:89] found id: "38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7"
I1122 02:52:29.646937 344637 cri.go:89] found id: "e52c3464cd88737582502c6aa61fc3e5abbb9af05034a43040177afcb2dbb5d1"
I1122 02:52:29.646944 344637 cri.go:89] found id: "fa9c797804b364958ce3838ea057a935bde8cc983a6e23742cbdad2dc97cc42e"
I1122 02:52:29.646947 344637 cri.go:89] found id: "76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf"
I1122 02:52:29.646962 344637 cri.go:89] found id: "539c479ff8c96b953de1d8017ffac77d2315ad00672fc123e3dadd7eec3b0a29"
I1122 02:52:29.646970 344637 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:52:29.646972 344637 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:52:29.646975 344637 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:52:29.646978 344637 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:52:29.646984 344637 cri.go:89] found id: "9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855"
I1122 02:52:29.646987 344637 cri.go:89] found id: "65c643dd5c669e49c5e116235f7eaaf31e7a28872397cc3f7a7d5cb97557a30e"
I1122 02:52:29.646990 344637 cri.go:89] found id: ""
I1122 02:52:29.647024 344637 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:29.658154 344637 retry.go:31] will retry after 366.658412ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:29Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:30.025775 344637 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:30.038114 344637 pause.go:52] kubelet running: false
I1122 02:52:30.038166 344637 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:30.168855 344637 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:30.168968 344637 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:30.232162 344637 cri.go:89] found id: "38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7"
I1122 02:52:30.232190 344637 cri.go:89] found id: "e52c3464cd88737582502c6aa61fc3e5abbb9af05034a43040177afcb2dbb5d1"
I1122 02:52:30.232196 344637 cri.go:89] found id: "fa9c797804b364958ce3838ea057a935bde8cc983a6e23742cbdad2dc97cc42e"
I1122 02:52:30.232201 344637 cri.go:89] found id: "76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf"
I1122 02:52:30.232205 344637 cri.go:89] found id: "539c479ff8c96b953de1d8017ffac77d2315ad00672fc123e3dadd7eec3b0a29"
I1122 02:52:30.232210 344637 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:52:30.232215 344637 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:52:30.232219 344637 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:52:30.232224 344637 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:52:30.232238 344637 cri.go:89] found id: "9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855"
I1122 02:52:30.232246 344637 cri.go:89] found id: "65c643dd5c669e49c5e116235f7eaaf31e7a28872397cc3f7a7d5cb97557a30e"
I1122 02:52:30.232250 344637 cri.go:89] found id: ""
I1122 02:52:30.232286 344637 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:30.243197 344637 retry.go:31] will retry after 547.382707ms: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:30Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:30.790943 344637 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:52:30.803286 344637 pause.go:52] kubelet running: false
I1122 02:52:30.803345 344637 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet
I1122 02:52:30.946713 344637 cri.go:54] listing CRI containers in root : {State:running Name: Namespaces:[kube-system kubernetes-dashboard istio-operator]}
I1122 02:52:30.946792 344637 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
I1122 02:52:31.009253 344637 cri.go:89] found id: "38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7"
I1122 02:52:31.009276 344637 cri.go:89] found id: "e52c3464cd88737582502c6aa61fc3e5abbb9af05034a43040177afcb2dbb5d1"
I1122 02:52:31.009282 344637 cri.go:89] found id: "fa9c797804b364958ce3838ea057a935bde8cc983a6e23742cbdad2dc97cc42e"
I1122 02:52:31.009287 344637 cri.go:89] found id: "76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf"
I1122 02:52:31.009291 344637 cri.go:89] found id: "539c479ff8c96b953de1d8017ffac77d2315ad00672fc123e3dadd7eec3b0a29"
I1122 02:52:31.009296 344637 cri.go:89] found id: "03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4"
I1122 02:52:31.009301 344637 cri.go:89] found id: "23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068"
I1122 02:52:31.009305 344637 cri.go:89] found id: "aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc"
I1122 02:52:31.009309 344637 cri.go:89] found id: "a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851"
I1122 02:52:31.009326 344637 cri.go:89] found id: "9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855"
I1122 02:52:31.009334 344637 cri.go:89] found id: "65c643dd5c669e49c5e116235f7eaaf31e7a28872397cc3f7a7d5cb97557a30e"
I1122 02:52:31.009339 344637 cri.go:89] found id: ""
I1122 02:52:31.009379 344637 ssh_runner.go:195] Run: sudo runc list -f json
I1122 02:52:31.022569 344637 out.go:203]
W1122 02:52:31.023662 344637 out.go:285] X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:31Z" level=error msg="open /run/runc: no such file or directory"
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:31Z" level=error msg="open /run/runc: no such file or directory"
W1122 02:52:31.023677 344637 out.go:285] *
*
W1122 02:52:31.027720 344637 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 02:52:31.028923 344637 out.go:203]
** /stderr **
start_stop_delete_test.go:309: out/minikube-linux-amd64 pause -p default-k8s-diff-port-714134 --alsologtostderr -v=1 failed: exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect default-k8s-diff-port-714134
helpers_test.go:243: (dbg) docker inspect default-k8s-diff-port-714134:
-- stdout --
[
{
"Id": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"Created": "2025-11-22T02:50:31.741901438Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 331458,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:34.070063123Z",
"FinishedAt": "2025-11-22T02:51:32.701586578Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hostname",
"HostsPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hosts",
"LogPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8-json.log",
"Name": "/default-k8s-diff-port-714134",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"default-k8s-diff-port-714134:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "default-k8s-diff-port-714134",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"LowerDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/merged",
"UpperDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/diff",
"WorkDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "default-k8s-diff-port-714134",
"Source": "/var/lib/docker/volumes/default-k8s-diff-port-714134/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "default-k8s-diff-port-714134",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8444/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"name.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "5739c701c7df30b5321c6906481af9061881740295c772e101bfbe99a504c7b4",
"SandboxKey": "/var/run/docker/netns/5739c701c7df",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33128"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33129"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33132"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33130"
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33131"
}
]
},
"Networks": {
"default-k8s-diff-port-714134": {
"IPAMConfig": {
"IPv4Address": "192.168.94.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "1451805a580c7a9f0fd8e60ea19dcbce5f50443c1da7f0f14ca30139c5b28efb",
"EndpointID": "d8e9f5c89ef60d0b94c5f12ece46352f60760bcf7f209c1fc7f8c7f3aada35df",
"Gateway": "192.168.94.1",
"IPAddress": "192.168.94.2",
"MacAddress": "ae:1a:71:f1:cb:45",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"default-k8s-diff-port-714134",
"0ce4a57beec5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134: exit status 2 (323.994824ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 logs -n 25: (1.038514962s)
helpers_test.go:260: TestStartStop/group/default-k8s-diff-port/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ stop │ -p default-k8s-diff-port-714134 --alsologtostderr -v=3 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ image │ embed-certs-153115 image list --format=json │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p embed-certs-153115 --alsologtostderr -v=1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ image │ default-k8s-diff-port-714134 image list --format=json │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p default-k8s-diff-port-714134 --alsologtostderr -v=1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p embed-certs-153115 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
W1122 02:52:09.532516 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:12.033636 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:14.532859 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:16.032562 331164 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:52:16.032585 331164 pod_ready.go:86] duration metric: took 31.505644461s for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.034549 331164 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.038327 331164 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.038348 331164 pod_ready.go:86] duration metric: took 3.779346ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.040260 331164 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.043450 331164 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.043472 331164 pod_ready.go:86] duration metric: took 3.1909ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.045426 331164 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.231368 331164 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.231395 331164 pod_ready.go:86] duration metric: took 185.950836ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.431104 331164 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.830786 331164 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:52:16.830810 331164 pod_ready.go:86] duration metric: took 399.679522ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.030470 331164 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430739 331164 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:17.430770 331164 pod_ready.go:86] duration metric: took 400.273026ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430784 331164 pod_ready.go:40] duration metric: took 32.907664623s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:17.477039 331164 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:17.478852 331164 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:52:00 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:00.911155015Z" level=info msg="Started container" PID=1740 containerID=a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper id=f54b227e-48b8-468f-914a-b12cb7b487b1 name=/runtime.v1.RuntimeService/StartContainer sandboxID=3e8bc4f4973dc5da3a6bed03854faa67b4d1e1656c3ca94948a77e47c367e2af
Nov 22 02:52:01 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:01.763769771Z" level=info msg="Removing container: 8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3" id=c948092a-5b80-496e-9da0-2bd9583ddd39 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:01 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:01.773433165Z" level=info msg="Removed container 8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=c948092a-5b80-496e-9da0-2bd9583ddd39 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.796142789Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=c39cf12c-536e-4543-a83c-f6c399990205 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.797139294Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=c9f6fa5b-bc44-43f4-a1e7-8bdffcf643bd name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.798248516Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=3cd95c34-4d64-4f2d-bdbd-b290286e5fd0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.798376734Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803678059Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803862217Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/a0369a141f568b14dcaf379eea5538d6bb985706ac613437b0ab190ec3b21bfc/merged/etc/passwd: no such file or directory"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803897194Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/a0369a141f568b14dcaf379eea5538d6bb985706ac613437b0ab190ec3b21bfc/merged/etc/group: no such file or directory"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.804635107Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.829179812Z" level=info msg="Created container 38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7: kube-system/storage-provisioner/storage-provisioner" id=3cd95c34-4d64-4f2d-bdbd-b290286e5fd0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.829705054Z" level=info msg="Starting container: 38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7" id=2b74175f-12d9-4d21-b9b5-6254cec423d5 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.831379324Z" level=info msg="Started container" PID=1754 containerID=38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7 description=kube-system/storage-provisioner/storage-provisioner id=2b74175f-12d9-4d21-b9b5-6254cec423d5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=4f4d57c8456075a93f5c1a25b7eeba79b6344c68c37051fe638f0121df22cc43
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.64385759Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=175d2adb-493a-46d4-bebe-6d93fafa2e19 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.644839968Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=752f9652-70f8-4bdf-9573-0e2c7cf0417c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.645842689Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=7d1609ca-c099-4502-a129-c25fccca16a7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.645979656Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.651573759Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.652016096Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.680362784Z" level=info msg="Created container 9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=7d1609ca-c099-4502-a129-c25fccca16a7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.680866967Z" level=info msg="Starting container: 9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855" id=1f9b59d8-f3f6-45de-bf95-7cb8ae770f4a name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.682788922Z" level=info msg="Started container" PID=1789 containerID=9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper id=1f9b59d8-f3f6-45de-bf95-7cb8ae770f4a name=/runtime.v1.RuntimeService/StartContainer sandboxID=3e8bc4f4973dc5da3a6bed03854faa67b4d1e1656c3ca94948a77e47c367e2af
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.816368737Z" level=info msg="Removing container: a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd" id=74df69ce-f104-4d11-af8a-090c3deaa784 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.825216094Z" level=info msg="Removed container a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=74df69ce-f104-4d11-af8a-090c3deaa784 name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
9f14d94d46b2c a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 10 seconds ago Exited dashboard-metrics-scraper 3 3e8bc4f4973dc dashboard-metrics-scraper-6ffb444bf9-dsjk4 kubernetes-dashboard
38dbf8959ebdd 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 17 seconds ago Running storage-provisioner 1 4f4d57c845607 storage-provisioner kube-system
65c643dd5c669 docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 37 seconds ago Running kubernetes-dashboard 0 8d0de0523faf7 kubernetes-dashboard-855c9754f9-jdn6w kubernetes-dashboard
e52c3464cd887 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 47 seconds ago Running coredns 0 1a82f061160db coredns-66bc5c9577-d74g5 kube-system
fa9c797804b36 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 48 seconds ago Running kube-proxy 0 ce443c9367705 kube-proxy-ppn8j kube-system
3ca3c93e537df 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 48 seconds ago Running busybox 1 47f1bc23b5771 busybox default
76bb9df11eaef 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 48 seconds ago Exited storage-provisioner 0 4f4d57c845607 storage-provisioner kube-system
539c479ff8c96 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 48 seconds ago Running kindnet-cni 0 fc74e13655f40 kindnet-jzn9z kube-system
03fed611f7c3c 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 50 seconds ago Running kube-scheduler 0 0716cbda8a473 kube-scheduler-default-k8s-diff-port-714134 kube-system
23737742a4f7e c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 50 seconds ago Running kube-controller-manager 0 579cbe7597671 kube-controller-manager-default-k8s-diff-port-714134 kube-system
aa3d75d2612f1 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 50 seconds ago Running kube-apiserver 0 d6adb98fbd5b6 kube-apiserver-default-k8s-diff-port-714134 kube-system
a941b14502e93 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 50 seconds ago Running etcd 0 98389006f5a58 etcd-default-k8s-diff-port-714134 kube-system
==> coredns [e52c3464cd88737582502c6aa61fc3e5abbb9af05034a43040177afcb2dbb5d1] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = c7556d8fdf49c5e32a9077be8cfb9fc6947bb07e663a10d55b192eb63ad1f2bd9793e8e5f5a36fc9abb1957831eec5c997fd9821790e3990ae9531bf41ecea37
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:47054 - 43749 "HINFO IN 163238085682147639.2870288700375267881. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.105112325s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
==> describe nodes <==
Name: default-k8s-diff-port-714134
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-714134
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=default-k8s-diff-port-714134
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_48_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:45 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-714134
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:24 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:51:04 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.94.2
Hostname: default-k8s-diff-port-714134
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 49aec726-6fdc-4995-886e-8625defc71e6
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 85s
kube-system coredns-66bc5c9577-d74g5 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 99s
kube-system etcd-default-k8s-diff-port-714134 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 105s
kube-system kindnet-jzn9z 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 99s
kube-system kube-apiserver-default-k8s-diff-port-714134 250m (3%) 0 (0%) 0 (0%) 0 (0%) 105s
kube-system kube-controller-manager-default-k8s-diff-port-714134 200m (2%) 0 (0%) 0 (0%) 0 (0%) 105s
kube-system kube-proxy-ppn8j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 99s
kube-system kube-scheduler-default-k8s-diff-port-714134 100m (1%) 0 (0%) 0 (0%) 0 (0%) 105s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 98s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-dsjk4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 45s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-jdn6w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 45s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 97s kube-proxy
Normal Starting 47s kube-proxy
Normal Starting 111s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 111s (x8 over 111s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 111s (x8 over 111s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 111s (x8 over 111s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 105s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 105s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 105s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal Starting 105s kubelet Starting kubelet.
Normal RegisteredNode 100s node-controller Node default-k8s-diff-port-714134 event: Registered Node default-k8s-diff-port-714134 in Controller
Normal NodeReady 88s kubelet Node default-k8s-diff-port-714134 status is now: NodeReady
Normal Starting 52s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 52s (x8 over 52s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 52s (x8 over 52s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 52s (x8 over 52s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal RegisteredNode 46s node-controller Node default-k8s-diff-port-714134 event: Registered Node default-k8s-diff-port-714134 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851] <==
{"level":"warn","ts":"2025-11-22T02:51:42.344437Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41142","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.361377Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41154","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.371878Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41182","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.384701Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41194","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.393047Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41222","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.402123Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41232","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.410080Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41242","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.425775Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41256","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.440474Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41274","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.465478Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41294","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.473264Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41306","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.482784Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41326","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.491169Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41338","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.500322Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41352","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.510442Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41370","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.521758Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41396","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.531434Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41416","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.539650Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41444","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.552378Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41452","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.562030Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41476","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.578450Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41492","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.584384Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41494","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.595791Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41504","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.605205Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41508","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.687784Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41536","server-name":"","error":"EOF"}
==> kernel <==
02:52:32 up 1:34, 0 user, load average: 4.83, 4.14, 2.48
Linux default-k8s-diff-port-714134 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [539c479ff8c96b953de1d8017ffac77d2315ad00672fc123e3dadd7eec3b0a29] <==
I1122 02:51:44.228298 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:44.228638 1 main.go:139] hostIP = 192.168.94.2
podIP = 192.168.94.2
I1122 02:51:44.228833 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:44.228851 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:44.228877 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:44Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:44.515451 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:44.515511 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:44.515527 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:44.515671 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:51:44.915956 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:51:44.915985 1 metrics.go:72] Registering metrics
I1122 02:51:44.916041 1 controller.go:711] "Syncing nftables rules"
I1122 02:51:54.516117 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:51:54.516380 1 main.go:301] handling current node
I1122 02:52:04.517093 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:04.517122 1 main.go:301] handling current node
I1122 02:52:14.516276 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:14.516308 1 main.go:301] handling current node
I1122 02:52:24.515660 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:24.515691 1 main.go:301] handling current node
==> kube-apiserver [aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc] <==
I1122 02:51:43.318829 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:51:43.318836 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:51:43.319014 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:43.319103 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:51:43.319111 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:51:43.329232 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
E1122 02:51:43.329365 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I1122 02:51:43.335823 1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
I1122 02:51:43.341156 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:43.341213 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:43.391974 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:43.398012 1 shared_informer.go:356] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]"
I1122 02:51:43.398095 1 policy_source.go:240] refreshing policies
I1122 02:51:43.404737 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:43.715405 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:43.749528 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:43.777217 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:43.783339 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:43.795223 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:43.843379 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.110.140.100"}
I1122 02:51:43.852353 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.97.114.196"}
I1122 02:51:44.221448 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:47.011901 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:47.064279 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:51:47.209472 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-controller-manager [23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068] <==
I1122 02:51:46.651983 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:51:46.654238 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:51:46.654330 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:51:46.654591 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:51:46.655460 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:46.657562 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:46.657627 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:51:46.657633 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:51:46.657656 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:51:46.658742 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:51:46.659885 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:46.659927 1 shared_informer.go:356] "Caches are synced" controller="PVC protection"
I1122 02:51:46.659973 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:51:46.660029 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:51:46.660094 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="default-k8s-diff-port-714134"
I1122 02:51:46.660140 1 node_lifecycle_controller.go:1067] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"
I1122 02:51:46.662238 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:51:46.664385 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:51:46.667359 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:51:46.669520 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:46.683654 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:51:46.705233 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:46.705365 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:46.705423 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:46.705440 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
==> kube-proxy [fa9c797804b364958ce3838ea057a935bde8cc983a6e23742cbdad2dc97cc42e] <==
I1122 02:51:44.081648 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:44.146017 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:44.246974 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:44.247023 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.94.2"]
E1122 02:51:44.247118 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:44.271987 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:44.272058 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:44.279482 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:44.280013 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:44.280195 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:44.282469 1 config.go:200] "Starting service config controller"
I1122 02:51:44.283808 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:44.282756 1 config.go:309] "Starting node config controller"
I1122 02:51:44.283874 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:44.283882 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:44.283235 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:44.283891 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:44.283222 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:44.283938 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:44.384047 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:44.384040 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:51:44.384040 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4] <==
I1122 02:51:42.031077 1 serving.go:386] Generated self-signed cert in-memory
I1122 02:51:44.422680 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:44.422714 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:44.428057 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I1122 02:51:44.428091 1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
I1122 02:51:44.428134 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.428300 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.428143 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.428357 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.428419 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:44.428494 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:44.528875 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.528954 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.528920 1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
==> kubelet <==
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405064 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsdp\" (UniqueName: \"kubernetes.io/projected/dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd-kube-api-access-wvsdp\") pod \"dashboard-metrics-scraper-6ffb444bf9-dsjk4\" (UID: \"dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4"
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405101 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54r75\" (UniqueName: \"kubernetes.io/projected/a3c3fe98-1996-46a2-943e-a5cd63e9d822-kube-api-access-54r75\") pod \"kubernetes-dashboard-855c9754f9-jdn6w\" (UID: \"a3c3fe98-1996-46a2-943e-a5cd63e9d822\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-jdn6w"
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405128 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd-tmp-volume\") pod \"dashboard-metrics-scraper-6ffb444bf9-dsjk4\" (UID: \"dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4"
Nov 22 02:51:50 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:50.731617 717 scope.go:117] "RemoveContainer" containerID="97f63589a6f5bae3726c721bc8850dd7c37385232b54e4fdace60c4fba200430"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:51.736833 717 scope.go:117] "RemoveContainer" containerID="97f63589a6f5bae3726c721bc8850dd7c37385232b54e4fdace60c4fba200430"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:51.737181 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: E1122 02:51:51.737365 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:51:52 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:52.741341 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:51:52 default-k8s-diff-port-714134 kubelet[717]: E1122 02:51:52.741535 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:51:55 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:55.757524 717 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-jdn6w" podStartSLOduration=1.409312836 podStartE2EDuration="8.757502896s" podCreationTimestamp="2025-11-22 02:51:47 +0000 UTC" firstStartedPulling="2025-11-22 02:51:47.622470654 +0000 UTC m=+7.084625260" lastFinishedPulling="2025-11-22 02:51:54.97066072 +0000 UTC m=+14.432815320" observedRunningTime="2025-11-22 02:51:55.756923804 +0000 UTC m=+15.219078418" watchObservedRunningTime="2025-11-22 02:51:55.757502896 +0000 UTC m=+15.219657507"
Nov 22 02:52:00 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:00.869739 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:01.762433 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:01.762731 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:01.762949 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:10 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:10.870508 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:10 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:10.870738 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:14 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:14.795683 717 scope.go:117] "RemoveContainer" containerID="76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.643382 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.815189 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.815452 717 scope.go:117] "RemoveContainer" containerID="9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:21.815639 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: kubelet.service: Consumed 1.526s CPU time.
==> kubernetes-dashboard [65c643dd5c669e49c5e116235f7eaaf31e7a28872397cc3f7a7d5cb97557a30e] <==
2025/11/22 02:51:55 Using namespace: kubernetes-dashboard
2025/11/22 02:51:55 Using in-cluster config to connect to apiserver
2025/11/22 02:51:55 Using secret token for csrf signing
2025/11/22 02:51:55 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:55 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:55 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:55 Generating JWE encryption key
2025/11/22 02:51:55 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:55 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:55 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:55 Creating in-cluster Sidecar client
2025/11/22 02:51:55 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:55 Serving insecurely on HTTP port: 9090
2025/11/22 02:52:25 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:55 Starting overwatch
==> storage-provisioner [38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7] <==
I1122 02:52:14.843119 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:52:14.850302 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:52:14.850335 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:52:14.852317 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:18.306546 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:22.566848 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:26.164695 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:29.218514 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.241040 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.246231 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:32.246362 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:52:32.246545 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64!
I1122 02:52:32.246546 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"ac612922-cc8d-492b-8e78-8d20922eff82", APIVersion:"v1", ResourceVersion:"665", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64 became leader
W1122 02:52:32.249031 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.252545 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:32.346792 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64!
==> storage-provisioner [76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf] <==
I1122 02:51:44.040963 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:52:14.044081 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134: exit status 2 (309.679206ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context default-k8s-diff-port-714134 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect default-k8s-diff-port-714134
helpers_test.go:243: (dbg) docker inspect default-k8s-diff-port-714134:
-- stdout --
[
{
"Id": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"Created": "2025-11-22T02:50:31.741901438Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 331458,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-22T02:51:34.070063123Z",
"FinishedAt": "2025-11-22T02:51:32.701586578Z"
},
"Image": "sha256:a368e3d71517ce17114afb6c9921965419df972dd0e2d32a9973a8946f0910a3",
"ResolvConfPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hostname",
"HostsPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/hosts",
"LogPath": "/var/lib/docker/containers/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8/0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8-json.log",
"Name": "/default-k8s-diff-port-714134",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"default-k8s-diff-port-714134:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "default-k8s-diff-port-714134",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "0ce4a57beec53d70dc03cdafcfa15125c1d82f0cded26ede59e00e55bb34e0b8",
"LowerDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04-init/diff:/var/lib/docker/overlay2/ae5887e9a52ddd2399281369e53c3df81f86b862fe3705d435c5a174d9364417/diff",
"MergedDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/merged",
"UpperDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/diff",
"WorkDir": "/var/lib/docker/overlay2/73fb9de56b30de06716480e590e9b855acf3ce08b779bc4e54646dbdddb56a04/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "default-k8s-diff-port-714134",
"Source": "/var/lib/docker/volumes/default-k8s-diff-port-714134/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "default-k8s-diff-port-714134",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8444/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"name.minikube.sigs.k8s.io": "default-k8s-diff-port-714134",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"SandboxID": "5739c701c7df30b5321c6906481af9061881740295c772e101bfbe99a504c7b4",
"SandboxKey": "/var/run/docker/netns/5739c701c7df",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33128"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33129"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33132"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33130"
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33131"
}
]
},
"Networks": {
"default-k8s-diff-port-714134": {
"IPAMConfig": {
"IPv4Address": "192.168.94.2",
"IPv6Address": ""
},
"Links": null,
"Aliases": null,
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "1451805a580c7a9f0fd8e60ea19dcbce5f50443c1da7f0f14ca30139c5b28efb",
"EndpointID": "d8e9f5c89ef60d0b94c5f12ece46352f60760bcf7f209c1fc7f8c7f3aada35df",
"Gateway": "192.168.94.1",
"IPAddress": "192.168.94.2",
"MacAddress": "ae:1a:71:f1:cb:45",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"default-k8s-diff-port-714134",
"0ce4a57beec5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134: exit status 2 (301.749396ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:247: status error: exit status 2 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 logs -n 25
helpers_test.go:260: TestStartStop/group/default-k8s-diff-port/serial/Pause logs:
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p old-k8s-version-169878 │ old-k8s-version-169878 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ addons │ enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ no-preload-346270 image list --format=json │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ pause │ -p no-preload-346270 --alsologtostderr -v=1 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable metrics-server -p newest-cni-021912 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ │
│ stop │ -p newest-cni-021912 --alsologtostderr -v=3 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ delete │ -p no-preload-346270 │ no-preload-346270 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ addons │ enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:51 UTC │
│ start │ -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:51 UTC │ 22 Nov 25 02:52 UTC │
│ image │ newest-cni-021912 image list --format=json │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p newest-cni-021912 --alsologtostderr -v=1 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ delete │ -p newest-cni-021912 │ newest-cni-021912 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ image │ embed-certs-153115 image list --format=json │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p embed-certs-153115 --alsologtostderr -v=1 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ image │ default-k8s-diff-port-714134 image list --format=json │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ pause │ -p default-k8s-diff-port-714134 --alsologtostderr -v=1 │ default-k8s-diff-port-714134 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ │
│ delete │ -p embed-certs-153115 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
│ delete │ -p embed-certs-153115 │ embed-certs-153115 │ jenkins │ v1.37.0 │ 22 Nov 25 02:52 UTC │ 22 Nov 25 02:52 UTC │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
==> Last Start <==
Log file created at: 2025/11/22 02:51:58
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 02:51:58.343492 338573 out.go:360] Setting OutFile to fd 1 ...
I1122 02:51:58.343787 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.343798 338573 out.go:374] Setting ErrFile to fd 2...
I1122 02:51:58.343803 338573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:51:58.344013 338573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:51:58.344449 338573 out.go:368] Setting JSON to false
I1122 02:51:58.345684 338573 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5661,"bootTime":1763774257,"procs":314,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:51:58.345774 338573 start.go:143] virtualization: kvm guest
I1122 02:51:58.347285 338573 out.go:179] * [newest-cni-021912] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:51:58.348665 338573 notify.go:221] Checking for updates...
I1122 02:51:58.348690 338573 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:51:58.349746 338573 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:51:58.351059 338573 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:51:58.352231 338573 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:51:58.353394 338573 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:51:58.354446 338573 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:51:58.356006 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:51:58.356490 338573 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:51:58.380741 338573 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:51:58.380807 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.433233 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.423653979 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.433366 338573 docker.go:319] overlay module found
I1122 02:51:58.434988 338573 out.go:179] * Using the docker driver based on existing profile
I1122 02:51:58.436073 338573 start.go:309] selected driver: docker
I1122 02:51:58.436085 338573 start.go:927] validating driver "docker" against &{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.436162 338573 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:51:58.436640 338573 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:51:58.497802 338573 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:66 SystemTime:2025-11-22 02:51:58.487064806 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:51:58.498135 338573 start_flags.go:1011] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:51:58.498163 338573 cni.go:84] Creating CNI manager for ""
I1122 02:51:58.498215 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:51:58.498248 338573 start.go:353] cluster config:
{Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:51:58.500613 338573 out.go:179] * Starting "newest-cni-021912" primary control-plane node in "newest-cni-021912" cluster
I1122 02:51:58.501731 338573 cache.go:134] Beginning downloading kic base image for docker with crio
I1122 02:51:58.502767 338573 out.go:179] * Pulling base image v0.0.48-1763507788-21924 ...
I1122 02:51:58.503754 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:51:58.503780 338573 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
I1122 02:51:58.503798 338573 cache.go:65] Caching tarball of preloaded images
I1122 02:51:58.503849 338573 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon
I1122 02:51:58.503885 338573 preload.go:238] Found /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1122 02:51:58.503899 338573 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1122 02:51:58.504021 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.524981 338573 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a in local docker daemon, skipping pull
I1122 02:51:58.525000 338573 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a exists in daemon, skipping load
I1122 02:51:58.525021 338573 cache.go:243] Successfully downloaded all kic artifacts
I1122 02:51:58.525047 338573 start.go:360] acquireMachinesLock for newest-cni-021912: {Name:mkb9a67e97e7c906929b13da22f6070541845f12 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1122 02:51:58.525100 338573 start.go:364] duration metric: took 36.093µs to acquireMachinesLock for "newest-cni-021912"
I1122 02:51:58.525116 338573 start.go:96] Skipping create...Using existing machine configuration
I1122 02:51:58.525124 338573 fix.go:54] fixHost starting:
I1122 02:51:58.525312 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.543843 338573 fix.go:112] recreateIfNeeded on newest-cni-021912: state=Stopped err=<nil>
W1122 02:51:58.543892 338573 fix.go:138] unexpected machine state, will restart: <nil>
W1122 02:51:56.031255 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.033108 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:51:58.014733 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:00.512332 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:51:58.545618 338573 out.go:252] * Restarting existing docker container for "newest-cni-021912" ...
I1122 02:51:58.545695 338573 cli_runner.go:164] Run: docker start newest-cni-021912
I1122 02:51:58.808533 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:51:58.827893 338573 kic.go:430] container "newest-cni-021912" state is running.
I1122 02:51:58.828321 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:51:58.846633 338573 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/config.json ...
I1122 02:51:58.846872 338573 machine.go:94] provisionDockerMachine start ...
I1122 02:51:58.846962 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:51:58.865575 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:51:58.865889 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:51:58.865918 338573 main.go:143] libmachine: About to run SSH command:
hostname
I1122 02:51:58.866538 338573 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52452->127.0.0.1:33133: read: connection reset by peer
I1122 02:52:01.995363 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:01.995391 338573 ubuntu.go:182] provisioning hostname "newest-cni-021912"
I1122 02:52:01.995450 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.014600 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.014823 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.014842 338573 main.go:143] libmachine: About to run SSH command:
sudo hostname newest-cni-021912 && echo "newest-cni-021912" | sudo tee /etc/hostname
I1122 02:52:02.152216 338573 main.go:143] libmachine: SSH cmd err, output: <nil>: newest-cni-021912
I1122 02:52:02.152304 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.171594 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:02.171788 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:02.171803 338573 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-021912' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-021912/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-021912' | sudo tee -a /etc/hosts;
fi
fi
I1122 02:52:02.298949 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1122 02:52:02.298978 338573 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21946-11041/.minikube CaCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21946-11041/.minikube}
I1122 02:52:02.299001 338573 ubuntu.go:190] setting up certificates
I1122 02:52:02.299014 338573 provision.go:84] configureAuth start
I1122 02:52:02.299067 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:02.316516 338573 provision.go:143] copyHostCerts
I1122 02:52:02.316578 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem, removing ...
I1122 02:52:02.316595 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem
I1122 02:52:02.316655 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/ca.pem (1078 bytes)
I1122 02:52:02.316742 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem, removing ...
I1122 02:52:02.316750 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem
I1122 02:52:02.316778 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/cert.pem (1123 bytes)
I1122 02:52:02.316829 338573 exec_runner.go:144] found /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem, removing ...
I1122 02:52:02.316836 338573 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem
I1122 02:52:02.316867 338573 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21946-11041/.minikube/key.pem (1679 bytes)
I1122 02:52:02.316959 338573 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem org=jenkins.newest-cni-021912 san=[127.0.0.1 192.168.85.2 localhost minikube newest-cni-021912]
I1122 02:52:02.875063 338573 provision.go:177] copyRemoteCerts
I1122 02:52:02.875125 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1122 02:52:02.875168 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:02.893475 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:02.987408 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1122 02:52:03.004204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1122 02:52:03.021204 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1122 02:52:03.038075 338573 provision.go:87] duration metric: took 739.046589ms to configureAuth
I1122 02:52:03.038099 338573 ubuntu.go:206] setting minikube options for container-runtime
I1122 02:52:03.038271 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:03.038354 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.056390 338573 main.go:143] libmachine: Using SSH client type: native
I1122 02:52:03.056618 338573 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x8416e0] 0x8443c0 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I1122 02:52:03.056644 338573 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1122 02:52:03.341234 338573 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1122 02:52:03.341262 338573 machine.go:97] duration metric: took 4.494372821s to provisionDockerMachine
I1122 02:52:03.341272 338573 start.go:293] postStartSetup for "newest-cni-021912" (driver="docker")
I1122 02:52:03.341283 338573 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1122 02:52:03.341327 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1122 02:52:03.341370 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
W1122 02:52:00.531471 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:02.532440 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:03.359639 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.453504 338573 ssh_runner.go:195] Run: cat /etc/os-release
I1122 02:52:03.456850 338573 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1122 02:52:03.456878 338573 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1122 02:52:03.456888 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/addons for local assets ...
I1122 02:52:03.456950 338573 filesync.go:126] Scanning /home/jenkins/minikube-integration/21946-11041/.minikube/files for local assets ...
I1122 02:52:03.457027 338573 filesync.go:149] local asset: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem -> 150722.pem in /etc/ssl/certs
I1122 02:52:03.457109 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1122 02:52:03.464396 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:03.481118 338573 start.go:296] duration metric: took 139.834704ms for postStartSetup
I1122 02:52:03.481175 338573 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:52:03.481215 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.499180 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.589314 338573 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1122 02:52:03.593633 338573 fix.go:56] duration metric: took 5.068503514s for fixHost
I1122 02:52:03.593657 338573 start.go:83] releasing machines lock for "newest-cni-021912", held for 5.068546164s
I1122 02:52:03.593739 338573 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-021912
I1122 02:52:03.610243 338573 ssh_runner.go:195] Run: cat /version.json
I1122 02:52:03.610283 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.610358 338573 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1122 02:52:03.610434 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:03.628841 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.629585 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:03.778566 338573 ssh_runner.go:195] Run: systemctl --version
I1122 02:52:03.784645 338573 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1122 02:52:03.817842 338573 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1122 02:52:03.822101 338573 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1122 02:52:03.822156 338573 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1122 02:52:03.829783 338573 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1122 02:52:03.829803 338573 start.go:496] detecting cgroup driver to use...
I1122 02:52:03.829837 338573 detect.go:190] detected "systemd" cgroup driver on host os
I1122 02:52:03.829884 338573 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1122 02:52:03.843243 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1122 02:52:03.854474 338573 docker.go:218] disabling cri-docker service (if available) ...
I1122 02:52:03.854534 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1122 02:52:03.868326 338573 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1122 02:52:03.879788 338573 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1122 02:52:03.957006 338573 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1122 02:52:04.035435 338573 docker.go:234] disabling docker service ...
I1122 02:52:04.035495 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1122 02:52:04.048802 338573 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1122 02:52:04.060191 338573 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1122 02:52:04.141150 338573 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1122 02:52:04.227197 338573 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1122 02:52:04.239102 338573 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1122 02:52:04.252149 338573 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1122 02:52:04.252199 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.261335 338573 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
I1122 02:52:04.261376 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.269552 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.277637 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.286006 338573 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1122 02:52:04.293310 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.301321 338573 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.309087 338573 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1122 02:52:04.316971 338573 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1122 02:52:04.323457 338573 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1122 02:52:04.330169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.406819 338573 ssh_runner.go:195] Run: sudo systemctl restart crio
I1122 02:52:04.547513 338573 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1122 02:52:04.547574 338573 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1122 02:52:04.551406 338573 start.go:564] Will wait 60s for crictl version
I1122 02:52:04.551461 338573 ssh_runner.go:195] Run: which crictl
I1122 02:52:04.554981 338573 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1122 02:52:04.579492 338573 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1122 02:52:04.579554 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.605921 338573 ssh_runner.go:195] Run: crio --version
I1122 02:52:04.633835 338573 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1122 02:52:04.634789 338573 cli_runner.go:164] Run: docker network inspect newest-cni-021912 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:52:04.652363 338573 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1122 02:52:04.656187 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.667175 338573 out.go:179] - kubeadm.pod-network-cidr=10.42.0.0/16
I1122 02:52:04.667996 338573 kubeadm.go:884] updating cluster {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1122 02:52:04.668113 338573 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 02:52:04.668158 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.697966 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.697985 338573 crio.go:433] Images already preloaded, skipping extraction
I1122 02:52:04.698021 338573 ssh_runner.go:195] Run: sudo crictl images --output json
I1122 02:52:04.721810 338573 crio.go:514] all images are preloaded for cri-o runtime.
I1122 02:52:04.721827 338573 cache_images.go:86] Images are preloaded, skipping loading
I1122 02:52:04.721835 338573 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 crio true true} ...
I1122 02:52:04.721945 338573 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=newest-cni-021912 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1122 02:52:04.722007 338573 ssh_runner.go:195] Run: crio config
I1122 02:52:04.765045 338573 cni.go:84] Creating CNI manager for ""
I1122 02:52:04.765066 338573 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I1122 02:52:04.765084 338573 kubeadm.go:85] Using pod CIDR: 10.42.0.0/16
I1122 02:52:04.765105 338573 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-021912 NodeName:newest-cni-021912 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k
ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1122 02:52:04.765219 338573 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-021912"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1122 02:52:04.765271 338573 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1122 02:52:04.773239 338573 binaries.go:51] Found k8s binaries, skipping transfer
I1122 02:52:04.773296 338573 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1122 02:52:04.780366 338573 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I1122 02:52:04.792245 338573 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1122 02:52:04.804082 338573 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2211 bytes)
I1122 02:52:04.815781 338573 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1122 02:52:04.819125 338573 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1122 02:52:04.828169 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:04.905681 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:04.932771 338573 certs.go:69] Setting up /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912 for IP: 192.168.85.2
I1122 02:52:04.932787 338573 certs.go:195] generating shared ca certs ...
I1122 02:52:04.932801 338573 certs.go:227] acquiring lock for ca certs: {Name:mk4c01b12ab9179ec62e8c54b59c37ecc45ac6a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:04.932942 338573 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key
I1122 02:52:04.932983 338573 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key
I1122 02:52:04.932994 338573 certs.go:257] generating profile certs ...
I1122 02:52:04.933065 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/client.key
I1122 02:52:04.933118 338573 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key.8b60d0e5
I1122 02:52:04.933160 338573 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key
I1122 02:52:04.933261 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem (1338 bytes)
W1122 02:52:04.933288 338573 certs.go:480] ignoring /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072_empty.pem, impossibly tiny 0 bytes
I1122 02:52:04.933297 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca-key.pem (1675 bytes)
I1122 02:52:04.933319 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/ca.pem (1078 bytes)
I1122 02:52:04.933340 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/cert.pem (1123 bytes)
I1122 02:52:04.933361 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/certs/key.pem (1679 bytes)
I1122 02:52:04.933398 338573 certs.go:484] found cert: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem (1708 bytes)
I1122 02:52:04.933939 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1122 02:52:04.951672 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1122 02:52:04.970053 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1122 02:52:04.988274 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1122 02:52:05.010435 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1122 02:52:05.028518 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1122 02:52:05.045545 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1122 02:52:05.061483 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/newest-cni-021912/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1122 02:52:05.077379 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/certs/15072.pem --> /usr/share/ca-certificates/15072.pem (1338 bytes)
I1122 02:52:05.093188 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/ssl/certs/150722.pem --> /usr/share/ca-certificates/150722.pem (1708 bytes)
I1122 02:52:05.109293 338573 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1122 02:52:05.126801 338573 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1122 02:52:05.138258 338573 ssh_runner.go:195] Run: openssl version
I1122 02:52:05.143874 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15072.pem && ln -fs /usr/share/ca-certificates/15072.pem /etc/ssl/certs/15072.pem"
I1122 02:52:05.151471 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154801 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 22 02:01 /usr/share/ca-certificates/15072.pem
I1122 02:52:05.154836 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15072.pem
I1122 02:52:05.192025 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15072.pem /etc/ssl/certs/51391683.0"
I1122 02:52:05.200464 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150722.pem && ln -fs /usr/share/ca-certificates/150722.pem /etc/ssl/certs/150722.pem"
I1122 02:52:05.209482 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213693 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 22 02:01 /usr/share/ca-certificates/150722.pem
I1122 02:52:05.213748 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150722.pem
I1122 02:52:05.249451 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150722.pem /etc/ssl/certs/3ec20f2e.0"
I1122 02:52:05.257232 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1122 02:52:05.265969 338573 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269486 338573 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 22 01:56 /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.269532 338573 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1122 02:52:05.307579 338573 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1122 02:52:05.315315 338573 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1122 02:52:05.318885 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1122 02:52:05.352692 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1122 02:52:05.386046 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1122 02:52:05.419798 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1122 02:52:05.461839 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1122 02:52:05.506401 338573 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1122 02:52:05.560581 338573 kubeadm.go:401] StartCluster: {Name:newest-cni-021912 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:newest-cni-021912 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:52:05.560693 338573 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1122 02:52:05.560763 338573 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1122 02:52:05.596533 338573 cri.go:89] found id: "1def51ecc6a61749044d52c0c585b323378f713d4da7ac9a66e59d78039fc5f4"
I1122 02:52:05.596556 338573 cri.go:89] found id: "91390a510a9b02056beb5796ab32e2d038cb3822d6ce96e331b9a1856bfc8bcf"
I1122 02:52:05.596560 338573 cri.go:89] found id: "6ef479412c61ca0e059ef49906146d2679014f8dc0e130fee34ccc423382a0d8"
I1122 02:52:05.596563 338573 cri.go:89] found id: "f16d03ae2337abe3ae447dd16f37c545e43fd662ebcc0d0fb20eac7ac1429001"
I1122 02:52:05.596566 338573 cri.go:89] found id: ""
I1122 02:52:05.596610 338573 ssh_runner.go:195] Run: sudo runc list -f json
W1122 02:52:05.609519 338573 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:52:05Z" level=error msg="open /run/runc: no such file or directory"
I1122 02:52:05.609609 338573 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1122 02:52:05.618659 338573 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1122 02:52:05.618678 338573 kubeadm.go:598] restartPrimaryControlPlane start ...
I1122 02:52:05.618729 338573 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1122 02:52:05.626057 338573 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1122 02:52:05.627068 338573 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-021912" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.627769 338573 kubeconfig.go:62] /home/jenkins/minikube-integration/21946-11041/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-021912" cluster setting kubeconfig missing "newest-cni-021912" context setting]
I1122 02:52:05.628852 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.630820 338573 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1122 02:52:05.638480 338573 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.85.2
I1122 02:52:05.638508 338573 kubeadm.go:602] duration metric: took 19.822973ms to restartPrimaryControlPlane
I1122 02:52:05.638521 338573 kubeadm.go:403] duration metric: took 77.989203ms to StartCluster
I1122 02:52:05.638538 338573 settings.go:142] acquiring lock: {Name:mk60c47df5f98319e582a48b56b58aff1525757a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.638592 338573 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:52:05.640607 338573 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21946-11041/kubeconfig: {Name:mk1444dbbdba1c06f7676cf1920855ae85a196bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1122 02:52:05.640851 338573 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1122 02:52:05.640926 338573 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1122 02:52:05.641040 338573 addons.go:70] Setting storage-provisioner=true in profile "newest-cni-021912"
I1122 02:52:05.641065 338573 addons.go:239] Setting addon storage-provisioner=true in "newest-cni-021912"
W1122 02:52:05.641078 338573 addons.go:248] addon storage-provisioner should already be in state true
I1122 02:52:05.641106 338573 config.go:182] Loaded profile config "newest-cni-021912": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:52:05.641117 338573 addons.go:70] Setting default-storageclass=true in profile "newest-cni-021912"
I1122 02:52:05.641133 338573 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-021912"
I1122 02:52:05.641108 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.641445 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.641112 338573 addons.go:70] Setting dashboard=true in profile "newest-cni-021912"
I1122 02:52:05.641581 338573 addons.go:239] Setting addon dashboard=true in "newest-cni-021912"
I1122 02:52:05.641601 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
W1122 02:52:05.641612 338573 addons.go:248] addon dashboard should already be in state true
I1122 02:52:05.641661 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.642236 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.642805 338573 out.go:179] * Verifying Kubernetes components...
I1122 02:52:05.643782 338573 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1122 02:52:05.666828 338573 addons.go:239] Setting addon default-storageclass=true in "newest-cni-021912"
W1122 02:52:05.666916 338573 addons.go:248] addon default-storageclass should already be in state true
I1122 02:52:05.666950 338573 host.go:66] Checking if "newest-cni-021912" exists ...
I1122 02:52:05.667444 338573 cli_runner.go:164] Run: docker container inspect newest-cni-021912 --format={{.State.Status}}
I1122 02:52:05.670229 338573 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1122 02:52:05.670756 338573 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1122 02:52:05.672038 338573 out.go:179] - Using image registry.k8s.io/echoserver:1.4
W1122 02:52:03.012142 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:05.014177 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:05.672149 338573 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.672167 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1122 02:52:05.672217 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.672930 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1122 02:52:05.672949 338573 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1122 02:52:05.673002 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.698167 338573 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.698190 338573 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1122 02:52:05.698248 338573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-021912
I1122 02:52:05.705486 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.709317 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.727056 338573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/newest-cni-021912/id_rsa Username:docker}
I1122 02:52:05.795700 338573 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1122 02:52:05.810324 338573 api_server.go:52] waiting for apiserver process to appear ...
I1122 02:52:05.810401 338573 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:52:05.818805 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1122 02:52:05.818824 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1122 02:52:05.818852 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1122 02:52:05.825558 338573 api_server.go:72] duration metric: took 184.672747ms to wait for apiserver process to appear ...
I1122 02:52:05.825580 338573 api_server.go:88] waiting for apiserver healthz status ...
I1122 02:52:05.825600 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:05.834024 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1122 02:52:05.834048 338573 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1122 02:52:05.838347 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1122 02:52:05.848951 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1122 02:52:05.848974 338573 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1122 02:52:05.865786 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1122 02:52:05.865807 338573 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1122 02:52:05.882205 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-role.yaml
I1122 02:52:05.882224 338573 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1122 02:52:05.899253 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1122 02:52:05.899275 338573 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1122 02:52:05.912806 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1122 02:52:05.912827 338573 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1122 02:52:05.925835 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1122 02:52:05.925856 338573 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1122 02:52:05.939421 338573 addons.go:436] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:05.939439 338573 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1122 02:52:05.951293 338573 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1122 02:52:07.895983 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.896013 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:07.896028 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:07.914322 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1122 02:52:07.914352 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1122 02:52:08.326712 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.332020 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.332047 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:08.457105 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.638225408s)
I1122 02:52:08.457168 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.618796671s)
I1122 02:52:08.457258 338573 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.505933048s)
I1122 02:52:08.458499 338573 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-021912 addons enable metrics-server
I1122 02:52:08.467217 338573 out.go:179] * Enabled addons: storage-provisioner, dashboard, default-storageclass
W1122 02:52:05.032646 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:07.033543 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:08.468272 338573 addons.go:530] duration metric: took 2.827349174s for enable addons: enabled=[storage-provisioner dashboard default-storageclass]
I1122 02:52:08.826490 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:08.830303 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1122 02:52:08.830339 338573 api_server.go:103] status: https://192.168.85.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1122 02:52:09.325974 338573 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1122 02:52:09.329951 338573 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1122 02:52:09.330894 338573 api_server.go:141] control plane version: v1.34.1
I1122 02:52:09.330945 338573 api_server.go:131] duration metric: took 3.505355479s to wait for apiserver health ...
I1122 02:52:09.330956 338573 system_pods.go:43] waiting for kube-system pods to appear ...
I1122 02:52:09.334152 338573 system_pods.go:59] 8 kube-system pods found
I1122 02:52:09.334179 338573 system_pods.go:61] "coredns-66bc5c9577-f6gl7" [deca6c78-29e3-4f35-ae6d-9f16fe5ac998] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334187 338573 system_pods.go:61] "etcd-newest-cni-021912" [6d306a6e-53d9-4f25-bb4f-dfd95c9e0f8d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1122 02:52:09.334193 338573 system_pods.go:61] "kindnet-qlk6r" [52fa3624-6a80-451b-bf42-5ca57e756651] Running
I1122 02:52:09.334199 338573 system_pods.go:61] "kube-apiserver-newest-cni-021912" [9da428c9-6190-4ffa-8ca6-6b1e1dc2c632] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1122 02:52:09.334204 338573 system_pods.go:61] "kube-controller-manager-newest-cni-021912" [0ab8a7fa-3eba-4b2c-842b-aae8c99a7782] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1122 02:52:09.334208 338573 system_pods.go:61] "kube-proxy-mbdks" [4e0b545b-1f11-4ab9-98e8-61a533e7ef4a] Running
I1122 02:52:09.334213 338573 system_pods.go:61] "kube-scheduler-newest-cni-021912" [c2b3ff54-8e8f-4f48-8335-9fd6cf8d0ec9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1122 02:52:09.334217 338573 system_pods.go:61] "storage-provisioner" [62c2433b-c8ef-476a-9c52-79129d01f0ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1122 02:52:09.334223 338573 system_pods.go:74] duration metric: took 3.260699ms to wait for pod list to return data ...
I1122 02:52:09.334234 338573 default_sa.go:34] waiting for default service account to be created ...
I1122 02:52:09.336385 338573 default_sa.go:45] found service account: "default"
I1122 02:52:09.336405 338573 default_sa.go:55] duration metric: took 2.164778ms for default service account to be created ...
I1122 02:52:09.336417 338573 kubeadm.go:587] duration metric: took 3.69553603s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I1122 02:52:09.336439 338573 node_conditions.go:102] verifying NodePressure condition ...
I1122 02:52:09.338519 338573 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1122 02:52:09.338544 338573 node_conditions.go:123] node cpu capacity is 8
I1122 02:52:09.338560 338573 node_conditions.go:105] duration metric: took 2.115404ms to run NodePressure ...
I1122 02:52:09.338576 338573 start.go:242] waiting for startup goroutines ...
I1122 02:52:09.338587 338573 start.go:247] waiting for cluster config update ...
I1122 02:52:09.338598 338573 start.go:256] writing updated cluster config ...
I1122 02:52:09.338843 338573 ssh_runner.go:195] Run: rm -f paused
I1122 02:52:09.386192 338573 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:09.388094 338573 out.go:179] * Done! kubectl is now configured to use "newest-cni-021912" cluster and "default" namespace by default
W1122 02:52:07.512684 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
W1122 02:52:09.512787 327960 pod_ready.go:104] pod "coredns-66bc5c9577-bq64j" is not "Ready", error: <nil>
I1122 02:52:11.012257 327960 pod_ready.go:94] pod "coredns-66bc5c9577-bq64j" is "Ready"
I1122 02:52:11.012281 327960 pod_ready.go:86] duration metric: took 33.004969351s for pod "coredns-66bc5c9577-bq64j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.014557 327960 pod_ready.go:83] waiting for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.018176 327960 pod_ready.go:94] pod "etcd-embed-certs-153115" is "Ready"
I1122 02:52:11.018195 327960 pod_ready.go:86] duration metric: took 3.618416ms for pod "etcd-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.020074 327960 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.023425 327960 pod_ready.go:94] pod "kube-apiserver-embed-certs-153115" is "Ready"
I1122 02:52:11.023443 327960 pod_ready.go:86] duration metric: took 3.347528ms for pod "kube-apiserver-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.025117 327960 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.210581 327960 pod_ready.go:94] pod "kube-controller-manager-embed-certs-153115" is "Ready"
I1122 02:52:11.210603 327960 pod_ready.go:86] duration metric: took 185.468241ms for pod "kube-controller-manager-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.411440 327960 pod_ready.go:83] waiting for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:11.811297 327960 pod_ready.go:94] pod "kube-proxy-vw5ph" is "Ready"
I1122 02:52:11.811323 327960 pod_ready.go:86] duration metric: took 399.856931ms for pod "kube-proxy-vw5ph" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.011053 327960 pod_ready.go:83] waiting for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411193 327960 pod_ready.go:94] pod "kube-scheduler-embed-certs-153115" is "Ready"
I1122 02:52:12.411222 327960 pod_ready.go:86] duration metric: took 400.143695ms for pod "kube-scheduler-embed-certs-153115" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:12.411235 327960 pod_ready.go:40] duration metric: took 34.407040305s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:12.455608 327960 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:12.457074 327960 out.go:179] * Done! kubectl is now configured to use "embed-certs-153115" cluster and "default" namespace by default
W1122 02:52:09.532516 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:12.033636 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
W1122 02:52:14.532859 331164 pod_ready.go:104] pod "coredns-66bc5c9577-d74g5" is not "Ready", error: <nil>
I1122 02:52:16.032562 331164 pod_ready.go:94] pod "coredns-66bc5c9577-d74g5" is "Ready"
I1122 02:52:16.032585 331164 pod_ready.go:86] duration metric: took 31.505644461s for pod "coredns-66bc5c9577-d74g5" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.034549 331164 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.038327 331164 pod_ready.go:94] pod "etcd-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.038348 331164 pod_ready.go:86] duration metric: took 3.779346ms for pod "etcd-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.040260 331164 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.043450 331164 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.043472 331164 pod_ready.go:86] duration metric: took 3.1909ms for pod "kube-apiserver-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.045426 331164 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.231368 331164 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:16.231395 331164 pod_ready.go:86] duration metric: took 185.950836ms for pod "kube-controller-manager-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.431104 331164 pod_ready.go:83] waiting for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:16.830786 331164 pod_ready.go:94] pod "kube-proxy-ppn8j" is "Ready"
I1122 02:52:16.830810 331164 pod_ready.go:86] duration metric: took 399.679522ms for pod "kube-proxy-ppn8j" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.030470 331164 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430739 331164 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-714134" is "Ready"
I1122 02:52:17.430770 331164 pod_ready.go:86] duration metric: took 400.273026ms for pod "kube-scheduler-default-k8s-diff-port-714134" in "kube-system" namespace to be "Ready" or be gone ...
I1122 02:52:17.430784 331164 pod_ready.go:40] duration metric: took 32.907664623s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1122 02:52:17.477039 331164 start.go:625] kubectl: 1.34.2, cluster: 1.34.1 (minor skew: 0)
I1122 02:52:17.478852 331164 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-714134" cluster and "default" namespace by default
==> CRI-O <==
Nov 22 02:52:00 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:00.911155015Z" level=info msg="Started container" PID=1740 containerID=a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper id=f54b227e-48b8-468f-914a-b12cb7b487b1 name=/runtime.v1.RuntimeService/StartContainer sandboxID=3e8bc4f4973dc5da3a6bed03854faa67b4d1e1656c3ca94948a77e47c367e2af
Nov 22 02:52:01 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:01.763769771Z" level=info msg="Removing container: 8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3" id=c948092a-5b80-496e-9da0-2bd9583ddd39 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:01 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:01.773433165Z" level=info msg="Removed container 8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=c948092a-5b80-496e-9da0-2bd9583ddd39 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.796142789Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=c39cf12c-536e-4543-a83c-f6c399990205 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.797139294Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=c9f6fa5b-bc44-43f4-a1e7-8bdffcf643bd name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.798248516Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=3cd95c34-4d64-4f2d-bdbd-b290286e5fd0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.798376734Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803678059Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803862217Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/a0369a141f568b14dcaf379eea5538d6bb985706ac613437b0ab190ec3b21bfc/merged/etc/passwd: no such file or directory"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.803897194Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/a0369a141f568b14dcaf379eea5538d6bb985706ac613437b0ab190ec3b21bfc/merged/etc/group: no such file or directory"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.804635107Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.829179812Z" level=info msg="Created container 38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7: kube-system/storage-provisioner/storage-provisioner" id=3cd95c34-4d64-4f2d-bdbd-b290286e5fd0 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.829705054Z" level=info msg="Starting container: 38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7" id=2b74175f-12d9-4d21-b9b5-6254cec423d5 name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:14 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:14.831379324Z" level=info msg="Started container" PID=1754 containerID=38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7 description=kube-system/storage-provisioner/storage-provisioner id=2b74175f-12d9-4d21-b9b5-6254cec423d5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=4f4d57c8456075a93f5c1a25b7eeba79b6344c68c37051fe638f0121df22cc43
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.64385759Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=175d2adb-493a-46d4-bebe-6d93fafa2e19 name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.644839968Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=752f9652-70f8-4bdf-9573-0e2c7cf0417c name=/runtime.v1.ImageService/ImageStatus
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.645842689Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=7d1609ca-c099-4502-a129-c25fccca16a7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.645979656Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.651573759Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.652016096Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.680362784Z" level=info msg="Created container 9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=7d1609ca-c099-4502-a129-c25fccca16a7 name=/runtime.v1.RuntimeService/CreateContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.680866967Z" level=info msg="Starting container: 9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855" id=1f9b59d8-f3f6-45de-bf95-7cb8ae770f4a name=/runtime.v1.RuntimeService/StartContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.682788922Z" level=info msg="Started container" PID=1789 containerID=9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper id=1f9b59d8-f3f6-45de-bf95-7cb8ae770f4a name=/runtime.v1.RuntimeService/StartContainer sandboxID=3e8bc4f4973dc5da3a6bed03854faa67b4d1e1656c3ca94948a77e47c367e2af
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.816368737Z" level=info msg="Removing container: a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd" id=74df69ce-f104-4d11-af8a-090c3deaa784 name=/runtime.v1.RuntimeService/RemoveContainer
Nov 22 02:52:21 default-k8s-diff-port-714134 crio[558]: time="2025-11-22T02:52:21.825216094Z" level=info msg="Removed container a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4/dashboard-metrics-scraper" id=74df69ce-f104-4d11-af8a-090c3deaa784 name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
9f14d94d46b2c a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 12 seconds ago Exited dashboard-metrics-scraper 3 3e8bc4f4973dc dashboard-metrics-scraper-6ffb444bf9-dsjk4 kubernetes-dashboard
38dbf8959ebdd 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 18 seconds ago Running storage-provisioner 1 4f4d57c845607 storage-provisioner kube-system
65c643dd5c669 docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029 38 seconds ago Running kubernetes-dashboard 0 8d0de0523faf7 kubernetes-dashboard-855c9754f9-jdn6w kubernetes-dashboard
e52c3464cd887 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969 49 seconds ago Running coredns 0 1a82f061160db coredns-66bc5c9577-d74g5 kube-system
fa9c797804b36 fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7 49 seconds ago Running kube-proxy 0 ce443c9367705 kube-proxy-ppn8j kube-system
3ca3c93e537df 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c 49 seconds ago Running busybox 1 47f1bc23b5771 busybox default
76bb9df11eaef 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 49 seconds ago Exited storage-provisioner 0 4f4d57c845607 storage-provisioner kube-system
539c479ff8c96 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c 49 seconds ago Running kindnet-cni 0 fc74e13655f40 kindnet-jzn9z kube-system
03fed611f7c3c 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813 52 seconds ago Running kube-scheduler 0 0716cbda8a473 kube-scheduler-default-k8s-diff-port-714134 kube-system
23737742a4f7e c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f 52 seconds ago Running kube-controller-manager 0 579cbe7597671 kube-controller-manager-default-k8s-diff-port-714134 kube-system
aa3d75d2612f1 c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97 52 seconds ago Running kube-apiserver 0 d6adb98fbd5b6 kube-apiserver-default-k8s-diff-port-714134 kube-system
a941b14502e93 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115 52 seconds ago Running etcd 0 98389006f5a58 etcd-default-k8s-diff-port-714134 kube-system
==> coredns [e52c3464cd88737582502c6aa61fc3e5abbb9af05034a43040177afcb2dbb5d1] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = c7556d8fdf49c5e32a9077be8cfb9fc6947bb07e663a10d55b192eb63ad1f2bd9793e8e5f5a36fc9abb1957831eec5c997fd9821790e3990ae9531bf41ecea37
CoreDNS-1.12.1
linux/amd64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:47054 - 43749 "HINFO IN 163238085682147639.2870288700375267881. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.105112325s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
==> describe nodes <==
Name: default-k8s-diff-port-714134
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-714134
kubernetes.io/os=linux
minikube.k8s.io/commit=567461379b593ffd05f59360e0d8825baf725f0a
minikube.k8s.io/name=default-k8s-diff-port-714134
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_22T02_50_48_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 22 Nov 2025 02:50:45 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-714134
AcquireTime: <unset>
RenewTime: Sat, 22 Nov 2025 02:52:24 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:50:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 22 Nov 2025 02:52:24 +0000 Sat, 22 Nov 2025 02:51:04 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.94.2
Hostname: default-k8s-diff-port-714134
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863356Ki
pods: 110
System Info:
Machine ID: cf10fb2f940d419c1d138723691cfee8
System UUID: 49aec726-6fdc-4995-886e-8625defc71e6
Boot ID: 0b9d7d1c-0fdc-4050-b9f1-dd2de4bc7d3e
Kernel Version: 6.8.0-1044-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 86s
kube-system coredns-66bc5c9577-d74g5 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 100s
kube-system etcd-default-k8s-diff-port-714134 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 106s
kube-system kindnet-jzn9z 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 100s
kube-system kube-apiserver-default-k8s-diff-port-714134 250m (3%) 0 (0%) 0 (0%) 0 (0%) 106s
kube-system kube-controller-manager-default-k8s-diff-port-714134 200m (2%) 0 (0%) 0 (0%) 0 (0%) 106s
kube-system kube-proxy-ppn8j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 100s
kube-system kube-scheduler-default-k8s-diff-port-714134 100m (1%) 0 (0%) 0 (0%) 0 (0%) 106s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 99s
kubernetes-dashboard dashboard-metrics-scraper-6ffb444bf9-dsjk4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 46s
kubernetes-dashboard kubernetes-dashboard-855c9754f9-jdn6w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 46s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 99s kube-proxy
Normal Starting 49s kube-proxy
Normal Starting 112s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 112s (x8 over 112s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 112s (x8 over 112s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 112s (x8 over 112s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 106s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 106s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 106s kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal Starting 106s kubelet Starting kubelet.
Normal RegisteredNode 101s node-controller Node default-k8s-diff-port-714134 event: Registered Node default-k8s-diff-port-714134 in Controller
Normal NodeReady 89s kubelet Node default-k8s-diff-port-714134 status is now: NodeReady
Normal Starting 53s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 53s (x8 over 53s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 53s (x8 over 53s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 53s (x8 over 53s) kubelet Node default-k8s-diff-port-714134 status is now: NodeHasSufficientPID
Normal RegisteredNode 47s node-controller Node default-k8s-diff-port-714134 event: Registered Node default-k8s-diff-port-714134 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[ +17.071818] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 83 42 33 b1 ed 08 06
[ +0.000359] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 2e 44 08 28 5d 08 06
[Nov22 02:49] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +11.885819] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee aa d6 a4 c9 61 08 06
[ +0.000517] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
[ +4.880980] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff e6 70 24 8b 2e 53 08 06
[ +0.000346] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d2 0f cd 5b d0 1c 08 06
[ +6.432144] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[ +18.753151] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 6a e6 4e 34 f9 ba 08 06
[ +0.000369] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 92 04 86 98 65 86 08 06
[Nov22 02:50] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 1a 4a 12 d4 69 1f 08 06
[ +0.000466] IPv4: martian source 10.244.0.4 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9a c7 b1 17 c4 50 08 06
==> etcd [a941b14502e93d15d64fa5c02abb8fc338123ede5a5c20650407562a762a0851] <==
{"level":"warn","ts":"2025-11-22T02:51:42.344437Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41142","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.361377Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41154","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.371878Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41182","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.384701Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41194","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.393047Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41222","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.402123Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41232","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.410080Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41242","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.425775Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41256","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.440474Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41274","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.465478Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41294","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.473264Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41306","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.482784Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41326","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.491169Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41338","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.500322Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41352","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.510442Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41370","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.521758Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41396","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.531434Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41416","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.539650Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41444","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.552378Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41452","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.562030Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41476","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.578450Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41492","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.584384Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41494","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.595791Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41504","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.605205Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41508","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-22T02:51:42.687784Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:41536","server-name":"","error":"EOF"}
==> kernel <==
02:52:33 up 1:34, 0 user, load average: 4.83, 4.14, 2.48
Linux default-k8s-diff-port-714134 6.8.0-1044-gcp #47~22.04.1-Ubuntu SMP Thu Oct 23 21:07:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [539c479ff8c96b953de1d8017ffac77d2315ad00672fc123e3dadd7eec3b0a29] <==
I1122 02:51:44.228298 1 main.go:109] connected to apiserver: https://10.96.0.1:443
I1122 02:51:44.228638 1 main.go:139] hostIP = 192.168.94.2
podIP = 192.168.94.2
I1122 02:51:44.228833 1 main.go:148] setting mtu 1500 for CNI
I1122 02:51:44.228851 1 main.go:178] kindnetd IP family: "ipv4"
I1122 02:51:44.228877 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
time="2025-11-22T02:51:44Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
I1122 02:51:44.515451 1 controller.go:377] "Starting controller" name="kube-network-policies"
I1122 02:51:44.515511 1 controller.go:381] "Waiting for informer caches to sync"
I1122 02:51:44.515527 1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
I1122 02:51:44.515671 1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
I1122 02:51:44.915956 1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
I1122 02:51:44.915985 1 metrics.go:72] Registering metrics
I1122 02:51:44.916041 1 controller.go:711] "Syncing nftables rules"
I1122 02:51:54.516117 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:51:54.516380 1 main.go:301] handling current node
I1122 02:52:04.517093 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:04.517122 1 main.go:301] handling current node
I1122 02:52:14.516276 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:14.516308 1 main.go:301] handling current node
I1122 02:52:24.515660 1 main.go:297] Handling node with IPs: map[192.168.94.2:{}]
I1122 02:52:24.515691 1 main.go:301] handling current node
==> kube-apiserver [aa3d75d2612f12f9263d8c89f0d54196649db226651370593340f2d47f5ac1cc] <==
I1122 02:51:43.318829 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1122 02:51:43.318836 1 cache.go:39] Caches are synced for autoregister controller
I1122 02:51:43.319014 1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
I1122 02:51:43.319103 1 apf_controller.go:382] Running API Priority and Fairness config worker
I1122 02:51:43.319111 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1122 02:51:43.329232 1 handler_discovery.go:451] Starting ResourceDiscoveryManager
E1122 02:51:43.329365 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I1122 02:51:43.335823 1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
I1122 02:51:43.341156 1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
I1122 02:51:43.341213 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1122 02:51:43.391974 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1122 02:51:43.398012 1 shared_informer.go:356] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]"
I1122 02:51:43.398095 1 policy_source.go:240] refreshing policies
I1122 02:51:43.404737 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1122 02:51:43.715405 1 controller.go:667] quota admission added evaluator for: namespaces
I1122 02:51:43.749528 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1122 02:51:43.777217 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1122 02:51:43.783339 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1122 02:51:43.795223 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1122 02:51:43.843379 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.110.140.100"}
I1122 02:51:43.852353 1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.97.114.196"}
I1122 02:51:44.221448 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1122 02:51:47.011901 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1122 02:51:47.064279 1 controller.go:667] quota admission added evaluator for: endpoints
I1122 02:51:47.209472 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-controller-manager [23737742a4f7e2e46a13cdba725c9c1c918be39b67cce4fc2506508160249068] <==
I1122 02:51:46.651983 1 shared_informer.go:356] "Caches are synced" controller="stateful set"
I1122 02:51:46.654238 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
I1122 02:51:46.654330 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
I1122 02:51:46.654591 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
I1122 02:51:46.655460 1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
I1122 02:51:46.657562 1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
I1122 02:51:46.657627 1 shared_informer.go:356] "Caches are synced" controller="job"
I1122 02:51:46.657633 1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
I1122 02:51:46.657656 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1122 02:51:46.658742 1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
I1122 02:51:46.659885 1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
I1122 02:51:46.659927 1 shared_informer.go:356] "Caches are synced" controller="PVC protection"
I1122 02:51:46.659973 1 shared_informer.go:356] "Caches are synced" controller="taint"
I1122 02:51:46.660029 1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
I1122 02:51:46.660094 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="default-k8s-diff-port-714134"
I1122 02:51:46.660140 1 node_lifecycle_controller.go:1067] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"
I1122 02:51:46.662238 1 shared_informer.go:356] "Caches are synced" controller="expand"
I1122 02:51:46.664385 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1122 02:51:46.667359 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1122 02:51:46.669520 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1122 02:51:46.683654 1 shared_informer.go:356] "Caches are synced" controller="HPA"
I1122 02:51:46.705233 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:46.705365 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1122 02:51:46.705423 1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
I1122 02:51:46.705440 1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
==> kube-proxy [fa9c797804b364958ce3838ea057a935bde8cc983a6e23742cbdad2dc97cc42e] <==
I1122 02:51:44.081648 1 server_linux.go:53] "Using iptables proxy"
I1122 02:51:44.146017 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1122 02:51:44.246974 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1122 02:51:44.247023 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.94.2"]
E1122 02:51:44.247118 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1122 02:51:44.271987 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1122 02:51:44.272058 1 server_linux.go:132] "Using iptables Proxier"
I1122 02:51:44.279482 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1122 02:51:44.280013 1 server.go:527] "Version info" version="v1.34.1"
I1122 02:51:44.280195 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:44.282469 1 config.go:200] "Starting service config controller"
I1122 02:51:44.283808 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1122 02:51:44.282756 1 config.go:309] "Starting node config controller"
I1122 02:51:44.283874 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1122 02:51:44.283882 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1122 02:51:44.283235 1 config.go:403] "Starting serviceCIDR config controller"
I1122 02:51:44.283891 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1122 02:51:44.283222 1 config.go:106] "Starting endpoint slice config controller"
I1122 02:51:44.283938 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1122 02:51:44.384047 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
I1122 02:51:44.384040 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1122 02:51:44.384040 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
==> kube-scheduler [03fed611f7c3cbf50382912d7cbabd333991a19de2482f5c1b98d1c84cc5c8b4] <==
I1122 02:51:42.031077 1 serving.go:386] Generated self-signed cert in-memory
I1122 02:51:44.422680 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1122 02:51:44.422714 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1122 02:51:44.428057 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I1122 02:51:44.428091 1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
I1122 02:51:44.428134 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.428300 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.428143 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.428357 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.428419 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1122 02:51:44.428494 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1122 02:51:44.528875 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1122 02:51:44.528954 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1122 02:51:44.528920 1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
==> kubelet <==
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405064 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsdp\" (UniqueName: \"kubernetes.io/projected/dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd-kube-api-access-wvsdp\") pod \"dashboard-metrics-scraper-6ffb444bf9-dsjk4\" (UID: \"dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4"
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405101 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54r75\" (UniqueName: \"kubernetes.io/projected/a3c3fe98-1996-46a2-943e-a5cd63e9d822-kube-api-access-54r75\") pod \"kubernetes-dashboard-855c9754f9-jdn6w\" (UID: \"a3c3fe98-1996-46a2-943e-a5cd63e9d822\") " pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-jdn6w"
Nov 22 02:51:47 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:47.405128 717 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd-tmp-volume\") pod \"dashboard-metrics-scraper-6ffb444bf9-dsjk4\" (UID: \"dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4"
Nov 22 02:51:50 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:50.731617 717 scope.go:117] "RemoveContainer" containerID="97f63589a6f5bae3726c721bc8850dd7c37385232b54e4fdace60c4fba200430"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:51.736833 717 scope.go:117] "RemoveContainer" containerID="97f63589a6f5bae3726c721bc8850dd7c37385232b54e4fdace60c4fba200430"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:51.737181 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:51:51 default-k8s-diff-port-714134 kubelet[717]: E1122 02:51:51.737365 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:51:52 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:52.741341 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:51:52 default-k8s-diff-port-714134 kubelet[717]: E1122 02:51:52.741535 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:51:55 default-k8s-diff-port-714134 kubelet[717]: I1122 02:51:55.757524 717 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-855c9754f9-jdn6w" podStartSLOduration=1.409312836 podStartE2EDuration="8.757502896s" podCreationTimestamp="2025-11-22 02:51:47 +0000 UTC" firstStartedPulling="2025-11-22 02:51:47.622470654 +0000 UTC m=+7.084625260" lastFinishedPulling="2025-11-22 02:51:54.97066072 +0000 UTC m=+14.432815320" observedRunningTime="2025-11-22 02:51:55.756923804 +0000 UTC m=+15.219078418" watchObservedRunningTime="2025-11-22 02:51:55.757502896 +0000 UTC m=+15.219657507"
Nov 22 02:52:00 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:00.869739 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:01.762433 717 scope.go:117] "RemoveContainer" containerID="8807fb4f0c28b2ca68da3c823218598ead3cf1a06b8d1488bae2b7d897c635e3"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:01.762731 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:01 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:01.762949 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:10 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:10.870508 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:10 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:10.870738 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:14 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:14.795683 717 scope.go:117] "RemoveContainer" containerID="76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.643382 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.815189 717 scope.go:117] "RemoveContainer" containerID="a3e54e66b57ba0ff5f2ab6533dcc278c67736db79b35b7f7a7500509a0a20dfd"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: I1122 02:52:21.815452 717 scope.go:117] "RemoveContainer" containerID="9f14d94d46b2c9f138ad0fa1157aad31f25d211ed2f8624aee65429c18093855"
Nov 22 02:52:21 default-k8s-diff-port-714134 kubelet[717]: E1122 02:52:21.815639 717 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6ffb444bf9-dsjk4_kubernetes-dashboard(dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-dsjk4" podUID="dfb7fe6a-b3e8-4140-b6f8-f11efe12bdfd"
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent...
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: kubelet.service: Deactivated successfully.
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent.
Nov 22 02:52:29 default-k8s-diff-port-714134 systemd[1]: kubelet.service: Consumed 1.526s CPU time.
==> kubernetes-dashboard [65c643dd5c669e49c5e116235f7eaaf31e7a28872397cc3f7a7d5cb97557a30e] <==
2025/11/22 02:51:55 Starting overwatch
2025/11/22 02:51:55 Using namespace: kubernetes-dashboard
2025/11/22 02:51:55 Using in-cluster config to connect to apiserver
2025/11/22 02:51:55 Using secret token for csrf signing
2025/11/22 02:51:55 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/11/22 02:51:55 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/11/22 02:51:55 Successful initial request to the apiserver, version: v1.34.1
2025/11/22 02:51:55 Generating JWE encryption key
2025/11/22 02:51:55 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/11/22 02:51:55 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/11/22 02:51:55 Initializing JWE encryption key from synchronized object
2025/11/22 02:51:55 Creating in-cluster Sidecar client
2025/11/22 02:51:55 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/11/22 02:51:55 Serving insecurely on HTTP port: 9090
2025/11/22 02:52:25 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [38dbf8959ebdd2422e303100481118e6dc676fe4f33af9ad7fac6a301953baa7] <==
I1122 02:52:14.843119 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1122 02:52:14.850302 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1122 02:52:14.850335 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
W1122 02:52:14.852317 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:18.306546 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:22.566848 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:26.164695 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:29.218514 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.241040 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.246231 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:32.246362 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1122 02:52:32.246545 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64!
I1122 02:52:32.246546 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"ac612922-cc8d-492b-8e78-8d20922eff82", APIVersion:"v1", ResourceVersion:"665", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64 became leader
W1122 02:52:32.249031 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
W1122 02:52:32.252545 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
I1122 02:52:32.346792 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-714134_00092c06-7242-4298-a721-247561177c64!
==> storage-provisioner [76bb9df11eaef9abf42f765392bafea9368d45dd9f06b0bdd76e1f6884bccecf] <==
I1122 02:51:44.040963 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1122 02:52:14.044081 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134: exit status 2 (307.533173ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run: kubectl --context default-k8s-diff-port-714134 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (5.34s)
=== RUN TestDownloadOnly/v1.28.0/json-events
aaa_download_only_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-370119 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker --container-runtime=crio
aaa_download_only_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-370119 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker --container-runtime=crio: (4.926096909s)
--- PASS: TestDownloadOnly/v1.28.0/json-events (4.93s)
=== RUN TestDownloadOnly/v1.28.0/preload-exists
I1122 01:55:57.286966 15072 preload.go:188] Checking if preload exists for k8s version v1.28.0 and runtime crio
I1122 01:55:57.287067 15072 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.28.0/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.28.0/LogsDuration
aaa_download_only_test.go:183: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-370119
aaa_download_only_test.go:183: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-370119: exit status 85 (66.973208ms)
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬──────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼──────────┤
│ start │ -o=json --download-only -p download-only-370119 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker --container-runtime=crio │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴──────────┘
==> Last Start <==
Log file created at: 2025/11/22 01:55:52
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 01:55:52.410367 15083 out.go:360] Setting OutFile to fd 1 ...
I1122 01:55:52.410623 15083 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:55:52.410633 15083 out.go:374] Setting ErrFile to fd 2...
I1122 01:55:52.410637 15083 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:55:52.410833 15083 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
W1122 01:55:52.410952 15083 root.go:314] Error reading config file at /home/jenkins/minikube-integration/21946-11041/.minikube/config/config.json: open /home/jenkins/minikube-integration/21946-11041/.minikube/config/config.json: no such file or directory
I1122 01:55:52.411379 15083 out.go:368] Setting JSON to true
I1122 01:55:52.412322 15083 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2295,"bootTime":1763774257,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 01:55:52.412404 15083 start.go:143] virtualization: kvm guest
I1122 01:55:52.414357 15083 out.go:99] [download-only-370119] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
W1122 01:55:52.414481 15083 preload.go:354] Failed to list preload files: open /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball: no such file or directory
I1122 01:55:52.414521 15083 notify.go:221] Checking for updates...
I1122 01:55:52.415546 15083 out.go:171] MINIKUBE_LOCATION=21946
I1122 01:55:52.416851 15083 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 01:55:52.417949 15083 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:55:52.419075 15083 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 01:55:52.420184 15083 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
W1122 01:55:52.422177 15083 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1122 01:55:52.422461 15083 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 01:55:52.444900 15083 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 01:55:52.445009 15083 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:55:52.821184 15083 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:false NGoroutines:64 SystemTime:2025-11-22 01:55:52.812253517 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:55:52.821328 15083 docker.go:319] overlay module found
I1122 01:55:52.822866 15083 out.go:99] Using the docker driver based on user configuration
I1122 01:55:52.822896 15083 start.go:309] selected driver: docker
I1122 01:55:52.822927 15083 start.go:927] validating driver "docker" against <nil>
I1122 01:55:52.823047 15083 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:55:52.880487 15083 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:false NGoroutines:64 SystemTime:2025-11-22 01:55:52.870871363 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:55:52.880631 15083 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 01:55:52.881157 15083 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
I1122 01:55:52.881304 15083 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
I1122 01:55:52.882779 15083 out.go:171] Using Docker driver with root privileges
* The control-plane node download-only-370119 host does not exist
To start a cluster, run: "minikube start -p download-only-370119"
-- /stdout --
aaa_download_only_test.go:184: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.0/LogsDuration (0.07s)
=== RUN TestDownloadOnly/v1.28.0/DeleteAll
aaa_download_only_test.go:196: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.0/DeleteAll (0.21s)
=== RUN TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:207: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-370119
--- PASS: TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds (0.13s)
=== RUN TestDownloadOnly/v1.34.1/json-events
aaa_download_only_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-425432 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=crio --driver=docker --container-runtime=crio
aaa_download_only_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-425432 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=crio --driver=docker --container-runtime=crio: (4.214418069s)
--- PASS: TestDownloadOnly/v1.34.1/json-events (4.21s)
=== RUN TestDownloadOnly/v1.34.1/preload-exists
I1122 01:56:01.907190 15072 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1122 01:56:01.907231 15072 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.34.1/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.34.1/LogsDuration
aaa_download_only_test.go:183: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-425432
aaa_download_only_test.go:183: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-425432: exit status 85 (69.279763ms)
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ -o=json --download-only -p download-only-370119 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker --container-runtime=crio │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ │
│ delete │ --all │ minikube │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ 22 Nov 25 01:55 UTC │
│ delete │ -p download-only-370119 │ download-only-370119 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ 22 Nov 25 01:55 UTC │
│ start │ -o=json --download-only -p download-only-425432 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=crio --driver=docker --container-runtime=crio │ download-only-425432 │ jenkins │ v1.37.0 │ 22 Nov 25 01:55 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/22 01:55:57
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1122 01:55:57.744601 15439 out.go:360] Setting OutFile to fd 1 ...
I1122 01:55:57.744686 15439 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:55:57.744693 15439 out.go:374] Setting ErrFile to fd 2...
I1122 01:55:57.744697 15439 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 01:55:57.744855 15439 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 01:55:57.745283 15439 out.go:368] Setting JSON to true
I1122 01:55:57.746070 15439 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2301,"bootTime":1763774257,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 01:55:57.746144 15439 start.go:143] virtualization: kvm guest
I1122 01:55:57.748023 15439 out.go:99] [download-only-425432] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 01:55:57.748201 15439 notify.go:221] Checking for updates...
I1122 01:55:57.749261 15439 out.go:171] MINIKUBE_LOCATION=21946
I1122 01:55:57.750493 15439 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 01:55:57.751605 15439 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 01:55:57.752704 15439 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 01:55:57.753652 15439 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
W1122 01:55:57.755477 15439 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1122 01:55:57.755684 15439 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 01:55:57.777321 15439 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 01:55:57.777413 15439 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:55:57.832575 15439 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:52 SystemTime:2025-11-22 01:55:57.82387777 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:55:57.832683 15439 docker.go:319] overlay module found
I1122 01:55:57.834085 15439 out.go:99] Using the docker driver based on user configuration
I1122 01:55:57.834111 15439 start.go:309] selected driver: docker
I1122 01:55:57.834116 15439 start.go:927] validating driver "docker" against <nil>
I1122 01:55:57.834183 15439 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 01:55:57.888337 15439 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:52 SystemTime:2025-11-22 01:55:57.879146721 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 01:55:57.888475 15439 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1122 01:55:57.888940 15439 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
I1122 01:55:57.889102 15439 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
I1122 01:55:57.890520 15439 out.go:171] Using Docker driver with root privileges
* The control-plane node download-only-425432 host does not exist
To start a cluster, run: "minikube start -p download-only-425432"
-- /stdout --
aaa_download_only_test.go:184: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.34.1/LogsDuration (0.07s)
=== RUN TestDownloadOnly/v1.34.1/DeleteAll
aaa_download_only_test.go:196: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.34.1/DeleteAll (0.21s)
=== RUN TestDownloadOnly/v1.34.1/DeleteAlwaysSucceeds
aaa_download_only_test.go:207: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-425432
--- PASS: TestDownloadOnly/v1.34.1/DeleteAlwaysSucceeds (0.13s)
=== RUN TestDownloadOnlyKic
aaa_download_only_test.go:231: (dbg) Run: out/minikube-linux-amd64 start --download-only -p download-docker-727919 --alsologtostderr --driver=docker --container-runtime=crio
helpers_test.go:175: Cleaning up "download-docker-727919" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p download-docker-727919
--- PASS: TestDownloadOnlyKic (0.38s)
=== RUN TestBinaryMirror
I1122 01:56:02.977948 15072 binary.go:80] Not caching binary, using https://dl.k8s.io/release/v1.34.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.34.1/bin/linux/amd64/kubectl.sha256
aaa_download_only_test.go:309: (dbg) Run: out/minikube-linux-amd64 start --download-only -p binary-mirror-401760 --alsologtostderr --binary-mirror http://127.0.0.1:33657 --driver=docker --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-401760" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p binary-mirror-401760
--- PASS: TestBinaryMirror (0.79s)
=== RUN TestOffline
=== PAUSE TestOffline
=== CONT TestOffline
aab_offline_test.go:55: (dbg) Run: out/minikube-linux-amd64 start -p offline-crio-452181 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=crio
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-crio-452181 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=crio: (49.497975608s)
helpers_test.go:175: Cleaning up "offline-crio-452181" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p offline-crio-452181
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-crio-452181: (7.092279359s)
--- PASS: TestOffline (56.59s)
=== RUN TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1000: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-416530
addons_test.go:1000: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-416530: exit status 85 (62.651367ms)
-- stdout --
* Profile "addons-416530" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-416530"
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)
=== RUN TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1011: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-416530
addons_test.go:1011: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-416530: exit status 85 (61.980495ms)
-- stdout --
* Profile "addons-416530" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-416530"
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)
=== RUN TestAddons/Setup
addons_test.go:108: (dbg) Run: out/minikube-linux-amd64 start -p addons-416530 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:108: (dbg) Done: out/minikube-linux-amd64 start -p addons-416530 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (2m1.869778493s)
--- PASS: TestAddons/Setup (121.87s)
=== RUN TestAddons/serial/GCPAuth/Namespaces
addons_test.go:630: (dbg) Run: kubectl --context addons-416530 create ns new-namespace
addons_test.go:644: (dbg) Run: kubectl --context addons-416530 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.12s)
=== RUN TestAddons/serial/GCPAuth/FakeCredentials
addons_test.go:675: (dbg) Run: kubectl --context addons-416530 create -f testdata/busybox.yaml
addons_test.go:682: (dbg) Run: kubectl --context addons-416530 create sa gcp-auth-test
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [239d109d-62b1-4acc-82d0-9e4940ee5d0a] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [239d109d-62b1-4acc-82d0-9e4940ee5d0a] Running
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 8.002538071s
addons_test.go:694: (dbg) Run: kubectl --context addons-416530 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:706: (dbg) Run: kubectl --context addons-416530 describe sa gcp-auth-test
addons_test.go:744: (dbg) Run: kubectl --context addons-416530 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (8.41s)
=== RUN TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run: out/minikube-linux-amd64 stop -p addons-416530
addons_test.go:172: (dbg) Done: out/minikube-linux-amd64 stop -p addons-416530: (18.157251888s)
addons_test.go:176: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-416530
addons_test.go:180: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-416530
addons_test.go:185: (dbg) Run: out/minikube-linux-amd64 addons disable gvisor -p addons-416530
--- PASS: TestAddons/StoppedEnableDisable (18.43s)
=== RUN TestCertOptions
=== PAUSE TestCertOptions
=== CONT TestCertOptions
cert_options_test.go:49: (dbg) Run: out/minikube-linux-amd64 start -p cert-options-122327 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-122327 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --container-runtime=crio: (22.434422835s)
cert_options_test.go:60: (dbg) Run: out/minikube-linux-amd64 -p cert-options-122327 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run: kubectl --context cert-options-122327 config view
cert_options_test.go:100: (dbg) Run: out/minikube-linux-amd64 ssh -p cert-options-122327 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-122327" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-options-122327
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-122327: (2.370245694s)
--- PASS: TestCertOptions (25.53s)
=== RUN TestCertExpiration
=== PAUSE TestCertExpiration
=== CONT TestCertExpiration
cert_options_test.go:123: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-304265 --memory=3072 --cert-expiration=3m --driver=docker --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-304265 --memory=3072 --cert-expiration=3m --driver=docker --container-runtime=crio: (23.972227554s)
cert_options_test.go:131: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-304265 --memory=3072 --cert-expiration=8760h --driver=docker --container-runtime=crio
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-304265 --memory=3072 --cert-expiration=8760h --driver=docker --container-runtime=crio: (7.48773653s)
helpers_test.go:175: Cleaning up "cert-expiration-304265" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-expiration-304265
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-304265: (3.64903275s)
--- PASS: TestCertExpiration (215.11s)
=== RUN TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag
=== CONT TestForceSystemdFlag
docker_test.go:91: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-flag-121484 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker --container-runtime=crio
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-121484 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker --container-runtime=crio: (22.399531111s)
docker_test.go:132: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-flag-121484 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-121484" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-flag-121484
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-121484: (2.511876607s)
--- PASS: TestForceSystemdFlag (25.20s)
=== RUN TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv
=== CONT TestForceSystemdEnv
docker_test.go:155: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-env-398585 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-398585 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio: (21.420197671s)
helpers_test.go:175: Cleaning up "force-systemd-env-398585" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-env-398585
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-398585: (2.617413561s)
--- PASS: TestForceSystemdEnv (24.04s)
=== RUN TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -p nospam-957527 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-957527 --driver=docker --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-957527 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-957527 --driver=docker --container-runtime=crio: (20.739622003s)
--- PASS: TestErrorSpam/setup (20.74s)
=== RUN TestErrorSpam/start
error_spam_test.go:206: Cleaning up 1 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 start --dry-run
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 start --dry-run
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 start --dry-run
--- PASS: TestErrorSpam/start (0.63s)
=== RUN TestErrorSpam/status
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 status
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 status
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 status
--- PASS: TestErrorSpam/status (0.91s)
=== RUN TestErrorSpam/pause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause
error_spam_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause: exit status 80 (1.598340286s)
-- stdout --
* Pausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:38Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:151: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause" failed: exit status 80
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause
error_spam_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause: exit status 80 (1.97202894s)
-- stdout --
* Pausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:40Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:151: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause" failed: exit status 80
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause
error_spam_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause: exit status 80 (2.339086398s)
-- stdout --
* Pausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_PAUSE: Pause: list running: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:42Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:174: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 pause" failed: exit status 80
--- PASS: TestErrorSpam/pause (5.91s)
=== RUN TestErrorSpam/unpause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause
error_spam_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause: exit status 80 (1.701385861s)
-- stdout --
* Unpausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_UNPAUSE: Pause: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:44Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:151: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause" failed: exit status 80
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause
error_spam_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause: exit status 80 (1.979891699s)
-- stdout --
* Unpausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_UNPAUSE: Pause: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:46Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:151: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause" failed: exit status 80
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause
error_spam_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause: exit status 80 (1.40051104s)
-- stdout --
* Unpausing node nospam-957527 ...
-- /stdout --
** stderr **
X Exiting due to GUEST_UNPAUSE: Pause: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-22T02:01:47Z" level=error msg="open /run/runc: no such file or directory"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_delete_7f6b85125f52d8b6f2676a081a2b9f4eb5a7d9b1_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
error_spam_test.go:174: "out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 unpause" failed: exit status 80
--- PASS: TestErrorSpam/unpause (5.08s)
=== RUN TestErrorSpam/stop
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 stop
error_spam_test.go:149: (dbg) Done: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 stop: (2.377671226s)
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 stop
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-957527 --log_dir /tmp/nospam-957527 stop
--- PASS: TestErrorSpam/stop (2.57s)
=== RUN TestFunctional/serial/CopySyncFile
functional_test.go:1860: local sync path: /home/jenkins/minikube-integration/21946-11041/.minikube/files/etc/test/nested/copy/15072/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)
=== RUN TestFunctional/serial/StartWithProxy
functional_test.go:2239: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker --container-runtime=crio
functional_test.go:2239: (dbg) Done: out/minikube-linux-amd64 start -p functional-593219 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker --container-runtime=crio: (37.464589135s)
--- PASS: TestFunctional/serial/StartWithProxy (37.47s)
=== RUN TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)
=== RUN TestFunctional/serial/SoftStart
I1122 02:02:32.947689 15072 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
functional_test.go:674: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --alsologtostderr -v=8
functional_test.go:674: (dbg) Done: out/minikube-linux-amd64 start -p functional-593219 --alsologtostderr -v=8: (5.814881999s)
functional_test.go:678: soft start took 5.816081132s for "functional-593219" cluster.
I1122 02:02:38.763492 15072 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestFunctional/serial/SoftStart (5.82s)
=== RUN TestFunctional/serial/KubeContext
functional_test.go:696: (dbg) Run: kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)
=== RUN TestFunctional/serial/KubectlGetPods
functional_test.go:711: (dbg) Run: kubectl --context functional-593219 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.07s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache add registry.k8s.io/pause:3.1
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache add registry.k8s.io/pause:3.3
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.58s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1092: (dbg) Run: docker build -t minikube-local-cache-test:functional-593219 /tmp/TestFunctionalserialCacheCmdcacheadd_local2078246313/001
functional_test.go:1104: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache add minikube-local-cache-test:functional-593219
functional_test.go:1109: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache delete minikube-local-cache-test:functional-593219
functional_test.go:1098: (dbg) Run: docker rmi minikube-local-cache-test:functional-593219
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.11s)
=== RUN TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1117: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)
=== RUN TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1125: (dbg) Run: out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)
=== RUN TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1139: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.28s)
=== RUN TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1162: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (274.829479ms)
-- stdout --
[31mFATA[0m[0000] no such image "registry.k8s.io/pause:latest" present
-- /stdout --
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:1173: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cache reload
functional_test.go:1178: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.49s)
=== RUN TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1187: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1187: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)
=== RUN TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:731: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 kubectl -- --context functional-593219 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.11s)
=== RUN TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:756: (dbg) Run: out/kubectl --context functional-593219 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)
=== RUN TestFunctional/serial/ExtraConfig
functional_test.go:772: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1122 02:03:06.255049 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.261371 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.272708 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.294027 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.335329 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.416675 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.578129 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:06.899648 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:07.541689 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:08.823060 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:11.384512 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:16.506551 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:03:26.748562 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:772: (dbg) Done: out/minikube-linux-amd64 start -p functional-593219 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (42.046413262s)
functional_test.go:776: restart took 42.046536526s for "functional-593219" cluster.
I1122 02:03:26.838845 15072 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestFunctional/serial/ExtraConfig (42.05s)
=== RUN TestFunctional/serial/ComponentHealth
functional_test.go:825: (dbg) Run: kubectl --context functional-593219 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:840: etcd phase: Running
functional_test.go:850: etcd status: Ready
functional_test.go:840: kube-apiserver phase: Running
functional_test.go:850: kube-apiserver status: Ready
functional_test.go:840: kube-controller-manager phase: Running
functional_test.go:850: kube-controller-manager status: Ready
functional_test.go:840: kube-scheduler phase: Running
functional_test.go:850: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.06s)
=== RUN TestFunctional/serial/LogsCmd
functional_test.go:1251: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 logs
functional_test.go:1251: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 logs: (1.118003879s)
--- PASS: TestFunctional/serial/LogsCmd (1.12s)
=== RUN TestFunctional/serial/LogsFileCmd
functional_test.go:1265: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 logs --file /tmp/TestFunctionalserialLogsFileCmd333191833/001/logs.txt
functional_test.go:1265: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 logs --file /tmp/TestFunctionalserialLogsFileCmd333191833/001/logs.txt: (1.121545883s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.12s)
=== RUN TestFunctional/serial/InvalidService
functional_test.go:2326: (dbg) Run: kubectl --context functional-593219 apply -f testdata/invalidsvc.yaml
functional_test.go:2340: (dbg) Run: out/minikube-linux-amd64 service invalid-svc -p functional-593219
functional_test.go:2340: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-593219: exit status 115 (322.064123ms)
-- stdout --
┌───────────┬─────────────┬─────────────┬───────────────────────────┐
│ NAMESPACE │ NAME │ TARGET PORT │ URL │
├───────────┼─────────────┼─────────────┼───────────────────────────┤
│ default │ invalid-svc │ 80 │ http://192.168.49.2:30456 │
└───────────┴─────────────┴─────────────┴───────────────────────────┘
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:2332: (dbg) Run: kubectl --context functional-593219 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.88s)
=== RUN TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config unset cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 config get cpus: exit status 14 (96.482483ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config set cpus 2
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config get cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config unset cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 config get cpus: exit status 14 (83.991824ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.46s)
=== RUN TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd
=== CONT TestFunctional/parallel/DashboardCmd
functional_test.go:920: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-593219 --alsologtostderr -v=1]
functional_test.go:925: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-593219 --alsologtostderr -v=1] ...
helpers_test.go:525: unable to kill pid 52011: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (7.98s)
=== RUN TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun
=== CONT TestFunctional/parallel/DryRun
functional_test.go:989: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=crio
functional_test.go:989: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-593219 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=crio: exit status 23 (150.921808ms)
-- stdout --
* [functional-593219] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on existing profile
-- /stdout --
** stderr **
I1122 02:03:49.215619 50979 out.go:360] Setting OutFile to fd 1 ...
I1122 02:03:49.215862 50979 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.215872 50979 out.go:374] Setting ErrFile to fd 2...
I1122 02:03:49.215875 50979 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.216079 50979 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:03:49.216453 50979 out.go:368] Setting JSON to false
I1122 02:03:49.217311 50979 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2772,"bootTime":1763774257,"procs":219,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:03:49.217387 50979 start.go:143] virtualization: kvm guest
I1122 02:03:49.219382 50979 out.go:179] * [functional-593219] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:03:49.220885 50979 notify.go:221] Checking for updates...
I1122 02:03:49.220893 50979 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:03:49.222377 50979 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:03:49.223567 50979 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:03:49.224674 50979 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:03:49.225695 50979 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:03:49.226732 50979 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:03:49.228108 50979 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:03:49.228550 50979 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:03:49.251614 50979 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:03:49.251715 50979 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:03:49.305449 50979 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-11-22 02:03:49.29676062 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:03:49.305549 50979 docker.go:319] overlay module found
I1122 02:03:49.307607 50979 out.go:179] * Using the docker driver based on existing profile
I1122 02:03:49.308514 50979 start.go:309] selected driver: docker
I1122 02:03:49.308525 50979 start.go:927] validating driver "docker" against &{Name:functional-593219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:functional-593219 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:03:49.308636 50979 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:03:49.310079 50979 out.go:203]
W1122 02:03:49.311106 50979 out.go:285] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
I1122 02:03:49.312155 50979 out.go:203]
** /stderr **
functional_test.go:1006: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --dry-run --alsologtostderr -v=1 --driver=docker --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.37s)
=== RUN TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage
=== CONT TestFunctional/parallel/InternationalLanguage
functional_test.go:1035: (dbg) Run: out/minikube-linux-amd64 start -p functional-593219 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=crio
functional_test.go:1035: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-593219 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=crio: exit status 23 (167.717304ms)
-- stdout --
* [functional-593219] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Utilisation du pilote docker basé sur le profil existant
-- /stdout --
** stderr **
I1122 02:03:49.599236 51244 out.go:360] Setting OutFile to fd 1 ...
I1122 02:03:49.599334 51244 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.599342 51244 out.go:374] Setting ErrFile to fd 2...
I1122 02:03:49.599346 51244 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:03:49.599601 51244 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:03:49.600042 51244 out.go:368] Setting JSON to false
I1122 02:03:49.601206 51244 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":2773,"bootTime":1763774257,"procs":221,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:03:49.601320 51244 start.go:143] virtualization: kvm guest
I1122 02:03:49.604020 51244 out.go:179] * [functional-593219] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
I1122 02:03:49.605271 51244 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:03:49.605287 51244 notify.go:221] Checking for updates...
I1122 02:03:49.607362 51244 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:03:49.608543 51244 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:03:49.609501 51244 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:03:49.610472 51244 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:03:49.611507 51244 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:03:49.613205 51244 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:03:49.613862 51244 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:03:49.638463 51244 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:03:49.638559 51244 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:03:49.692188 51244 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-11-22 02:03:49.683000737 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:03:49.692292 51244 docker.go:319] overlay module found
I1122 02:03:49.693840 51244 out.go:179] * Utilisation du pilote docker basé sur le profil existant
I1122 02:03:49.694861 51244 start.go:309] selected driver: docker
I1122 02:03:49.694876 51244 start.go:927] validating driver "docker" against &{Name:functional-593219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763507788-21924@sha256:1e20c07242571f3eb6bbb213b88269c923b5578034662e07409047e7102bdd1a Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:functional-593219 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1122 02:03:49.694996 51244 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:03:49.696554 51244 out.go:203]
W1122 02:03:49.697529 51244 out.go:285] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
I1122 02:03:49.698704 51244 out.go:203]
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.17s)
=== RUN TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd
=== CONT TestFunctional/parallel/StatusCmd
functional_test.go:869: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 status
functional_test.go:875: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:887: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.10s)
=== RUN TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd
=== CONT TestFunctional/parallel/AddonsCmd
functional_test.go:1695: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 addons list
functional_test.go:1707: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.14s)
=== RUN TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:352: "storage-provisioner" [419b937c-0dd5-4455-ac33-f72c450a4627] Running
2025/11/22 02:03:57 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.004365696s
functional_test_pvc_test.go:55: (dbg) Run: kubectl --context functional-593219 get storageclass -o=json
functional_test_pvc_test.go:75: (dbg) Run: kubectl --context functional-593219 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:82: (dbg) Run: kubectl --context functional-593219 get pvc myclaim -o=json
functional_test_pvc_test.go:131: (dbg) Run: kubectl --context functional-593219 apply -f testdata/storage-provisioner/pod.yaml
I1122 02:04:00.291722 15072 detect.go:223] nested VM detected
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [a80a670e-dc7f-4b99-b0a6-455f33a2764b] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:352: "sp-pod" [a80a670e-dc7f-4b99-b0a6-455f33a2764b] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.002967547s
functional_test_pvc_test.go:106: (dbg) Run: kubectl --context functional-593219 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:112: (dbg) Run: kubectl --context functional-593219 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:131: (dbg) Run: kubectl --context functional-593219 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [012ed49f-61d1-4b6b-98cb-76a359d21198] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:352: "sp-pod" [012ed49f-61d1-4b6b-98cb-76a359d21198] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.002592563s
functional_test_pvc_test.go:120: (dbg) Run: kubectl --context functional-593219 exec sp-pod -- ls /tmp/mount
E1122 02:04:28.191530 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:05:50.113628 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:08:06.245264 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:08:33.955599 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:13:06.245945 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (24.48s)
=== RUN TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd
=== CONT TestFunctional/parallel/SSHCmd
functional_test.go:1730: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "echo hello"
functional_test.go:1747: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.62s)
=== RUN TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd
=== CONT TestFunctional/parallel/CpCmd
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh -n functional-593219 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cp functional-593219:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd2938136030/001/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh -n functional-593219 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh -n functional-593219 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.75s)
=== RUN TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1798: (dbg) Run: kubectl --context functional-593219 replace --force -f testdata/mysql.yaml
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:352: "mysql-5bb876957f-hqzm8" [1c50a72c-c717-45e0-adbc-1c84b313a2cf] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
helpers_test.go:352: "mysql-5bb876957f-hqzm8" [1c50a72c-c717-45e0-adbc-1c84b313a2cf] Running
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 14.002922468s
functional_test.go:1812: (dbg) Run: kubectl --context functional-593219 exec mysql-5bb876957f-hqzm8 -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-593219 exec mysql-5bb876957f-hqzm8 -- mysql -ppassword -e "show databases;": exit status 1 (85.649728ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
command terminated with exit code 1
** /stderr **
I1122 02:03:47.908594 15072 retry.go:31] will retry after 1.173838465s: exit status 1
functional_test.go:1812: (dbg) Run: kubectl --context functional-593219 exec mysql-5bb876957f-hqzm8 -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (15.52s)
=== RUN TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync
=== CONT TestFunctional/parallel/FileSync
functional_test.go:1934: Checking for existence of /etc/test/nested/copy/15072/hosts within VM
functional_test.go:1936: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /etc/test/nested/copy/15072/hosts"
functional_test.go:1941: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.30s)
=== RUN TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1977: Checking for existence of /etc/ssl/certs/15072.pem within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /etc/ssl/certs/15072.pem"
functional_test.go:1977: Checking for existence of /usr/share/ca-certificates/15072.pem within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /usr/share/ca-certificates/15072.pem"
functional_test.go:1977: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/150722.pem within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /etc/ssl/certs/150722.pem"
functional_test.go:2004: Checking for existence of /usr/share/ca-certificates/150722.pem within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /usr/share/ca-certificates/150722.pem"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.76s)
=== RUN TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels
=== CONT TestFunctional/parallel/NodeLabels
functional_test.go:234: (dbg) Run: kubectl --context functional-593219 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.06s)
=== RUN TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled
=== CONT TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2032: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo systemctl is-active docker"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "sudo systemctl is-active docker": exit status 1 (331.134092ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
functional_test.go:2032: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo systemctl is-active containerd"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "sudo systemctl is-active containerd": exit status 1 (331.190367ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.66s)
=== RUN TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License
=== CONT TestFunctional/parallel/License
functional_test.go:2293: (dbg) Run: out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.45s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort
=== CONT TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls --format short --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-593219 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10.1
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.34.1
registry.k8s.io/kube-proxy:v1.34.1
registry.k8s.io/kube-controller-manager:v1.34.1
registry.k8s.io/kube-apiserver:v1.34.1
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/kindest/kindnetd:v20250512-df8de77b
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-593219 image ls --format short --alsologtostderr:
I1122 02:04:08.273627 54373 out.go:360] Setting OutFile to fd 1 ...
I1122 02:04:08.273728 54373 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:08.273736 54373 out.go:374] Setting ErrFile to fd 2...
I1122 02:04:08.273740 54373 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:08.273898 54373 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:04:08.274420 54373 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:08.274510 54373 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:08.274848 54373 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:04:08.292051 54373 ssh_runner.go:195] Run: systemctl --version
I1122 02:04:08.292100 54373 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:04:08.308998 54373 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:04:08.400893 54373 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.21s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable
=== CONT TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls --format table --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-593219 image ls --format table --alsologtostderr:
┌─────────────────────────────────────────┬────────────────────┬───────────────┬────────┐
│ IMAGE │ TAG │ IMAGE ID │ SIZE │
├─────────────────────────────────────────┼────────────────────┼───────────────┼────────┤
│ docker.io/library/mysql │ 5.7 │ 5107333e08a87 │ 520MB │
│ gcr.io/k8s-minikube/busybox │ 1.28.4-glibc │ 56cc512116c8f │ 4.63MB │
│ registry.k8s.io/coredns/coredns │ v1.12.1 │ 52546a367cc9e │ 76.1MB │
│ registry.k8s.io/kube-apiserver │ v1.34.1 │ c3994bc696102 │ 89MB │
│ registry.k8s.io/kube-controller-manager │ v1.34.1 │ c80c8dbafe7dd │ 76MB │
│ docker.io/kindest/kindnetd │ v20250512-df8de77b │ 409467f978b4a │ 109MB │
│ docker.io/library/nginx │ alpine │ d4918ca78576a │ 54.3MB │
│ registry.k8s.io/etcd │ 3.6.4-0 │ 5f1f5298c888d │ 196MB │
│ docker.io/library/nginx │ latest │ 60adc2e137e75 │ 155MB │
│ gcr.io/k8s-minikube/storage-provisioner │ v5 │ 6e38f40d628db │ 31.5MB │
│ localhost/my-image │ functional-593219 │ b1fb3bd2f9f94 │ 1.47MB │
│ registry.k8s.io/kube-proxy │ v1.34.1 │ fc25172553d79 │ 73.1MB │
│ registry.k8s.io/pause │ 3.10.1 │ cd073f4c5f6a8 │ 742kB │
│ registry.k8s.io/pause │ 3.3 │ 0184c1613d929 │ 686kB │
│ gcr.io/k8s-minikube/busybox │ latest │ beae173ccac6a │ 1.46MB │
│ registry.k8s.io/kube-scheduler │ v1.34.1 │ 7dd6aaa1717ab │ 53.8MB │
│ registry.k8s.io/pause │ 3.1 │ da86e6ba6ca19 │ 747kB │
│ registry.k8s.io/pause │ latest │ 350b164e7ae1d │ 247kB │
└─────────────────────────────────────────┴────────────────────┴───────────────┴────────┘
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-593219 image ls --format table --alsologtostderr:
I1122 02:04:10.958987 55139 out.go:360] Setting OutFile to fd 1 ...
I1122 02:04:10.959250 55139 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.959260 55139 out.go:374] Setting ErrFile to fd 2...
I1122 02:04:10.959264 55139 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.959455 55139 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:04:10.960011 55139 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.960118 55139 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.960467 55139 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:04:10.978841 55139 ssh_runner.go:195] Run: systemctl --version
I1122 02:04:10.978878 55139 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:04:10.994940 55139 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:04:11.086806 55139 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.22s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson
=== CONT TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls --format json --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-593219 image ls --format json --alsologtostderr:
[{"id":"cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f","repoDigests":["registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c","registry.k8s.io/pause@sha256:e5b941ef8f71de54dc3a13398226c269ba217d06650a21bd3afcf9d890cf1f41"],"repoTags":["registry.k8s.io/pause:3.10.1"],"size":"742092"},{"id":"0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":["registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"686139"},{"id":"115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a","docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"43824855"},{"id":"5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933","repoDige
sts":["docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb","docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da"],"repoTags":["docker.io/library/mysql:5.7"],"size":"519571821"},{"id":"56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"4631262"},{"id":"6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944","gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"31470524
"},{"id":"7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813","repoDigests":["registry.k8s.io/kube-scheduler@sha256:47306e2178d9766fe3fe9eada02fa995f9f29dcbf518832293dfbe16964e2d31","registry.k8s.io/kube-scheduler@sha256:6e9fbc4e25a576483e6a233976353a66e4d77eb5d0530e9118e94b7d46fb3500"],"repoTags":["registry.k8s.io/kube-scheduler:v1.34.1"],"size":"53844823"},{"id":"da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":["registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"746911"},{"id":"07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029"],"repoTags":[],"size":"249229937"},{"id":"60adc2e137e757418d4d771822fa3b3f5d3b4ad58ef2385d200c9ee78375b6
d5","repoDigests":["docker.io/library/nginx@sha256:553f64aecdc31b5bf944521731cd70e35da4faed96b2b7548a3d8e2598c52a42","docker.io/library/nginx@sha256:5c733364e9a8f7e6d7289ceaad623c6600479fe95c3ab5534f07bfd7416d9541"],"repoTags":["docker.io/library/nginx:latest"],"size":"155491845"},{"id":"409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c","repoDigests":["docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a","docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11"],"repoTags":["docker.io/kindest/kindnetd:v20250512-df8de77b"],"size":"109379124"},{"id":"52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969","repoDigests":["registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998","registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c"],"repoTags":["registry.k8s.io/coredns/coredns:v1.12.1"],"size":"761035
47"},{"id":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","repoDigests":["registry.k8s.io/etcd@sha256:71170330936954286be203a7737459f2838dd71cc79f8ffaac91548a9e079b8f","registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19"],"repoTags":["registry.k8s.io/etcd:3.6.4-0"],"size":"195976448"},{"id":"c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97","repoDigests":["registry.k8s.io/kube-apiserver@sha256:264da1e0ab552e24b2eb034a1b75745df78fe8903bade1fa0f874f9167dad964","registry.k8s.io/kube-apiserver@sha256:b9d7c117f8ac52bed4b13aeed973dc5198f9d93a926e6fe9e0b384f155baa902"],"repoTags":["registry.k8s.io/kube-apiserver:v1.34.1"],"size":"89046001"},{"id":"350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":["registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9"],"repoTags":["registry.k8s.io/pause:latest"],"size":"247077"},{"id":"e8555493601dfb859f0a07ddc065c716acb7e52507372389adf
f23b30b990f5e","repoDigests":["docker.io/library/b172f8402fcf6ca4d7a43f99f07f9df8ac9ac782d3c80146f79a7225340e65ff-tmp@sha256:4f3c29cc22c6e1b85886d527be09f5bcf5d3eaccd37badf8067fe7dc9b472ee4"],"repoTags":[],"size":"1466132"},{"id":"d4918ca78576a537caa7b0c043051c8efc1796de33fee8724ee0fff4a1cabed9","repoDigests":["docker.io/library/nginx@sha256:667473807103639a0aca5b49534a216d2b64f0fb868aaa801f023da0cdd781c7","docker.io/library/nginx@sha256:b3c656d55d7ad751196f21b7fd2e8d4da9cb430e32f646adcf92441b72f82b14"],"repoTags":["docker.io/library/nginx:alpine"],"size":"54252718"},{"id":"beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:62ffc2ed7554e4c6d360bce40bbcf196573dd27c4ce080641a2c59867e732dee","gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b"],"repoTags":["gcr.io/k8s-minikube/busybox:latest"],"size":"1462480"},{"id":"b1fb3bd2f9f9442935dd05a8c7e1871d70312810c41758ab2958663365680a8b","repoDigests":["
localhost/my-image@sha256:e1ea81ac14bda00b43fa3b46ae2e9a2dac56632483d709c3acd7e06c4b8342b6"],"repoTags":["localhost/my-image:functional-593219"],"size":"1468744"},{"id":"c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:2bf47c1b01f51e8963bf2327390883c9fa4ed03ea1b284500a2cba17ce303e89","registry.k8s.io/kube-controller-manager@sha256:a6fe41965f1693c8a73ebe75e215d0b7c0902732c66c6692b0dbcfb0f077c992"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.34.1"],"size":"76004181"},{"id":"fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7","repoDigests":["registry.k8s.io/kube-proxy@sha256:913cc83ca0b5588a81d86ce8eedeb3ed1e9c1326e81852a1ea4f622b74ff749a","registry.k8s.io/kube-proxy@sha256:9e876d245c76f0e3529c82bb103b60a59c4e190317827f977ab696cc4f43020a"],"repoTags":["registry.k8s.io/kube-proxy:v1.34.1"],"size":"73138073"}]
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-593219 image ls --format json --alsologtostderr:
I1122 02:04:10.743095 55085 out.go:360] Setting OutFile to fd 1 ...
I1122 02:04:10.743362 55085 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.743375 55085 out.go:374] Setting ErrFile to fd 2...
I1122 02:04:10.743381 55085 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.743965 55085 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:04:10.744982 55085 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.745105 55085 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.745486 55085 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:04:10.763113 55085 ssh_runner.go:195] Run: systemctl --version
I1122 02:04:10.763156 55085 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:04:10.780520 55085 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:04:10.871762 55085 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.22s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml
=== CONT TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls --format yaml --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-593219 image ls --format yaml --alsologtostderr:
- id: 115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "43824855"
- id: 5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933
repoDigests:
- docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb
- docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da
repoTags:
- docker.io/library/mysql:5.7
size: "519571821"
- id: 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
- gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "31470524"
- id: c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:264da1e0ab552e24b2eb034a1b75745df78fe8903bade1fa0f874f9167dad964
- registry.k8s.io/kube-apiserver@sha256:b9d7c117f8ac52bed4b13aeed973dc5198f9d93a926e6fe9e0b384f155baa902
repoTags:
- registry.k8s.io/kube-apiserver:v1.34.1
size: "89046001"
- id: fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7
repoDigests:
- registry.k8s.io/kube-proxy@sha256:913cc83ca0b5588a81d86ce8eedeb3ed1e9c1326e81852a1ea4f622b74ff749a
- registry.k8s.io/kube-proxy@sha256:9e876d245c76f0e3529c82bb103b60a59c4e190317827f977ab696cc4f43020a
repoTags:
- registry.k8s.io/kube-proxy:v1.34.1
size: "73138073"
- id: cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f
repoDigests:
- registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c
- registry.k8s.io/pause@sha256:e5b941ef8f71de54dc3a13398226c269ba217d06650a21bd3afcf9d890cf1f41
repoTags:
- registry.k8s.io/pause:3.10.1
size: "742092"
- id: 07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
- docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029
repoTags: []
size: "249229937"
- id: 60adc2e137e757418d4d771822fa3b3f5d3b4ad58ef2385d200c9ee78375b6d5
repoDigests:
- docker.io/library/nginx@sha256:553f64aecdc31b5bf944521731cd70e35da4faed96b2b7548a3d8e2598c52a42
- docker.io/library/nginx@sha256:5c733364e9a8f7e6d7289ceaad623c6600479fe95c3ab5534f07bfd7416d9541
repoTags:
- docker.io/library/nginx:latest
size: "155491845"
- id: 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115
repoDigests:
- registry.k8s.io/etcd@sha256:71170330936954286be203a7737459f2838dd71cc79f8ffaac91548a9e079b8f
- registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19
repoTags:
- registry.k8s.io/etcd:3.6.4-0
size: "195976448"
- id: e8555493601dfb859f0a07ddc065c716acb7e52507372389adff23b30b990f5e
repoDigests:
- docker.io/library/b172f8402fcf6ca4d7a43f99f07f9df8ac9ac782d3c80146f79a7225340e65ff-tmp@sha256:4f3c29cc22c6e1b85886d527be09f5bcf5d3eaccd37badf8067fe7dc9b472ee4
repoTags: []
size: "1466132"
- id: 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "4631262"
- id: b1fb3bd2f9f9442935dd05a8c7e1871d70312810c41758ab2958663365680a8b
repoDigests:
- localhost/my-image@sha256:e1ea81ac14bda00b43fa3b46ae2e9a2dac56632483d709c3acd7e06c4b8342b6
repoTags:
- localhost/my-image:functional-593219
size: "1468744"
- id: c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:2bf47c1b01f51e8963bf2327390883c9fa4ed03ea1b284500a2cba17ce303e89
- registry.k8s.io/kube-controller-manager@sha256:a6fe41965f1693c8a73ebe75e215d0b7c0902732c66c6692b0dbcfb0f077c992
repoTags:
- registry.k8s.io/kube-controller-manager:v1.34.1
size: "76004181"
- id: da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests:
- registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e
repoTags:
- registry.k8s.io/pause:3.1
size: "746911"
- id: 350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests:
- registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9
repoTags:
- registry.k8s.io/pause:latest
size: "247077"
- id: 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c
repoDigests:
- docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a
- docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11
repoTags:
- docker.io/kindest/kindnetd:v20250512-df8de77b
size: "109379124"
- id: d4918ca78576a537caa7b0c043051c8efc1796de33fee8724ee0fff4a1cabed9
repoDigests:
- docker.io/library/nginx@sha256:667473807103639a0aca5b49534a216d2b64f0fb868aaa801f023da0cdd781c7
- docker.io/library/nginx@sha256:b3c656d55d7ad751196f21b7fd2e8d4da9cb430e32f646adcf92441b72f82b14
repoTags:
- docker.io/library/nginx:alpine
size: "54252718"
- id: beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:62ffc2ed7554e4c6d360bce40bbcf196573dd27c4ce080641a2c59867e732dee
- gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
repoTags:
- gcr.io/k8s-minikube/busybox:latest
size: "1462480"
- id: 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998
- registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c
repoTags:
- registry.k8s.io/coredns/coredns:v1.12.1
size: "76103547"
- id: 7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:47306e2178d9766fe3fe9eada02fa995f9f29dcbf518832293dfbe16964e2d31
- registry.k8s.io/kube-scheduler@sha256:6e9fbc4e25a576483e6a233976353a66e4d77eb5d0530e9118e94b7d46fb3500
repoTags:
- registry.k8s.io/kube-scheduler:v1.34.1
size: "53844823"
- id: 0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests:
- registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04
repoTags:
- registry.k8s.io/pause:3.3
size: "686139"
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-593219 image ls --format yaml --alsologtostderr:
I1122 02:04:10.523796 55011 out.go:360] Setting OutFile to fd 1 ...
I1122 02:04:10.523918 55011 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.523928 55011 out.go:374] Setting ErrFile to fd 2...
I1122 02:04:10.523932 55011 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:10.524152 55011 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:04:10.524696 55011 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.524805 55011 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:10.525205 55011 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:04:10.542422 55011 ssh_runner.go:195] Run: systemctl --version
I1122 02:04:10.542458 55011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:04:10.559807 55011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:04:10.655824 55011 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.22s)
=== RUN TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:323: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh pgrep buildkitd
functional_test.go:323: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh pgrep buildkitd: exit status 1 (250.395712ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:330: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image build -t localhost/my-image:functional-593219 testdata/build --alsologtostderr
functional_test.go:330: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 image build -t localhost/my-image:functional-593219 testdata/build --alsologtostderr: (1.569616824s)
functional_test.go:335: (dbg) Stdout: out/minikube-linux-amd64 -p functional-593219 image build -t localhost/my-image:functional-593219 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> e8555493601
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-593219
--> b1fb3bd2f9f
Successfully tagged localhost/my-image:functional-593219
b1fb3bd2f9f9442935dd05a8c7e1871d70312810c41758ab2958663365680a8b
functional_test.go:338: (dbg) Stderr: out/minikube-linux-amd64 -p functional-593219 image build -t localhost/my-image:functional-593219 testdata/build --alsologtostderr:
I1122 02:04:08.738377 54537 out.go:360] Setting OutFile to fd 1 ...
I1122 02:04:08.738658 54537 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:08.738669 54537 out.go:374] Setting ErrFile to fd 2...
I1122 02:04:08.738673 54537 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:04:08.738892 54537 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:04:08.739480 54537 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:08.740140 54537 config.go:182] Loaded profile config "functional-593219": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:04:08.740471 54537 cli_runner.go:164] Run: docker container inspect functional-593219 --format={{.State.Status}}
I1122 02:04:08.757868 54537 ssh_runner.go:195] Run: systemctl --version
I1122 02:04:08.757953 54537 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-593219
I1122 02:04:08.774398 54537 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/functional-593219/id_rsa Username:docker}
I1122 02:04:08.865685 54537 build_images.go:162] Building image from path: /tmp/build.3009424168.tar
I1122 02:04:08.865742 54537 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1122 02:04:08.873202 54537 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3009424168.tar
I1122 02:04:08.876672 54537 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3009424168.tar: stat -c "%s %y" /var/lib/minikube/build/build.3009424168.tar: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3009424168.tar': No such file or directory
I1122 02:04:08.876710 54537 ssh_runner.go:362] scp /tmp/build.3009424168.tar --> /var/lib/minikube/build/build.3009424168.tar (3072 bytes)
I1122 02:04:08.893598 54537 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3009424168
I1122 02:04:08.900559 54537 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3009424168 -xf /var/lib/minikube/build/build.3009424168.tar
I1122 02:04:08.907999 54537 crio.go:315] Building image: /var/lib/minikube/build/build.3009424168
I1122 02:04:08.908046 54537 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-593219 /var/lib/minikube/build/build.3009424168 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying config sha256:beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a
Writing manifest to image destination
Storing signatures
I1122 02:04:10.228502 54537 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-593219 /var/lib/minikube/build/build.3009424168 --cgroup-manager=cgroupfs: (1.320421543s)
I1122 02:04:10.228563 54537 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3009424168
I1122 02:04:10.236824 54537 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3009424168.tar
I1122 02:04:10.244991 54537 build_images.go:218] Built localhost/my-image:functional-593219 from /tmp/build.3009424168.tar
I1122 02:04:10.245020 54537 build_images.go:134] succeeded building to: functional-593219
I1122 02:04:10.245027 54537 build_images.go:135] failed building to:
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls
I1122 02:04:10.258792 15072 detect.go:223] nested VM detected
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (2.04s)
=== RUN TestFunctional/parallel/ImageCommands/Setup
functional_test.go:357: (dbg) Run: docker pull kicbase/echo-server:1.0
functional_test.go:357: (dbg) Done: docker pull kicbase/echo-server:1.0: (1.00918077s)
functional_test.go:362: (dbg) Run: docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-593219
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.04s)
=== RUN TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short
=== CONT TestFunctional/parallel/Version/short
functional_test.go:2261: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)
=== RUN TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components
=== CONT TestFunctional/parallel/Version/components
functional_test.go:2275: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.44s)
=== RUN TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:407: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image rm kicbase/echo-server:functional-593219 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.46s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1285: (dbg) Run: out/minikube-linux-amd64 profile lis
functional_test.go:1290: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.39s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1325: (dbg) Run: out/minikube-linux-amd64 profile list
functional_test.go:1330: Took "324.420993ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1339: (dbg) Run: out/minikube-linux-amd64 profile list -l
functional_test.go:1344: Took "61.949706ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.39s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1376: (dbg) Run: out/minikube-linux-amd64 profile list -o json
functional_test.go:1381: Took "323.31821ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1389: (dbg) Run: out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1394: Took "63.665335ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.39s)
=== RUN TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdany-port1639942289/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1763777024612216843" to /tmp/TestFunctionalparallelMountCmdany-port1639942289/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1763777024612216843" to /tmp/TestFunctionalparallelMountCmdany-port1639942289/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1763777024612216843" to /tmp/TestFunctionalparallelMountCmdany-port1639942289/001/test-1763777024612216843
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (289.914293ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1122 02:03:44.902435 15072 retry.go:31] will retry after 522.480484ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Nov 22 02:03 created-by-test
-rw-r--r-- 1 docker docker 24 Nov 22 02:03 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Nov 22 02:03 test-1763777024612216843
functional_test_mount_test.go:137: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh cat /mount-9p/test-1763777024612216843
functional_test_mount_test.go:148: (dbg) Run: kubectl --context functional-593219 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:352: "busybox-mount" [4c30c6d6-a87b-4a7e-a9b0-f9c63c4a2467] Pending
E1122 02:03:47.229807 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:352: "busybox-mount" [4c30c6d6-a87b-4a7e-a9b0-f9c63c4a2467] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:352: "busybox-mount" [4c30c6d6-a87b-4a7e-a9b0-f9c63c4a2467] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "busybox-mount" [4c30c6d6-a87b-4a7e-a9b0-f9c63c4a2467] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 3.002709281s
functional_test_mount_test.go:169: (dbg) Run: kubectl --context functional-593219 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdany-port1639942289/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (5.77s)
=== RUN TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdspecific-port3795532776/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (299.109393ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1122 02:03:50.684066 15072 retry.go:31] will retry after 308.314272ms: exit status 1
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdspecific-port3795532776/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "sudo umount -f /mount-9p": exit status 1 (267.916275ms)
-- stdout --
umount: /mount-9p: not mounted.
-- /stdout --
** stderr **
ssh: Process exited with status 32
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-593219 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdspecific-port3795532776/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.61s)
=== RUN TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T" /mount1: exit status 1 (355.596139ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1122 02:03:52.355490 15072 retry.go:31] will retry after 505.045683ms: exit status 1
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run: out/minikube-linux-amd64 mount -p functional-593219 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-593219 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3458691916/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.86s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr] ...
helpers_test.go:525: unable to kill pid 53461: os: process already finished
helpers_test.go:525: unable to kill pid 53276: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.49s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run: kubectl --context functional-593219 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:352: "nginx-svc" [9fd7108e-54c1-4ae6-95ad-e51b0eeb4dad] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx-svc" [9fd7108e-54c1-4ae6-95ad-e51b0eeb4dad] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.002410602s
I1122 02:04:07.420472 15072 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.18s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run: kubectl --context functional-593219 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.05s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.98.244.227 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-amd64 -p functional-593219 tunnel --alsologtostderr] ...
functional_test_tunnel_test.go:437: failed to stop process: signal: terminated
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes
=== CONT TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.15s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== CONT TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters
=== CONT TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)
=== RUN TestFunctional/parallel/ServiceCmd/List
functional_test.go:1469: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 service list
functional_test.go:1469: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 service list: (1.682651766s)
--- PASS: TestFunctional/parallel/ServiceCmd/List (1.68s)
=== RUN TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1499: (dbg) Run: out/minikube-linux-amd64 -p functional-593219 service list -o json
functional_test.go:1499: (dbg) Done: out/minikube-linux-amd64 -p functional-593219 service list -o json: (1.687389097s)
functional_test.go:1504: Took "1.687472677s" to run "out/minikube-linux-amd64 -p functional-593219 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (1.69s)
=== RUN TestFunctional/delete_echo-server_images
functional_test.go:205: (dbg) Run: docker rmi -f kicbase/echo-server:1.0
functional_test.go:205: (dbg) Run: docker rmi -f kicbase/echo-server:functional-593219
--- PASS: TestFunctional/delete_echo-server_images (0.04s)
=== RUN TestFunctional/delete_my-image_image
functional_test.go:213: (dbg) Run: docker rmi -f localhost/my-image:functional-593219
--- PASS: TestFunctional/delete_my-image_image (0.02s)
=== RUN TestFunctional/delete_minikube_cached_images
functional_test.go:221: (dbg) Run: docker rmi -f minikube-local-cache-test:functional-593219
--- PASS: TestFunctional/delete_minikube_cached_images (0.01s)
=== RUN TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=crio
ha_test.go:101: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=crio: (2m50.540109876s)
ha_test.go:107: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/StartCluster (171.23s)
=== RUN TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 kubectl -- rollout status deployment/busybox: (1.976283659s)
ha_test.go:140: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-cwjr6 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-dwjps -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-s5zww -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-cwjr6 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-dwjps -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-s5zww -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-cwjr6 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-dwjps -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-s5zww -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (3.92s)
=== RUN TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-cwjr6 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-cwjr6 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-dwjps -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-dwjps -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-s5zww -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 kubectl -- exec busybox-7b57f96db7-s5zww -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (0.98s)
=== RUN TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node add --alsologtostderr -v 5
ha_test.go:228: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 node add --alsologtostderr -v 5: (52.433211052s)
ha_test.go:234: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (53.27s)
=== RUN TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run: kubectl --context ha-131075 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.06s)
=== RUN TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.84s)
=== RUN TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --output json --alsologtostderr -v 5
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp testdata/cp-test.txt ha-131075:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3207427559/001/cp-test_ha-131075.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075:/home/docker/cp-test.txt ha-131075-m02:/home/docker/cp-test_ha-131075_ha-131075-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test_ha-131075_ha-131075-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075:/home/docker/cp-test.txt ha-131075-m03:/home/docker/cp-test_ha-131075_ha-131075-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test_ha-131075_ha-131075-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075:/home/docker/cp-test.txt ha-131075-m04:/home/docker/cp-test_ha-131075_ha-131075-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test_ha-131075_ha-131075-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp testdata/cp-test.txt ha-131075-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3207427559/001/cp-test_ha-131075-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m02:/home/docker/cp-test.txt ha-131075:/home/docker/cp-test_ha-131075-m02_ha-131075.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test_ha-131075-m02_ha-131075.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m02:/home/docker/cp-test.txt ha-131075-m03:/home/docker/cp-test_ha-131075-m02_ha-131075-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test_ha-131075-m02_ha-131075-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m02:/home/docker/cp-test.txt ha-131075-m04:/home/docker/cp-test_ha-131075-m02_ha-131075-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test_ha-131075-m02_ha-131075-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp testdata/cp-test.txt ha-131075-m03:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3207427559/001/cp-test_ha-131075-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m03:/home/docker/cp-test.txt ha-131075:/home/docker/cp-test_ha-131075-m03_ha-131075.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test_ha-131075-m03_ha-131075.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m03:/home/docker/cp-test.txt ha-131075-m02:/home/docker/cp-test_ha-131075-m03_ha-131075-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test_ha-131075-m03_ha-131075-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m03:/home/docker/cp-test.txt ha-131075-m04:/home/docker/cp-test_ha-131075-m03_ha-131075-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test_ha-131075-m03_ha-131075-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp testdata/cp-test.txt ha-131075-m04:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3207427559/001/cp-test_ha-131075-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m04:/home/docker/cp-test.txt ha-131075:/home/docker/cp-test_ha-131075-m04_ha-131075.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075 "sudo cat /home/docker/cp-test_ha-131075-m04_ha-131075.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m04:/home/docker/cp-test.txt ha-131075-m02:/home/docker/cp-test_ha-131075-m04_ha-131075-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m02 "sudo cat /home/docker/cp-test_ha-131075-m04_ha-131075-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 cp ha-131075-m04:/home/docker/cp-test.txt ha-131075-m03:/home/docker/cp-test_ha-131075-m04_ha-131075-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 ssh -n ha-131075-m03 "sudo cat /home/docker/cp-test_ha-131075-m04_ha-131075-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (16.60s)
=== RUN TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node stop m02 --alsologtostderr -v 5
E1122 02:18:06.247800 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:365: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 node stop m02 --alsologtostderr -v 5: (13.545035555s)
ha_test.go:371: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
ha_test.go:371: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5: exit status 7 (666.745801ms)
-- stdout --
ha-131075
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-131075-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-131075-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-131075-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I1122 02:18:08.987159 79985 out.go:360] Setting OutFile to fd 1 ...
I1122 02:18:08.987278 79985 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:18:08.987289 79985 out.go:374] Setting ErrFile to fd 2...
I1122 02:18:08.987294 79985 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:18:08.987574 79985 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:18:08.987740 79985 out.go:368] Setting JSON to false
I1122 02:18:08.987768 79985 mustload.go:66] Loading cluster: ha-131075
I1122 02:18:08.987901 79985 notify.go:221] Checking for updates...
I1122 02:18:08.988235 79985 config.go:182] Loaded profile config "ha-131075": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:18:08.988252 79985 status.go:174] checking status of ha-131075 ...
I1122 02:18:08.988759 79985 cli_runner.go:164] Run: docker container inspect ha-131075 --format={{.State.Status}}
I1122 02:18:09.009012 79985 status.go:371] ha-131075 host status = "Running" (err=<nil>)
I1122 02:18:09.009030 79985 host.go:66] Checking if "ha-131075" exists ...
I1122 02:18:09.009323 79985 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-131075
I1122 02:18:09.025431 79985 host.go:66] Checking if "ha-131075" exists ...
I1122 02:18:09.025673 79985 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:18:09.025713 79985 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-131075
I1122 02:18:09.042557 79985 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/ha-131075/id_rsa Username:docker}
I1122 02:18:09.133952 79985 ssh_runner.go:195] Run: systemctl --version
I1122 02:18:09.140129 79985 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:18:09.151515 79985 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:18:09.211168 79985 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:72 OomKillDisable:false NGoroutines:75 SystemTime:2025-11-22 02:18:09.201466032 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:18:09.211707 79985 kubeconfig.go:125] found "ha-131075" server: "https://192.168.49.254:8443"
I1122 02:18:09.211738 79985 api_server.go:166] Checking apiserver status ...
I1122 02:18:09.211780 79985 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:18:09.222901 79985 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1246/cgroup
W1122 02:18:09.230715 79985 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1246/cgroup: Process exited with status 1
stdout:
stderr:
I1122 02:18:09.230765 79985 ssh_runner.go:195] Run: ls
I1122 02:18:09.234343 79985 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
I1122 02:18:09.239689 79985 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
ok
I1122 02:18:09.239712 79985 status.go:463] ha-131075 apiserver status = Running (err=<nil>)
I1122 02:18:09.239729 79985 status.go:176] ha-131075 status: &{Name:ha-131075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:18:09.239745 79985 status.go:174] checking status of ha-131075-m02 ...
I1122 02:18:09.240010 79985 cli_runner.go:164] Run: docker container inspect ha-131075-m02 --format={{.State.Status}}
I1122 02:18:09.256739 79985 status.go:371] ha-131075-m02 host status = "Stopped" (err=<nil>)
I1122 02:18:09.256758 79985 status.go:384] host is not running, skipping remaining checks
I1122 02:18:09.256766 79985 status.go:176] ha-131075-m02 status: &{Name:ha-131075-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:18:09.256785 79985 status.go:174] checking status of ha-131075-m03 ...
I1122 02:18:09.257059 79985 cli_runner.go:164] Run: docker container inspect ha-131075-m03 --format={{.State.Status}}
I1122 02:18:09.273992 79985 status.go:371] ha-131075-m03 host status = "Running" (err=<nil>)
I1122 02:18:09.274012 79985 host.go:66] Checking if "ha-131075-m03" exists ...
I1122 02:18:09.274228 79985 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-131075-m03
I1122 02:18:09.290511 79985 host.go:66] Checking if "ha-131075-m03" exists ...
I1122 02:18:09.290724 79985 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:18:09.290764 79985 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-131075-m03
I1122 02:18:09.307783 79985 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/ha-131075-m03/id_rsa Username:docker}
I1122 02:18:09.398620 79985 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:18:09.410711 79985 kubeconfig.go:125] found "ha-131075" server: "https://192.168.49.254:8443"
I1122 02:18:09.410735 79985 api_server.go:166] Checking apiserver status ...
I1122 02:18:09.410764 79985 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:18:09.422258 79985 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1176/cgroup
W1122 02:18:09.431556 79985 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1176/cgroup: Process exited with status 1
stdout:
stderr:
I1122 02:18:09.431674 79985 ssh_runner.go:195] Run: ls
I1122 02:18:09.436265 79985 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
I1122 02:18:09.440692 79985 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
ok
I1122 02:18:09.440712 79985 status.go:463] ha-131075-m03 apiserver status = Running (err=<nil>)
I1122 02:18:09.440721 79985 status.go:176] ha-131075-m03 status: &{Name:ha-131075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:18:09.440735 79985 status.go:174] checking status of ha-131075-m04 ...
I1122 02:18:09.441010 79985 cli_runner.go:164] Run: docker container inspect ha-131075-m04 --format={{.State.Status}}
I1122 02:18:09.458798 79985 status.go:371] ha-131075-m04 host status = "Running" (err=<nil>)
I1122 02:18:09.458816 79985 host.go:66] Checking if "ha-131075-m04" exists ...
I1122 02:18:09.459069 79985 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-131075-m04
I1122 02:18:09.475342 79985 host.go:66] Checking if "ha-131075-m04" exists ...
I1122 02:18:09.475570 79985 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:18:09.475601 79985 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-131075-m04
I1122 02:18:09.492215 79985 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32798 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/ha-131075-m04/id_rsa Username:docker}
I1122 02:18:09.583588 79985 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:18:09.595444 79985 status.go:176] ha-131075-m04 status: &{Name:ha-131075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (14.21s)
=== RUN TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.68s)
=== RUN TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node start m02 --alsologtostderr -v 5
ha_test.go:422: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 node start m02 --alsologtostderr -v 5: (7.582982137s)
ha_test.go:430: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
ha_test.go:450: (dbg) Run: kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (8.47s)
=== RUN TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.84s)
=== RUN TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node list --alsologtostderr -v 5
ha_test.go:464: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 stop --alsologtostderr -v 5
E1122 02:18:33.218870 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.225250 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.236550 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.257855 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.299181 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.380560 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.542083 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:33.863735 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:34.505743 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:35.787040 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:38.350039 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:43.472129 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:18:53.713645 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:19:14.195091 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:464: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 stop --alsologtostderr -v 5: (56.914016461s)
ha_test.go:469: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 start --wait true --alsologtostderr -v 5
E1122 02:19:29.316868 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:19:55.157395 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:469: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 start --wait true --alsologtostderr -v 5: (1m3.12334004s)
ha_test.go:474: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node list --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (120.16s)
=== RUN TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node delete m03 --alsologtostderr -v 5
ha_test.go:489: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 node delete m03 --alsologtostderr -v 5: (9.676580895s)
ha_test.go:495: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
ha_test.go:513: (dbg) Run: kubectl get nodes
ha_test.go:521: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (10.51s)
=== RUN TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.67s)
=== RUN TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 stop --alsologtostderr -v 5
ha_test.go:533: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 stop --alsologtostderr -v 5: (41.889781042s)
ha_test.go:539: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
ha_test.go:539: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5: exit status 7 (107.913111ms)
-- stdout --
ha-131075
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-131075-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-131075-m04
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1122 02:21:12.873189 94255 out.go:360] Setting OutFile to fd 1 ...
I1122 02:21:12.873437 94255 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:21:12.873448 94255 out.go:374] Setting ErrFile to fd 2...
I1122 02:21:12.873452 94255 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:21:12.873681 94255 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:21:12.873892 94255 out.go:368] Setting JSON to false
I1122 02:21:12.873936 94255 mustload.go:66] Loading cluster: ha-131075
I1122 02:21:12.873988 94255 notify.go:221] Checking for updates...
I1122 02:21:12.874334 94255 config.go:182] Loaded profile config "ha-131075": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:21:12.874349 94255 status.go:174] checking status of ha-131075 ...
I1122 02:21:12.874763 94255 cli_runner.go:164] Run: docker container inspect ha-131075 --format={{.State.Status}}
I1122 02:21:12.892196 94255 status.go:371] ha-131075 host status = "Stopped" (err=<nil>)
I1122 02:21:12.892221 94255 status.go:384] host is not running, skipping remaining checks
I1122 02:21:12.892229 94255 status.go:176] ha-131075 status: &{Name:ha-131075 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:21:12.892277 94255 status.go:174] checking status of ha-131075-m02 ...
I1122 02:21:12.892497 94255 cli_runner.go:164] Run: docker container inspect ha-131075-m02 --format={{.State.Status}}
I1122 02:21:12.908513 94255 status.go:371] ha-131075-m02 host status = "Stopped" (err=<nil>)
I1122 02:21:12.908529 94255 status.go:384] host is not running, skipping remaining checks
I1122 02:21:12.908536 94255 status.go:176] ha-131075-m02 status: &{Name:ha-131075-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:21:12.908566 94255 status.go:174] checking status of ha-131075-m04 ...
I1122 02:21:12.908788 94255 cli_runner.go:164] Run: docker container inspect ha-131075-m04 --format={{.State.Status}}
I1122 02:21:12.925036 94255 status.go:371] ha-131075-m04 host status = "Stopped" (err=<nil>)
I1122 02:21:12.925053 94255 status.go:384] host is not running, skipping remaining checks
I1122 02:21:12.925059 94255 status.go:176] ha-131075-m04 status: &{Name:ha-131075-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (42.00s)
=== RUN TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 start --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=crio
E1122 02:21:17.079393 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:562: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 start --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=crio: (59.738504029s)
ha_test.go:568: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
ha_test.go:586: (dbg) Run: kubectl get nodes
ha_test.go:594: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (60.49s)
=== RUN TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.67s)
=== RUN TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:607: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 node add --control-plane --alsologtostderr -v 5
E1122 02:23:06.245471 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:23:33.219173 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:607: (dbg) Done: out/minikube-linux-amd64 -p ha-131075 node add --control-plane --alsologtostderr -v 5: (1m19.516390969s)
ha_test.go:613: (dbg) Run: out/minikube-linux-amd64 -p ha-131075 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (80.35s)
=== RUN TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.85s)
=== RUN TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 start -p json-output-681136 --output=json --user=testUser --memory=3072 --wait=true --driver=docker --container-runtime=crio
E1122 02:24:00.921090 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-681136 --output=json --user=testUser --memory=3072 --wait=true --driver=docker --container-runtime=crio: (41.315235997s)
--- PASS: TestJSONOutput/start/Command (41.32s)
=== RUN TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)
=== RUN TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)
=== RUN TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)
=== RUN TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 stop -p json-output-681136 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-681136 --output=json --user=testUser: (6.138187117s)
--- PASS: TestJSONOutput/stop/Command (6.14s)
=== RUN TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)
=== RUN TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestErrorJSONOutput
json_output_test.go:160: (dbg) Run: out/minikube-linux-amd64 start -p json-output-error-323914 --memory=3072 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-323914 --memory=3072 --output=json --wait=true --driver=fail: exit status 56 (69.952682ms)
-- stdout --
{"specversion":"1.0","id":"2a6528f8-fca3-419c-93bd-4292aaa76e3e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-323914] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"8227e54c-f014-4b15-8426-8d6967b055b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=21946"}}
{"specversion":"1.0","id":"451cff75-7c42-45f0-9f3f-90a3578e8dfd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"aef05268-4792-4334-806b-fc6858aa120e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig"}}
{"specversion":"1.0","id":"32b0a4de-e417-4224-86ab-8a4e33510f5f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube"}}
{"specversion":"1.0","id":"ceb4464f-d95e-47e7-ae64-8fd089927198","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"50ee5cb6-1ddd-46c0-b551-94aa760941b9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
{"specversion":"1.0","id":"4188c7c7-9714-4455-8717-b3b46f8e84cd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-323914" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p json-output-error-323914
--- PASS: TestErrorJSONOutput (0.22s)
=== RUN TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run: out/minikube-linux-amd64 start -p docker-network-878060 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-878060 --network=: (26.654659673s)
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-878060" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p docker-network-878060
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-878060: (2.094441339s)
--- PASS: TestKicCustomNetwork/create_custom_network (28.77s)
=== RUN TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run: out/minikube-linux-amd64 start -p docker-network-774641 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-774641 --network=bridge: (19.82324228s)
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-774641" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p docker-network-774641
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-774641: (1.956838547s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (21.80s)
=== RUN TestKicExistingNetwork
I1122 02:25:29.450756 15072 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1122 02:25:29.466229 15072 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1122 02:25:29.466296 15072 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I1122 02:25:29.466317 15072 cli_runner.go:164] Run: docker network inspect existing-network
W1122 02:25:29.481429 15072 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I1122 02:25:29.481453 15072 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]
stderr:
Error response from daemon: network existing-network not found
I1122 02:25:29.481475 15072 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network existing-network not found
** /stderr **
I1122 02:25:29.481611 15072 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1122 02:25:29.498366 15072 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-a0509acbf98b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:2e:ca:8e:10:08:4b} reservation:<nil>}
I1122 02:25:29.498795 15072 network.go:206] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00034ac00}
I1122 02:25:29.498826 15072 network_create.go:124] attempt to create docker network existing-network 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1122 02:25:29.498875 15072 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I1122 02:25:29.542453 15072 network_create.go:108] docker network existing-network 192.168.58.0/24 created
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run: out/minikube-linux-amd64 start -p existing-network-479626 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-479626 --network=existing-network: (20.598928547s)
helpers_test.go:175: Cleaning up "existing-network-479626" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p existing-network-479626
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-479626: (1.949919874s)
I1122 02:25:52.107920 15072 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (22.67s)
=== RUN TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p custom-subnet-309842 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-309842 --subnet=192.168.60.0/24: (21.164615348s)
kic_custom_network_test.go:161: (dbg) Run: docker network inspect custom-subnet-309842 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-309842" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p custom-subnet-309842
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-309842: (2.103491474s)
--- PASS: TestKicCustomSubnet (23.29s)
=== RUN TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run: out/minikube-linux-amd64 start -p static-ip-422393 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p static-ip-422393 --static-ip=192.168.200.200: (20.760147358s)
kic_custom_network_test.go:138: (dbg) Run: out/minikube-linux-amd64 -p static-ip-422393 ip
helpers_test.go:175: Cleaning up "static-ip-422393" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p static-ip-422393
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p static-ip-422393: (2.116215403s)
--- PASS: TestKicStaticIP (23.02s)
=== RUN TestMainNoArgs
main_test.go:70: (dbg) Run: out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.06s)
=== RUN TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p first-631250 --driver=docker --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-631250 --driver=docker --container-runtime=crio: (21.335720144s)
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p second-633828 --driver=docker --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-633828 --driver=docker --container-runtime=crio: (19.708525789s)
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile first-631250
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile second-633828
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-633828" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p second-633828
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-633828: (2.302080569s)
helpers_test.go:175: Cleaning up "first-631250" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p first-631250
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-631250: (2.28586456s)
--- PASS: TestMinikubeProfile (46.81s)
=== RUN TestMountStart/serial/StartWithMountFirst
mount_start_test.go:118: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-1-072423 --memory=3072 --mount-string /tmp/TestMountStartserial907363432/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=crio
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-072423 --memory=3072 --mount-string /tmp/TestMountStartserial907363432/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=crio: (4.431512681s)
--- PASS: TestMountStart/serial/StartWithMountFirst (5.43s)
=== RUN TestMountStart/serial/VerifyMountFirst
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-072423 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.26s)
=== RUN TestMountStart/serial/StartWithMountSecond
mount_start_test.go:118: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-091494 --memory=3072 --mount-string /tmp/TestMountStartserial907363432/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=crio
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-091494 --memory=3072 --mount-string /tmp/TestMountStartserial907363432/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=crio: (7.020901068s)
--- PASS: TestMountStart/serial/StartWithMountSecond (8.02s)
=== RUN TestMountStart/serial/VerifyMountSecond
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-091494 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.26s)
=== RUN TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p mount-start-1-072423 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-072423 --alsologtostderr -v=5: (1.622328852s)
--- PASS: TestMountStart/serial/DeleteFirst (1.62s)
=== RUN TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-091494 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.25s)
=== RUN TestMountStart/serial/Stop
mount_start_test.go:196: (dbg) Run: out/minikube-linux-amd64 stop -p mount-start-2-091494
mount_start_test.go:196: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-091494: (1.243557048s)
--- PASS: TestMountStart/serial/Stop (1.24s)
=== RUN TestMountStart/serial/RestartStopped
mount_start_test.go:207: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-091494
mount_start_test.go:207: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-091494: (6.772987268s)
--- PASS: TestMountStart/serial/RestartStopped (7.77s)
=== RUN TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-091494 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.26s)
=== RUN TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run: out/minikube-linux-amd64 start -p multinode-001269 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=crio
E1122 02:28:06.245365 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:28:33.220085 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:96: (dbg) Done: out/minikube-linux-amd64 start -p multinode-001269 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=crio: (1m59.041174801s)
multinode_test.go:102: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (119.50s)
=== RUN TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-001269 -- rollout status deployment/busybox: (1.928756447s)
multinode_test.go:505: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-lbc4z -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-ndh7s -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-lbc4z -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-ndh7s -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-lbc4z -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-ndh7s -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (3.27s)
=== RUN TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-lbc4z -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-lbc4z -- sh -c "ping -c 1 192.168.67.1"
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-ndh7s -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-001269 -- exec busybox-7b57f96db7-ndh7s -- sh -c "ping -c 1 192.168.67.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.67s)
=== RUN TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-001269 -v=5 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-001269 -v=5 --alsologtostderr: (52.20961753s)
multinode_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (52.82s)
=== RUN TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run: kubectl --context multinode-001269 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.06s)
=== RUN TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.63s)
=== RUN TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --output json --alsologtostderr
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp testdata/cp-test.txt multinode-001269:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2719650874/001/cp-test_multinode-001269.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269:/home/docker/cp-test.txt multinode-001269-m02:/home/docker/cp-test_multinode-001269_multinode-001269-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test_multinode-001269_multinode-001269-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269:/home/docker/cp-test.txt multinode-001269-m03:/home/docker/cp-test_multinode-001269_multinode-001269-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test_multinode-001269_multinode-001269-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp testdata/cp-test.txt multinode-001269-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2719650874/001/cp-test_multinode-001269-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m02:/home/docker/cp-test.txt multinode-001269:/home/docker/cp-test_multinode-001269-m02_multinode-001269.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test_multinode-001269-m02_multinode-001269.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m02:/home/docker/cp-test.txt multinode-001269-m03:/home/docker/cp-test_multinode-001269-m02_multinode-001269-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test_multinode-001269-m02_multinode-001269-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp testdata/cp-test.txt multinode-001269-m03:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2719650874/001/cp-test_multinode-001269-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m03:/home/docker/cp-test.txt multinode-001269:/home/docker/cp-test_multinode-001269-m03_multinode-001269.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269 "sudo cat /home/docker/cp-test_multinode-001269-m03_multinode-001269.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 cp multinode-001269-m03:/home/docker/cp-test.txt multinode-001269-m02:/home/docker/cp-test_multinode-001269-m03_multinode-001269-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 ssh -n multinode-001269-m02 "sudo cat /home/docker/cp-test_multinode-001269-m03_multinode-001269-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.36s)
=== RUN TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p multinode-001269 node stop m03: (1.259361573s)
multinode_test.go:254: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-001269 status: exit status 7 (465.756223ms)
-- stdout --
multinode-001269
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-001269-m02
type: Worker
host: Running
kubelet: Running
multinode-001269-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:261: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr: exit status 7 (468.709469ms)
-- stdout --
multinode-001269
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-001269-m02
type: Worker
host: Running
kubelet: Running
multinode-001269-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1122 02:31:00.309557 154440 out.go:360] Setting OutFile to fd 1 ...
I1122 02:31:00.309829 154440 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:31:00.309839 154440 out.go:374] Setting ErrFile to fd 2...
I1122 02:31:00.309845 154440 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:31:00.310028 154440 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:31:00.310210 154440 out.go:368] Setting JSON to false
I1122 02:31:00.310246 154440 mustload.go:66] Loading cluster: multinode-001269
I1122 02:31:00.310337 154440 notify.go:221] Checking for updates...
I1122 02:31:00.310626 154440 config.go:182] Loaded profile config "multinode-001269": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:31:00.310642 154440 status.go:174] checking status of multinode-001269 ...
I1122 02:31:00.311119 154440 cli_runner.go:164] Run: docker container inspect multinode-001269 --format={{.State.Status}}
I1122 02:31:00.328033 154440 status.go:371] multinode-001269 host status = "Running" (err=<nil>)
I1122 02:31:00.328051 154440 host.go:66] Checking if "multinode-001269" exists ...
I1122 02:31:00.328284 154440 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-001269
I1122 02:31:00.343991 154440 host.go:66] Checking if "multinode-001269" exists ...
I1122 02:31:00.344239 154440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:31:00.344276 154440 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-001269
I1122 02:31:00.361255 154440 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/multinode-001269/id_rsa Username:docker}
I1122 02:31:00.452501 154440 ssh_runner.go:195] Run: systemctl --version
I1122 02:31:00.458249 154440 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:31:00.469687 154440 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:31:00.524854 154440 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:false NGoroutines:65 SystemTime:2025-11-22 02:31:00.515748933 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:31:00.525406 154440 kubeconfig.go:125] found "multinode-001269" server: "https://192.168.67.2:8443"
I1122 02:31:00.525434 154440 api_server.go:166] Checking apiserver status ...
I1122 02:31:00.525470 154440 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1122 02:31:00.536454 154440 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1246/cgroup
W1122 02:31:00.544158 154440 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1246/cgroup: Process exited with status 1
stdout:
stderr:
I1122 02:31:00.544193 154440 ssh_runner.go:195] Run: ls
I1122 02:31:00.547582 154440 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
I1122 02:31:00.551580 154440 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
ok
I1122 02:31:00.551598 154440 status.go:463] multinode-001269 apiserver status = Running (err=<nil>)
I1122 02:31:00.551607 154440 status.go:176] multinode-001269 status: &{Name:multinode-001269 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:31:00.551620 154440 status.go:174] checking status of multinode-001269-m02 ...
I1122 02:31:00.551827 154440 cli_runner.go:164] Run: docker container inspect multinode-001269-m02 --format={{.State.Status}}
I1122 02:31:00.568689 154440 status.go:371] multinode-001269-m02 host status = "Running" (err=<nil>)
I1122 02:31:00.568706 154440 host.go:66] Checking if "multinode-001269-m02" exists ...
I1122 02:31:00.568958 154440 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-001269-m02
I1122 02:31:00.585660 154440 host.go:66] Checking if "multinode-001269-m02" exists ...
I1122 02:31:00.585893 154440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1122 02:31:00.585958 154440 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-001269-m02
I1122 02:31:00.601676 154440 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32908 SSHKeyPath:/home/jenkins/minikube-integration/21946-11041/.minikube/machines/multinode-001269-m02/id_rsa Username:docker}
I1122 02:31:00.692312 154440 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1122 02:31:00.703569 154440 status.go:176] multinode-001269-m02 status: &{Name:multinode-001269-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
I1122 02:31:00.703598 154440 status.go:174] checking status of multinode-001269-m03 ...
I1122 02:31:00.703863 154440 cli_runner.go:164] Run: docker container inspect multinode-001269-m03 --format={{.State.Status}}
I1122 02:31:00.721478 154440 status.go:371] multinode-001269-m03 host status = "Stopped" (err=<nil>)
I1122 02:31:00.721494 154440 status.go:384] host is not running, skipping remaining checks
I1122 02:31:00.721499 154440 status.go:176] multinode-001269-m03 status: &{Name:multinode-001269-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.19s)
=== RUN TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 node start m03 -v=5 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p multinode-001269 node start m03 -v=5 --alsologtostderr: (6.306175972s)
multinode_test.go:290: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status -v=5 --alsologtostderr
multinode_test.go:306: (dbg) Run: kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (6.97s)
=== RUN TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-001269
multinode_test.go:321: (dbg) Run: out/minikube-linux-amd64 stop -p multinode-001269
multinode_test.go:321: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-001269: (29.368599752s)
multinode_test.go:326: (dbg) Run: out/minikube-linux-amd64 start -p multinode-001269 --wait=true -v=5 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-amd64 start -p multinode-001269 --wait=true -v=5 --alsologtostderr: (50.848451053s)
multinode_test.go:331: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-001269
--- PASS: TestMultiNode/serial/RestartKeepsNodes (80.34s)
=== RUN TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-amd64 -p multinode-001269 node delete m03: (4.561282931s)
multinode_test.go:422: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
multinode_test.go:436: (dbg) Run: kubectl get nodes
multinode_test.go:444: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.13s)
=== RUN TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-amd64 -p multinode-001269 stop: (28.133592578s)
multinode_test.go:351: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-001269 status: exit status 7 (96.182785ms)
-- stdout --
multinode-001269
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-001269-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:358: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr: exit status 7 (92.333892ms)
-- stdout --
multinode-001269
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-001269-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1122 02:33:01.439261 164243 out.go:360] Setting OutFile to fd 1 ...
I1122 02:33:01.439476 164243 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:33:01.439485 164243 out.go:374] Setting ErrFile to fd 2...
I1122 02:33:01.439489 164243 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:33:01.439659 164243 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:33:01.439829 164243 out.go:368] Setting JSON to false
I1122 02:33:01.439856 164243 mustload.go:66] Loading cluster: multinode-001269
I1122 02:33:01.439939 164243 notify.go:221] Checking for updates...
I1122 02:33:01.440185 164243 config.go:182] Loaded profile config "multinode-001269": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:33:01.440198 164243 status.go:174] checking status of multinode-001269 ...
I1122 02:33:01.440578 164243 cli_runner.go:164] Run: docker container inspect multinode-001269 --format={{.State.Status}}
I1122 02:33:01.458492 164243 status.go:371] multinode-001269 host status = "Stopped" (err=<nil>)
I1122 02:33:01.458521 164243 status.go:384] host is not running, skipping remaining checks
I1122 02:33:01.458529 164243 status.go:176] multinode-001269 status: &{Name:multinode-001269 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1122 02:33:01.458579 164243 status.go:174] checking status of multinode-001269-m02 ...
I1122 02:33:01.458847 164243 cli_runner.go:164] Run: docker container inspect multinode-001269-m02 --format={{.State.Status}}
I1122 02:33:01.475580 164243 status.go:371] multinode-001269-m02 host status = "Stopped" (err=<nil>)
I1122 02:33:01.475597 164243 status.go:384] host is not running, skipping remaining checks
I1122 02:33:01.475603 164243 status.go:176] multinode-001269-m02 status: &{Name:multinode-001269-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (28.32s)
=== RUN TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run: out/minikube-linux-amd64 start -p multinode-001269 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=crio
E1122 02:33:06.245642 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 start -p multinode-001269 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=crio: (22.077582595s)
multinode_test.go:382: (dbg) Run: out/minikube-linux-amd64 -p multinode-001269 status --alsologtostderr
multinode_test.go:396: (dbg) Run: kubectl get nodes
multinode_test.go:404: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (22.66s)
=== RUN TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-001269
multinode_test.go:464: (dbg) Run: out/minikube-linux-amd64 start -p multinode-001269-m02 --driver=docker --container-runtime=crio
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-001269-m02 --driver=docker --container-runtime=crio: exit status 14 (70.951096ms)
-- stdout --
* [multinode-001269-m02] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
! Profile name 'multinode-001269-m02' is duplicated with machine name 'multinode-001269-m02' in profile 'multinode-001269'
X Exiting due to MK_USAGE: Profile name should be unique
** /stderr **
multinode_test.go:472: (dbg) Run: out/minikube-linux-amd64 start -p multinode-001269-m03 --driver=docker --container-runtime=crio
E1122 02:33:33.218695 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:472: (dbg) Done: out/minikube-linux-amd64 start -p multinode-001269-m03 --driver=docker --container-runtime=crio: (19.750113988s)
multinode_test.go:479: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-001269
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-001269: exit status 80 (272.776679ms)
-- stdout --
* Adding node m03 to cluster multinode-001269 as [worker]
-- /stdout --
** stderr **
X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-001269-m03 already exists in multinode-001269-m03 profile
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:484: (dbg) Run: out/minikube-linux-amd64 delete -p multinode-001269-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-001269-m03: (2.312179494s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (22.47s)
=== RUN TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run: out/minikube-linux-amd64 start -p scheduled-stop-195879 --memory=3072 --driver=docker --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-195879 --memory=3072 --driver=docker --container-runtime=crio: (20.336964942s)
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-195879 --schedule 5m -v=5 --alsologtostderr
minikube stop output:
** stderr **
I1122 02:41:20.091783 182734 out.go:360] Setting OutFile to fd 1 ...
I1122 02:41:20.092054 182734 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:20.092064 182734 out.go:374] Setting ErrFile to fd 2...
I1122 02:41:20.092068 182734 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:20.092242 182734 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:41:20.092457 182734 out.go:368] Setting JSON to false
I1122 02:41:20.092541 182734 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:20.092882 182734 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:41:20.092970 182734 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/config.json ...
I1122 02:41:20.093163 182734 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:20.093263 182734 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
** /stderr **
scheduled_stop_test.go:204: (dbg) Run: out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-195879 -n scheduled-stop-195879
scheduled_stop_test.go:172: signal error was: <nil>
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr
minikube stop output:
** stderr **
I1122 02:41:20.464476 182902 out.go:360] Setting OutFile to fd 1 ...
I1122 02:41:20.464596 182902 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:20.464607 182902 out.go:374] Setting ErrFile to fd 2...
I1122 02:41:20.464611 182902 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:20.464800 182902 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:41:20.465069 182902 out.go:368] Setting JSON to false
I1122 02:41:20.465274 182902 daemonize_unix.go:73] killing process 182768 as it is an old scheduled stop
I1122 02:41:20.465373 182902 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:20.465746 182902 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:41:20.465820 182902 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/config.json ...
I1122 02:41:20.466033 182902 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:20.466170 182902 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
** /stderr **
scheduled_stop_test.go:172: signal error was: os: process already finished
I1122 02:41:20.472027 15072 retry.go:31] will retry after 61.796µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.473196 15072 retry.go:31] will retry after 97.199µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.474351 15072 retry.go:31] will retry after 121.146µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.475519 15072 retry.go:31] will retry after 318.912µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.476651 15072 retry.go:31] will retry after 727.454µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.477796 15072 retry.go:31] will retry after 580.089µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.478931 15072 retry.go:31] will retry after 1.538296ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.481115 15072 retry.go:31] will retry after 940.464µs: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.482244 15072 retry.go:31] will retry after 2.726402ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.485433 15072 retry.go:31] will retry after 4.892923ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.490587 15072 retry.go:31] will retry after 5.35536ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.496774 15072 retry.go:31] will retry after 4.731353ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.501963 15072 retry.go:31] will retry after 18.612767ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.521169 15072 retry.go:31] will retry after 11.505103ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.533376 15072 retry.go:31] will retry after 40.008781ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
I1122 02:41:20.573609 15072 retry.go:31] will retry after 62.550766ms: open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-195879 --cancel-scheduled
minikube stop output:
-- stdout --
* All existing scheduled stops cancelled
-- /stdout --
scheduled_stop_test.go:189: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-195879 -n scheduled-stop-195879
scheduled_stop_test.go:218: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-195879
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-195879 --schedule 15s -v=5 --alsologtostderr
minikube stop output:
** stderr **
I1122 02:41:46.354076 183458 out.go:360] Setting OutFile to fd 1 ...
I1122 02:41:46.354313 183458 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:46.354321 183458 out.go:374] Setting ErrFile to fd 2...
I1122 02:41:46.354325 183458 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:41:46.354515 183458 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:41:46.354757 183458 out.go:368] Setting JSON to false
I1122 02:41:46.354831 183458 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:46.355155 183458 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:41:46.355228 183458 profile.go:143] Saving config to /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/scheduled-stop-195879/config.json ...
I1122 02:41:46.355413 183458 mustload.go:66] Loading cluster: scheduled-stop-195879
I1122 02:41:46.355504 183458 config.go:182] Loaded profile config "scheduled-stop-195879": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
** /stderr **
scheduled_stop_test.go:172: signal error was: os: process already finished
scheduled_stop_test.go:218: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-195879
scheduled_stop_test.go:218: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-195879: exit status 7 (80.165706ms)
-- stdout --
scheduled-stop-195879
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
-- /stdout --
scheduled_stop_test.go:189: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-195879 -n scheduled-stop-195879
scheduled_stop_test.go:189: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-195879 -n scheduled-stop-195879: exit status 7 (78.999385ms)
-- stdout --
Stopped
-- /stdout --
scheduled_stop_test.go:189: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-195879" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p scheduled-stop-195879
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-195879: (4.059364774s)
--- PASS: TestScheduledStopUnix (95.89s)
=== RUN TestInsufficientStorage
status_test.go:50: (dbg) Run: out/minikube-linux-amd64 start -p insufficient-storage-280464 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=crio
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-280464 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=crio: exit status 26 (6.838098217s)
-- stdout --
{"specversion":"1.0","id":"f899facb-3bd9-4434-8598-6d3fac357c8d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-280464] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"81ef47f2-e1f1-4f84-a221-42255c81c5c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=21946"}}
{"specversion":"1.0","id":"c845f05f-0ef2-44a5-8853-569f395382c0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"c3386fe9-4f33-451d-a60e-841aaa5d67da","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig"}}
{"specversion":"1.0","id":"cc9fb2d3-fda2-4f57-a261-e7cbc5123cff","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube"}}
{"specversion":"1.0","id":"628966dd-8e75-4d6f-9fcd-cefd7cb9bb15","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"839a1973-ef34-4020-9f54-99fa6ab0da30","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
{"specversion":"1.0","id":"23619a24-7ec9-4052-b7c0-42a9e8db30ea","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
{"specversion":"1.0","id":"55c575a2-e89c-4cf4-b0ee-cb994a8b1080","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
{"specversion":"1.0","id":"26174792-cccb-4892-b4a1-7f05b40c6e91","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
{"specversion":"1.0","id":"e29e40e1-6888-4f71-8932-6439575a1c2a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
{"specversion":"1.0","id":"c0c7aedc-b119-4e9b-98cc-83fe5847751c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-280464\" primary control-plane node in \"insufficient-storage-280464\" cluster","name":"Starting Node","totalsteps":"19"}}
{"specversion":"1.0","id":"1fef91ff-e860-4f49-9982-87be87ef2a03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.48-1763507788-21924 ...","name":"Pulling Base Image","totalsteps":"19"}}
{"specversion":"1.0","id":"368c7d8b-5f94-423a-96f5-3cf83cd467ac","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=3072MB) ...","name":"Creating Container","totalsteps":"19"}}
{"specversion":"1.0","id":"788fa47b-8e51-40c2-b32d-bbd3bfcce5fb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}
-- /stdout --
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p insufficient-storage-280464 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-280464 --output=json --layout=cluster: exit status 7 (276.141428ms)
-- stdout --
{"Name":"insufficient-storage-280464","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=3072MB) ...","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-280464","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
** stderr **
E1122 02:42:42.688133 185957 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-280464" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
** /stderr **
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p insufficient-storage-280464 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-280464 --output=json --layout=cluster: exit status 7 (274.146897ms)
-- stdout --
{"Name":"insufficient-storage-280464","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-280464","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
** stderr **
E1122 02:42:42.962712 186068 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-280464" does not appear in /home/jenkins/minikube-integration/21946-11041/kubeconfig
E1122 02:42:42.972690 186068 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/insufficient-storage-280464/events.json: no such file or directory
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-280464" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p insufficient-storage-280464
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-280464: (1.868740033s)
--- PASS: TestInsufficientStorage (9.26s)
=== RUN TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run: /tmp/minikube-v1.32.0.1375808351 start -p running-upgrade-744651 --memory=3072 --vm-driver=docker --container-runtime=crio
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.32.0.1375808351 start -p running-upgrade-744651 --memory=3072 --vm-driver=docker --container-runtime=crio: (21.164456748s)
version_upgrade_test.go:130: (dbg) Run: out/minikube-linux-amd64 start -p running-upgrade-744651 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-744651 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (20.312272744s)
helpers_test.go:175: Cleaning up "running-upgrade-744651" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p running-upgrade-744651
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-744651: (2.364791338s)
--- PASS: TestRunningBinaryUpgrade (44.57s)
=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (21.225885514s)
version_upgrade_test.go:227: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-019060
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-019060: (1.885870576s)
version_upgrade_test.go:232: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-019060 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-019060 status --format={{.Host}}: exit status 7 (78.069222ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (4m26.723258076s)
version_upgrade_test.go:248: (dbg) Run: kubectl --context kubernetes-upgrade-019060 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker --container-runtime=crio: exit status 106 (89.615247ms)
-- stdout --
* [kubernetes-upgrade-019060] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.34.1 cluster to v1.28.0
* Suggestion:
1) Recreate the cluster with Kubernetes 1.28.0, by running:
minikube delete -p kubernetes-upgrade-019060
minikube start -p kubernetes-upgrade-019060 --kubernetes-version=v1.28.0
2) Create a second cluster with Kubernetes 1.28.0, by running:
minikube start -p kubernetes-upgrade-0190602 --kubernetes-version=v1.28.0
3) Use the existing cluster at version Kubernetes 1.34.1, by running:
minikube start -p kubernetes-upgrade-019060 --kubernetes-version=v1.34.1
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-019060 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (5.682609407s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-019060" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-019060
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-019060: (2.602848527s)
--- PASS: TestKubernetesUpgrade (298.37s)
=== RUN TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade
=== CONT TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run: /tmp/minikube-v1.32.0.421449879 start -p missing-upgrade-562593 --memory=3072 --driver=docker --container-runtime=crio
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.32.0.421449879 start -p missing-upgrade-562593 --memory=3072 --driver=docker --container-runtime=crio: (1m14.269693025s)
version_upgrade_test.go:318: (dbg) Run: docker stop missing-upgrade-562593
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-562593: (10.802382815s)
version_upgrade_test.go:323: (dbg) Run: docker rm missing-upgrade-562593
version_upgrade_test.go:329: (dbg) Run: out/minikube-linux-amd64 start -p missing-upgrade-562593 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-562593 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (45.425282724s)
helpers_test.go:175: Cleaning up "missing-upgrade-562593" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p missing-upgrade-562593
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-562593: (2.089768142s)
--- PASS: TestMissingContainerUpgrade (133.14s)
=== RUN TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.53s)
=== RUN TestPause/serial/Start
pause_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -p pause-537523 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=crio
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-537523 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=crio: (49.379333583s)
--- PASS: TestPause/serial/Start (49.38s)
=== RUN TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run: /tmp/minikube-v1.32.0.3713840663 start -p stopped-upgrade-549569 --memory=3072 --vm-driver=docker --container-runtime=crio
E1122 02:43:06.245251 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:43:33.219464 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.32.0.3713840663 start -p stopped-upgrade-549569 --memory=3072 --vm-driver=docker --container-runtime=crio: (1m15.448920087s)
version_upgrade_test.go:192: (dbg) Run: /tmp/minikube-v1.32.0.3713840663 -p stopped-upgrade-549569 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.32.0.3713840663 -p stopped-upgrade-549569 stop: (14.312543327s)
version_upgrade_test.go:198: (dbg) Run: out/minikube-linux-amd64 start -p stopped-upgrade-549569 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-549569 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (15.860225432s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (105.62s)
=== RUN TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run: out/minikube-linux-amd64 start -p pause-537523 --alsologtostderr -v=1 --driver=docker --container-runtime=crio
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-537523 --alsologtostderr -v=1 --driver=docker --container-runtime=crio: (22.46583035s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (22.48s)
=== RUN TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:108: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker --container-runtime=crio
no_kubernetes_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker --container-runtime=crio: exit status 14 (83.966716ms)
-- stdout --
* [NoKubernetes-001085] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
to unset a global config run:
$ minikube config unset kubernetes-version
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)
=== RUN TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:120: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-001085 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio
no_kubernetes_test.go:120: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-001085 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio: (24.871404369s)
no_kubernetes_test.go:225: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-001085 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (25.22s)
=== RUN TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run: out/minikube-linux-amd64 logs -p stopped-upgrade-549569
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-549569: (1.017280413s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.02s)
=== RUN TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run: out/minikube-linux-amd64 start -p false-430524 --memory=3072 --alsologtostderr --cni=false --driver=docker --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-430524 --memory=3072 --alsologtostderr --cni=false --driver=docker --container-runtime=crio: exit status 14 (199.387234ms)
-- stdout --
* [false-430524] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21946
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
-- /stdout --
** stderr **
I1122 02:44:40.957711 213567 out.go:360] Setting OutFile to fd 1 ...
I1122 02:44:40.957868 213567 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:44:40.957882 213567 out.go:374] Setting ErrFile to fd 2...
I1122 02:44:40.957890 213567 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1122 02:44:40.958204 213567 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21946-11041/.minikube/bin
I1122 02:44:40.958837 213567 out.go:368] Setting JSON to false
I1122 02:44:40.960306 213567 start.go:133] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5224,"bootTime":1763774257,"procs":293,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1044-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1122 02:44:40.960384 213567 start.go:143] virtualization: kvm guest
I1122 02:44:40.962500 213567 out.go:179] * [false-430524] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1122 02:44:40.963927 213567 notify.go:221] Checking for updates...
I1122 02:44:40.964596 213567 out.go:179] - MINIKUBE_LOCATION=21946
I1122 02:44:40.968356 213567 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1122 02:44:40.970009 213567 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21946-11041/kubeconfig
I1122 02:44:40.971041 213567 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21946-11041/.minikube
I1122 02:44:40.975084 213567 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1122 02:44:40.976089 213567 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1122 02:44:40.977582 213567 config.go:182] Loaded profile config "NoKubernetes-001085": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:44:40.977712 213567 config.go:182] Loaded profile config "kubernetes-upgrade-019060": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1122 02:44:40.977840 213567 config.go:182] Loaded profile config "missing-upgrade-562593": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.3
I1122 02:44:40.977989 213567 driver.go:422] Setting default libvirt URI to qemu:///system
I1122 02:44:41.006715 213567 docker.go:124] docker version: linux-29.0.2:Docker Engine - Community
I1122 02:44:41.006809 213567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1122 02:44:41.076350 213567 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:60 OomKillDisable:false NGoroutines:78 SystemTime:2025-11-22 02:44:41.064567319 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1044-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652076544 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-15 Labels:[] ExperimentalBuild:false ServerVersion:29.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:fcd43222d6b07379a4be9786bda52438f0dd16a1 Expected:} RuncCommit:{ID:v1.3.3-0-gd842d771 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[
map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.30.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.40.3] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v1.0.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1122 02:44:41.076464 213567 docker.go:319] overlay module found
I1122 02:44:41.078478 213567 out.go:179] * Using the docker driver based on user configuration
I1122 02:44:41.079602 213567 start.go:309] selected driver: docker
I1122 02:44:41.079620 213567 start.go:927] validating driver "docker" against <nil>
I1122 02:44:41.079631 213567 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1122 02:44:41.081460 213567 out.go:203]
W1122 02:44:41.082748 213567 out.go:285] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
I1122 02:44:41.083834 213567 out.go:203]
** /stderr **
net_test.go:88:
----------------------- debugLogs start: false-430524 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-430524
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-430524
>>> host: /etc/nsswitch.conf:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/hosts:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/resolv.conf:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-430524
>>> host: crictl pods:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: crictl containers:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> k8s: describe netcat deployment:
error: context "false-430524" does not exist
>>> k8s: describe netcat pod(s):
error: context "false-430524" does not exist
>>> k8s: netcat logs:
error: context "false-430524" does not exist
>>> k8s: describe coredns deployment:
error: context "false-430524" does not exist
>>> k8s: describe coredns pods:
error: context "false-430524" does not exist
>>> k8s: coredns logs:
error: context "false-430524" does not exist
>>> k8s: describe api server pod(s):
error: context "false-430524" does not exist
>>> k8s: api server logs:
error: context "false-430524" does not exist
>>> host: /etc/cni:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: ip a s:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: ip r s:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: iptables-save:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: iptables table nat:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> k8s: describe kube-proxy daemon set:
error: context "false-430524" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "false-430524" does not exist
>>> k8s: kube-proxy logs:
error: context "false-430524" does not exist
>>> host: kubelet daemon status:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: kubelet daemon config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> k8s: kubelet logs:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:44:16 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-019060
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.103.2:8443
name: missing-upgrade-562593
contexts:
- context:
cluster: kubernetes-upgrade-019060
user: kubernetes-upgrade-019060
name: kubernetes-upgrade-019060
- context:
cluster: missing-upgrade-562593
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-562593
name: missing-upgrade-562593
current-context: ""
kind: Config
users:
- name: kubernetes-upgrade-019060
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key
- name: missing-upgrade-562593
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-430524
>>> host: docker daemon status:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: docker daemon config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/docker/daemon.json:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: docker system info:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: cri-docker daemon status:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: cri-docker daemon config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: cri-dockerd version:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: containerd daemon status:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: containerd daemon config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/containerd/config.toml:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: containerd config dump:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: crio daemon status:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: crio daemon config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: /etc/crio:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
>>> host: crio config:
* Profile "false-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-430524"
----------------------- debugLogs end: false-430524 [took: 3.332531475s] --------------------------------
helpers_test.go:175: Cleaning up "false-430524" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p false-430524
--- PASS: TestNetworkPlugins/group/false (3.71s)
=== RUN TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:137: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio
no_kubernetes_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio: (14.057734068s)
no_kubernetes_test.go:225: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-001085 status -o json
no_kubernetes_test.go:225: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-001085 status -o json: exit status 2 (324.140626ms)
-- stdout --
{"Name":"NoKubernetes-001085","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}
-- /stdout --
no_kubernetes_test.go:149: (dbg) Run: out/minikube-linux-amd64 delete -p NoKubernetes-001085
no_kubernetes_test.go:149: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-001085: (2.084515623s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (16.47s)
=== RUN TestNoKubernetes/serial/Start
no_kubernetes_test.go:161: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio
no_kubernetes_test.go:161: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-001085 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=crio: (7.602594791s)
--- PASS: TestNoKubernetes/serial/Start (7.60s)
=== RUN TestNoKubernetes/serial/VerifyNok8sNoK8sDownloads
no_kubernetes_test.go:89: Checking cache directory: /home/jenkins/minikube-integration/21946-11041/.minikube/cache/linux/amd64/v0.0.0
--- PASS: TestNoKubernetes/serial/VerifyNok8sNoK8sDownloads (0.00s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:172: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-001085 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-001085 "sudo systemctl is-active --quiet service kubelet": exit status 1 (314.841976ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)
=== RUN TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:194: (dbg) Run: out/minikube-linux-amd64 profile list
no_kubernetes_test.go:194: (dbg) Done: out/minikube-linux-amd64 profile list: (16.53664558s)
no_kubernetes_test.go:204: (dbg) Run: out/minikube-linux-amd64 profile list --output=json
no_kubernetes_test.go:204: (dbg) Done: out/minikube-linux-amd64 profile list --output=json: (29.738601535s)
--- PASS: TestNoKubernetes/serial/ProfileList (46.28s)
=== RUN TestNoKubernetes/serial/Stop
no_kubernetes_test.go:183: (dbg) Run: out/minikube-linux-amd64 stop -p NoKubernetes-001085
no_kubernetes_test.go:183: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-001085: (1.272930313s)
--- PASS: TestNoKubernetes/serial/Stop (1.27s)
=== RUN TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:216: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-001085 --driver=docker --container-runtime=crio
no_kubernetes_test.go:216: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-001085 --driver=docker --container-runtime=crio: (6.561536075s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.56s)
=== RUN TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p auto-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker --container-runtime=crio: (38.406850213s)
--- PASS: TestNetworkPlugins/group/auto/Start (38.41s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:172: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-001085 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-001085 "sudo systemctl is-active --quiet service kubelet": exit status 1 (277.301455ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.28s)
=== RUN TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p kindnet-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker --container-runtime=crio: (38.591086972s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (38.59s)
=== RUN TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p auto-430524 "pgrep -a kubelet"
I1122 02:46:46.762073 15072 config.go:182] Loaded profile config "auto-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.27s)
=== RUN TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context auto-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-d54bk" [30e3ce28-468b-4919-9108-5726af56acbe] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-d54bk" [30e3ce28-468b-4919-9108-5726af56acbe] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.003111501s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.19s)
=== RUN TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:352: "kindnet-xmvpc" [6691ea7d-1d82-4374-b900-1e6d81553d2a] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.002905771s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.00s)
=== RUN TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run: kubectl --context auto-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.11s)
=== RUN TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run: kubectl --context auto-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.08s)
=== RUN TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run: kubectl --context auto-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.08s)
=== RUN TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p kindnet-430524 "pgrep -a kubelet"
I1122 02:47:01.136452 15072 config.go:182] Loaded profile config "kindnet-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.27s)
=== RUN TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context kindnet-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-7gnw8" [d0a039a5-5705-4079-beb0-7d088d922f06] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-7gnw8" [d0a039a5-5705-4079-beb0-7d088d922f06] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.004381035s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.17s)
=== RUN TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run: kubectl --context kindnet-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.11s)
=== RUN TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run: kubectl --context kindnet-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.08s)
=== RUN TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run: kubectl --context kindnet-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.09s)
=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p calico-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=crio: (49.10929725s)
--- PASS: TestNetworkPlugins/group/calico/Start (49.11s)
=== RUN TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p custom-flannel-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker --container-runtime=crio: (52.714490441s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (52.71s)
=== RUN TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:352: "calico-node-7gkr5" [f9a9f3a0-077f-488e-92d3-ec326299e8bd] Running / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
E1122 02:48:06.245220 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/addons-416530/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:352: "calico-node-7gkr5" [f9a9f3a0-077f-488e-92d3-ec326299e8bd] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.002604243s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.00s)
=== RUN TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p calico-430524 "pgrep -a kubelet"
I1122 02:48:10.099360 15072 config.go:182] Loaded profile config "calico-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.27s)
=== RUN TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context calico-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-xlbkb" [4c83d961-434a-4efc-9f4a-dce836a4799c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-xlbkb" [4c83d961-434a-4efc-9f4a-dce836a4799c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 8.003240906s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (8.16s)
=== RUN TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run: kubectl --context calico-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.11s)
=== RUN TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run: kubectl --context calico-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.09s)
=== RUN TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run: kubectl --context calico-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.10s)
=== RUN TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p custom-flannel-430524 "pgrep -a kubelet"
I1122 02:48:23.114045 15072 config.go:182] Loaded profile config "custom-flannel-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.29s)
=== RUN TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context custom-flannel-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-v6pj4" [34e48357-d3e0-45a6-b278-e89e9a578c78] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-v6pj4" [34e48357-d3e0-45a6-b278-e89e9a578c78] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 9.003769343s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (9.17s)
=== RUN TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context custom-flannel-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.12s)
=== RUN TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context custom-flannel-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.10s)
=== RUN TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context custom-flannel-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.10s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p enable-default-cni-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker --container-runtime=crio: (35.947158929s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (35.95s)
=== RUN TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p flannel-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p flannel-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker --container-runtime=crio: (54.171213144s)
--- PASS: TestNetworkPlugins/group/flannel/Start (54.17s)
=== RUN TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p bridge-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-430524 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker --container-runtime=crio: (1m6.971287412s)
--- PASS: TestNetworkPlugins/group/bridge/Start (66.97s)
=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-169878 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.28.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-169878 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.28.0: (50.712413873s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (50.71s)
=== RUN TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p enable-default-cni-430524 "pgrep -a kubelet"
I1122 02:49:15.192326 15072 config.go:182] Loaded profile config "enable-default-cni-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)
=== RUN TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context enable-default-cni-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-5rx4t" [0838d9a6-a7a0-44c2-967a-a510e78af0ec] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-5rx4t" [0838d9a6-a7a0-44c2-967a-a510e78af0ec] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.003210672s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.18s)
=== RUN TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run: kubectl --context enable-default-cni-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.10s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run: kubectl --context enable-default-cni-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.08s)
=== RUN TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run: kubectl --context enable-default-cni-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.08s)
=== RUN TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:352: "kube-flannel-ds-wbnhf" [bdd9c074-ce51-4acc-aaad-0b6e811b59f6] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.003880228s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p flannel-430524 "pgrep -a kubelet"
I1122 02:49:40.301888 15072 config.go:182] Loaded profile config "flannel-430524": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.32s)
=== RUN TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context flannel-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-v4kzx" [3b1f4b5b-e629-40c4-9fec-989b30d959e5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-v4kzx" [3b1f4b5b-e629-40c4-9fec-989b30d959e5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.004344274s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.20s)
=== RUN TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (51.986451099s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (51.99s)
=== RUN TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context old-k8s-version-169878 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [b1f5e42f-ea8d-4876-abe0-1dc771a9c751] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [b1f5e42f-ea8d-4876-abe0-1dc771a9c751] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.003221645s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context old-k8s-version-169878 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.28s)
=== RUN TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context flannel-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.16s)
=== RUN TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context flannel-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.16s)
=== RUN TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context flannel-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.09s)
=== RUN TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p bridge-430524 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.33s)
=== RUN TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context bridge-430524 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-zdzsq" [68851119-e706-41a6-a6d4-b7214ec8e097] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-zdzsq" [68851119-e706-41a6-a6d4-b7214ec8e097] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.003301921s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.23s)
=== RUN TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p old-k8s-version-169878 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-169878 --alsologtostderr -v=3: (16.751322317s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (16.75s)
=== RUN TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run: kubectl --context bridge-430524 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.11s)
=== RUN TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run: kubectl --context bridge-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.09s)
=== RUN TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run: kubectl --context bridge-430524 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.11s)
E1122 02:51:56.152830 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:57.194021 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:51:57.435043 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
=== RUN TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (44.932796311s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (44.93s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878: exit status 7 (108.95938ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-169878 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.29s)
=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-169878 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.28.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-169878 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.28.0: (47.566502659s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-169878 -n old-k8s-version-169878
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (47.88s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (40.507089072s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (40.51s)
=== RUN TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context no-preload-346270 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [ac002b55-1114-4073-9f4b-aa618203638d] Pending
helpers_test.go:352: "busybox" [ac002b55-1114-4073-9f4b-aa618203638d] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [ac002b55-1114-4073-9f4b-aa618203638d] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.003870242s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context no-preload-346270 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.25s)
=== RUN TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p no-preload-346270 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-346270 --alsologtostderr -v=3: (18.668515088s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (18.67s)
=== RUN TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context embed-certs-153115 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [3d98398f-9fa2-4e7d-99fb-dd974733447e] Pending
helpers_test.go:352: "busybox" [3d98398f-9fa2-4e7d-99fb-dd974733447e] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [3d98398f-9fa2-4e7d-99fb-dd974733447e] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 7.003103202s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context embed-certs-153115 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (7.21s)
=== RUN TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-mr7x8" [da45cfda-d75d-4960-94d8-f5328f8ded9c] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003507559s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.00s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270: exit status 7 (106.819925ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p no-preload-346270 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.25s)
=== RUN TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-346270 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (22.181742755s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-346270 -n no-preload-346270
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (22.59s)
=== RUN TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p embed-certs-153115 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-153115 --alsologtostderr -v=3: (19.992446894s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (19.99s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context default-k8s-diff-port-714134 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [1adb74f3-b60d-4211-b993-496fae3afe14] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [1adb74f3-b60d-4211-b993-496fae3afe14] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 7.00318839s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context default-k8s-diff-port-714134 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (7.24s)
=== RUN TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-mr7x8" [da45cfda-d75d-4960-94d8-f5328f8ded9c] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004081612s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context old-k8s-version-169878 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)
=== RUN TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-169878 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.27s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p default-k8s-diff-port-714134 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-714134 --alsologtostderr -v=3: (16.767108777s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (16.77s)
=== RUN TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (29.906018163s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (29.91s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115: exit status 7 (121.843669ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-153115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.53s)
=== RUN TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-153115 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (46.171587813s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-153115 -n embed-certs-153115
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (46.51s)
=== RUN TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-h2f2w" [4ec27387-5a7f-4691-9ef9-7081e676846c] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-h2f2w" [4ec27387-5a7f-4691-9ef9-7081e676846c] Running
E1122 02:51:36.284244 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/functional-593219/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 12.005207418s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (12.01s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134: exit status 7 (100.817515ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-714134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.24s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-714134 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (43.761856379s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-714134 -n default-k8s-diff-port-714134
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (44.09s)
=== RUN TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-h2f2w" [4ec27387-5a7f-4691-9ef9-7081e676846c] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.00430961s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context no-preload-346270 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p no-preload-346270 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)
=== RUN TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p newest-cni-021912 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-021912 --alsologtostderr -v=3: (2.8693743s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (2.87s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912: exit status 7 (76.499339ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p newest-cni-021912 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)
=== RUN TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1
E1122 02:51:59.996671 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:52:05.118605 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kindnet-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1122 02:52:07.436147 15072 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/auto-430524/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-021912 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=crio --kubernetes-version=v1.34.1: (11.115467604s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-021912 -n newest-cni-021912
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (11.43s)
=== RUN TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:271: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:282: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-021912 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.24s)
=== RUN TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-5z5fq" [3f73992f-c95c-4469-8867-dd0f3fd4b7c9] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003107993s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.00s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-jdn6w" [a3c3fe98-1996-46a2-943e-a5cd63e9d822] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.002697898s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.00s)
=== RUN TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-5z5fq" [3f73992f-c95c-4469-8867-dd0f3fd4b7c9] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003805557s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context embed-certs-153115 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-jdn6w" [a3c3fe98-1996-46a2-943e-a5cd63e9d822] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003710955s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context default-k8s-diff-port-714134 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.08s)
=== RUN TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-153115 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.22s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-714134 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.24s)
=== RUN TestDownloadOnly/v1.28.0/cached-images
aaa_download_only_test.go:128: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.0/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.28.0/binaries
aaa_download_only_test.go:150: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.0/binaries (0.00s)
=== RUN TestDownloadOnly/v1.28.0/kubectl
aaa_download_only_test.go:166: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.0/kubectl (0.00s)
=== RUN TestDownloadOnly/v1.34.1/cached-images
aaa_download_only_test.go:128: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.34.1/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.34.1/binaries
aaa_download_only_test.go:150: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.34.1/binaries (0.00s)
=== RUN TestDownloadOnly/v1.34.1/kubectl
aaa_download_only_test.go:166: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.34.1/kubectl (0.00s)
=== RUN TestAddons/serial/GCPAuth/RealCredentials
addons_test.go:763: skipping GCPAuth addon test until 'Permission "artifactregistry.repositories.downloadArtifacts" denied on resource "projects/k8s-minikube/locations/us/repositories/test-artifacts" (or it may not exist)' issue is resolved
--- SKIP: TestAddons/serial/GCPAuth/RealCredentials (0.00s)
=== RUN TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm
=== CONT TestAddons/parallel/Olm
addons_test.go:483: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)
=== RUN TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)
=== RUN TestDockerEnvContainerd
docker_test.go:170: running with crio true linux amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)
=== RUN TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:37: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)
=== RUN TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:101: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)
=== RUN TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv
=== CONT TestFunctional/parallel/DockerEnv
functional_test.go:478: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)
=== RUN TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv
=== CONT TestFunctional/parallel/PodmanEnv
functional_test.go:565: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)
=== RUN TestFunctionalNewestKubernetes
functional_test.go:82:
--- SKIP: TestFunctionalNewestKubernetes (0.00s)
=== RUN TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)
=== RUN TestImageBuild
image_test.go:33:
--- SKIP: TestImageBuild (0.00s)
=== RUN TestISOImage
iso_test.go:36: This test requires a VM driver
--- SKIP: TestISOImage (0.00s)
=== RUN TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)
=== RUN TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)
=== RUN TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)
=== RUN TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:636:
----------------------- debugLogs start: kubenet-430524 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-430524
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-430524
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/hosts:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/resolv.conf:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-430524
>>> host: crictl pods:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: crictl containers:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> k8s: describe netcat deployment:
error: context "kubenet-430524" does not exist
>>> k8s: describe netcat pod(s):
error: context "kubenet-430524" does not exist
>>> k8s: netcat logs:
error: context "kubenet-430524" does not exist
>>> k8s: describe coredns deployment:
error: context "kubenet-430524" does not exist
>>> k8s: describe coredns pods:
error: context "kubenet-430524" does not exist
>>> k8s: coredns logs:
error: context "kubenet-430524" does not exist
>>> k8s: describe api server pod(s):
error: context "kubenet-430524" does not exist
>>> k8s: api server logs:
error: context "kubenet-430524" does not exist
>>> host: /etc/cni:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: ip a s:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: ip r s:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: iptables-save:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: iptables table nat:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-430524" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-430524" does not exist
>>> k8s: kube-proxy logs:
error: context "kubenet-430524" does not exist
>>> host: kubelet daemon status:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: kubelet daemon config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> k8s: kubelet logs:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:44:16 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-019060
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.103.2:8443
name: missing-upgrade-562593
contexts:
- context:
cluster: kubernetes-upgrade-019060
user: kubernetes-upgrade-019060
name: kubernetes-upgrade-019060
- context:
cluster: missing-upgrade-562593
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-562593
name: missing-upgrade-562593
current-context: ""
kind: Config
users:
- name: kubernetes-upgrade-019060
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key
- name: missing-upgrade-562593
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-430524
>>> host: docker daemon status:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: docker daemon config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: docker system info:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: cri-docker daemon status:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: cri-docker daemon config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: cri-dockerd version:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: containerd daemon status:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: containerd daemon config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: containerd config dump:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: crio daemon status:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: crio daemon config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: /etc/crio:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
>>> host: crio config:
* Profile "kubenet-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-430524"
----------------------- debugLogs end: kubenet-430524 [took: 4.90086725s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-430524" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubenet-430524
--- SKIP: TestNetworkPlugins/group/kubenet (5.19s)
=== RUN TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:636:
----------------------- debugLogs start: cilium-430524 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-430524
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-430524
>>> host: /etc/nsswitch.conf:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/hosts:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/resolv.conf:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-430524
>>> host: crictl pods:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: crictl containers:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> k8s: describe netcat deployment:
error: context "cilium-430524" does not exist
>>> k8s: describe netcat pod(s):
error: context "cilium-430524" does not exist
>>> k8s: netcat logs:
error: context "cilium-430524" does not exist
>>> k8s: describe coredns deployment:
error: context "cilium-430524" does not exist
>>> k8s: describe coredns pods:
error: context "cilium-430524" does not exist
>>> k8s: coredns logs:
error: context "cilium-430524" does not exist
>>> k8s: describe api server pod(s):
error: context "cilium-430524" does not exist
>>> k8s: api server logs:
error: context "cilium-430524" does not exist
>>> host: /etc/cni:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: ip a s:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: ip r s:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: iptables-save:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: iptables table nat:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-430524
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-430524
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-430524" does not exist
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-430524" does not exist
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-430524
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-430524
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-430524" does not exist
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-430524" does not exist
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-430524" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-430524" does not exist
>>> k8s: kube-proxy logs:
error: context "cilium-430524" does not exist
>>> host: kubelet daemon status:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: kubelet daemon config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> k8s: kubelet logs:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:44:16 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-019060
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21946-11041/.minikube/ca.crt
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.103.2:8443
name: missing-upgrade-562593
contexts:
- context:
cluster: kubernetes-upgrade-019060
user: kubernetes-upgrade-019060
name: kubernetes-upgrade-019060
- context:
cluster: missing-upgrade-562593
extensions:
- extension:
last-update: Sat, 22 Nov 2025 02:43:58 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-562593
name: missing-upgrade-562593
current-context: ""
kind: Config
users:
- name: kubernetes-upgrade-019060
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/kubernetes-upgrade-019060/client.key
- name: missing-upgrade-562593
user:
client-certificate: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.crt
client-key: /home/jenkins/minikube-integration/21946-11041/.minikube/profiles/missing-upgrade-562593/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-430524
>>> host: docker daemon status:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: docker daemon config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/docker/daemon.json:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: docker system info:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: cri-docker daemon status:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: cri-docker daemon config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: cri-dockerd version:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: containerd daemon status:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: containerd daemon config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/containerd/config.toml:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: containerd config dump:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: crio daemon status:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: crio daemon config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: /etc/crio:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
>>> host: crio config:
* Profile "cilium-430524" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-430524"
----------------------- debugLogs end: cilium-430524 [took: 3.632215039s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-430524" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cilium-430524
--- SKIP: TestNetworkPlugins/group/cilium (3.83s)
=== RUN TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts
=== CONT TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:101: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-212164" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p disable-driver-mounts-212164
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)