=== RUN TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run: out/minikube-linux-arm64 start -p scheduled-stop-796413 --memory=3072 --driver=docker --container-runtime=docker
E1123 08:50:18.715548 4159 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/functional-376312/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-796413 --memory=3072 --driver=docker --container-runtime=docker: (35.641328143s)
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-arm64 stop -p scheduled-stop-796413 --schedule 5m -v=5 --alsologtostderr
minikube stop output:
** stderr **
I1123 08:50:25.746871 208728 out.go:360] Setting OutFile to fd 1 ...
I1123 08:50:25.746988 208728 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:50:25.746999 208728 out.go:374] Setting ErrFile to fd 2...
I1123 08:50:25.747004 208728 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:50:25.747400 208728 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21969-2348/.minikube/bin
I1123 08:50:25.747702 208728 out.go:368] Setting JSON to false
I1123 08:50:25.747912 208728 mustload.go:66] Loading cluster: scheduled-stop-796413
I1123 08:50:25.748583 208728 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
I1123 08:50:25.748671 208728 profile.go:143] Saving config to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/config.json ...
I1123 08:50:25.748886 208728 mustload.go:66] Loading cluster: scheduled-stop-796413
I1123 08:50:25.749015 208728 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
** /stderr **
scheduled_stop_test.go:204: (dbg) Run: out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-796413 -n scheduled-stop-796413
scheduled_stop_test.go:172: signal error was: <nil>
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-arm64 stop -p scheduled-stop-796413 --schedule 15s -v=5 --alsologtostderr
minikube stop output:
** stderr **
I1123 08:50:26.190877 208815 out.go:360] Setting OutFile to fd 1 ...
I1123 08:50:26.191083 208815 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:50:26.191105 208815 out.go:374] Setting ErrFile to fd 2...
I1123 08:50:26.191123 208815 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:50:26.191426 208815 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21969-2348/.minikube/bin
I1123 08:50:26.191717 208815 out.go:368] Setting JSON to false
I1123 08:50:26.191961 208815 daemonize_unix.go:73] killing process 208744 as it is an old scheduled stop
I1123 08:50:26.192063 208815 mustload.go:66] Loading cluster: scheduled-stop-796413
I1123 08:50:26.192559 208815 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
I1123 08:50:26.192685 208815 profile.go:143] Saving config to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/config.json ...
I1123 08:50:26.192921 208815 mustload.go:66] Loading cluster: scheduled-stop-796413
I1123 08:50:26.193085 208815 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
** /stderr **
scheduled_stop_test.go:172: signal error was: <nil>
scheduled_stop_test.go:98: process 208744 running but should have been killed on reschedule of stop
panic.go:615: *** TestScheduledStopUnix FAILED at 2025-11-23 08:50:26.196894062 +0000 UTC m=+2377.665134745
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestScheduledStopUnix]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestScheduledStopUnix]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect scheduled-stop-796413
helpers_test.go:243: (dbg) docker inspect scheduled-stop-796413:
-- stdout --
[
{
"Id": "56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702",
"Created": "2025-11-23T08:49:55.044507103Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 205965,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-23T08:49:55.113172103Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:572c983e466f1f784136812eef5cc59ac623db764bc7704d3676c4643993fd08",
"ResolvConfPath": "/var/lib/docker/containers/56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702/hostname",
"HostsPath": "/var/lib/docker/containers/56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702/hosts",
"LogPath": "/var/lib/docker/containers/56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702/56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702-json.log",
"Name": "/scheduled-stop-796413",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"scheduled-stop-796413:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "scheduled-stop-796413",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "56f752b8c856d7e843e315db97730cb31ae986eb75fe886cf323fbc45bef3702",
"LowerDir": "/var/lib/docker/overlay2/5dd86cac8aec217160547c04ae26784a66581a7bed4b4411b24ac74cc114ee50-init/diff:/var/lib/docker/overlay2/3fb1513b0ac8259904671a401388a3d254718e126087d75697f2512f126510c2/diff",
"MergedDir": "/var/lib/docker/overlay2/5dd86cac8aec217160547c04ae26784a66581a7bed4b4411b24ac74cc114ee50/merged",
"UpperDir": "/var/lib/docker/overlay2/5dd86cac8aec217160547c04ae26784a66581a7bed4b4411b24ac74cc114ee50/diff",
"WorkDir": "/var/lib/docker/overlay2/5dd86cac8aec217160547c04ae26784a66581a7bed4b4411b24ac74cc114ee50/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "scheduled-stop-796413",
"Source": "/var/lib/docker/volumes/scheduled-stop-796413/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "scheduled-stop-796413",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "scheduled-stop-796413",
"name.minikube.sigs.k8s.io": "scheduled-stop-796413",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "784f1453d740a72a4dd9cce7c51e14e7ffc2af837da3cfc55b2acea5153bbf60",
"SandboxKey": "/var/run/docker/netns/784f1453d740",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32968"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32969"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32972"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32970"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32971"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"scheduled-stop-796413": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "0a:3e:3c:c4:e3:3d",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "9c64a1fa0f6474c1be2829f5a8283e5c91d4d474358567d9aa1596fe52e7c597",
"EndpointID": "1ef0a80ea43abf5261a2bbf4475d294f4c4086dc9cbe65e5be4c496eba9d365b",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"scheduled-stop-796413",
"56f752b8c856"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-796413 -n scheduled-stop-796413
helpers_test.go:252: <<< TestScheduledStopUnix FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestScheduledStopUnix]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-arm64 -p scheduled-stop-796413 logs -n 25
helpers_test.go:260: TestScheduledStopUnix logs:
-- stdout --
==> Audit <==
┌─────────┬─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ stop │ -p multinode-327794 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:43 UTC │ 23 Nov 25 08:44 UTC │
│ start │ -p multinode-327794 --wait=true -v=5 --alsologtostderr │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:44 UTC │ 23 Nov 25 08:45 UTC │
│ node │ list -p multinode-327794 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:45 UTC │ │
│ node │ multinode-327794 node delete m03 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:45 UTC │ 23 Nov 25 08:45 UTC │
│ stop │ multinode-327794 stop │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:45 UTC │ 23 Nov 25 08:45 UTC │
│ start │ -p multinode-327794 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=docker │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:45 UTC │ 23 Nov 25 08:46 UTC │
│ node │ list -p multinode-327794 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:46 UTC │ │
│ start │ -p multinode-327794-m02 --driver=docker --container-runtime=docker │ multinode-327794-m02 │ jenkins │ v1.37.0 │ 23 Nov 25 08:46 UTC │ │
│ start │ -p multinode-327794-m03 --driver=docker --container-runtime=docker │ multinode-327794-m03 │ jenkins │ v1.37.0 │ 23 Nov 25 08:46 UTC │ 23 Nov 25 08:47 UTC │
│ node │ add -p multinode-327794 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:47 UTC │ │
│ delete │ -p multinode-327794-m03 │ multinode-327794-m03 │ jenkins │ v1.37.0 │ 23 Nov 25 08:47 UTC │ 23 Nov 25 08:47 UTC │
│ delete │ -p multinode-327794 │ multinode-327794 │ jenkins │ v1.37.0 │ 23 Nov 25 08:47 UTC │ 23 Nov 25 08:47 UTC │
│ start │ -p test-preload-912414 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=docker --kubernetes-version=v1.32.0 │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:47 UTC │ 23 Nov 25 08:48 UTC │
│ image │ test-preload-912414 image pull gcr.io/k8s-minikube/busybox │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:48 UTC │ 23 Nov 25 08:48 UTC │
│ stop │ -p test-preload-912414 │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:48 UTC │ 23 Nov 25 08:48 UTC │
│ start │ -p test-preload-912414 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=docker │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:48 UTC │ 23 Nov 25 08:49 UTC │
│ image │ test-preload-912414 image list │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:49 UTC │ 23 Nov 25 08:49 UTC │
│ delete │ -p test-preload-912414 │ test-preload-912414 │ jenkins │ v1.37.0 │ 23 Nov 25 08:49 UTC │ 23 Nov 25 08:49 UTC │
│ start │ -p scheduled-stop-796413 --memory=3072 --driver=docker --container-runtime=docker │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:49 UTC │ 23 Nov 25 08:50 UTC │
│ stop │ -p scheduled-stop-796413 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
│ stop │ -p scheduled-stop-796413 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
│ stop │ -p scheduled-stop-796413 --schedule 5m -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
│ stop │ -p scheduled-stop-796413 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
│ stop │ -p scheduled-stop-796413 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
│ stop │ -p scheduled-stop-796413 --schedule 15s -v=5 --alsologtostderr │ scheduled-stop-796413 │ jenkins │ v1.37.0 │ 23 Nov 25 08:50 UTC │ │
└─────────┴─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/23 08:49:50
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.25.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1123 08:49:50.096982 205575 out.go:360] Setting OutFile to fd 1 ...
I1123 08:49:50.097099 205575 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:49:50.097103 205575 out.go:374] Setting ErrFile to fd 2...
I1123 08:49:50.097106 205575 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1123 08:49:50.097447 205575 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21969-2348/.minikube/bin
I1123 08:49:50.097868 205575 out.go:368] Setting JSON to false
I1123 08:49:50.098824 205575 start.go:133] hostinfo: {"hostname":"ip-172-31-30-239","uptime":5541,"bootTime":1763882249,"procs":153,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1084-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I1123 08:49:50.098890 205575 start.go:143] virtualization:
I1123 08:49:50.102893 205575 out.go:179] * [scheduled-stop-796413] minikube v1.37.0 on Ubuntu 20.04 (arm64)
I1123 08:49:50.107503 205575 out.go:179] - MINIKUBE_LOCATION=21969
I1123 08:49:50.107589 205575 notify.go:221] Checking for updates...
I1123 08:49:50.114116 205575 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1123 08:49:50.117419 205575 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21969-2348/kubeconfig
I1123 08:49:50.120631 205575 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21969-2348/.minikube
I1123 08:49:50.123843 205575 out.go:179] - MINIKUBE_BIN=out/minikube-linux-arm64
I1123 08:49:50.127049 205575 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1123 08:49:50.130471 205575 driver.go:422] Setting default libvirt URI to qemu:///system
I1123 08:49:50.158417 205575 docker.go:124] docker version: linux-28.1.1:Docker Engine - Community
I1123 08:49:50.158521 205575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1123 08:49:50.222998 205575 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:true NGoroutines:42 SystemTime:2025-11-23 08:49:50.213885244 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I1123 08:49:50.223089 205575 docker.go:319] overlay module found
I1123 08:49:50.226453 205575 out.go:179] * Using the docker driver based on user configuration
I1123 08:49:50.229615 205575 start.go:309] selected driver: docker
I1123 08:49:50.229624 205575 start.go:927] validating driver "docker" against <nil>
I1123 08:49:50.229636 205575 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1123 08:49:50.230391 205575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1123 08:49:50.281891 205575 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:true NGoroutines:42 SystemTime:2025-11-23 08:49:50.272975375 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I1123 08:49:50.282022 205575 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1123 08:49:50.282230 205575 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
I1123 08:49:50.285286 205575 out.go:179] * Using Docker driver with root privileges
I1123 08:49:50.288289 205575 cni.go:84] Creating CNI manager for ""
I1123 08:49:50.288360 205575 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1123 08:49:50.288369 205575 start_flags.go:336] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1123 08:49:50.288450 205575 start.go:353] cluster config:
{Name:scheduled-stop-796413 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:scheduled-stop-796413 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1123 08:49:50.291613 205575 out.go:179] * Starting "scheduled-stop-796413" primary control-plane node in "scheduled-stop-796413" cluster
I1123 08:49:50.294553 205575 cache.go:134] Beginning downloading kic base image for docker with docker
I1123 08:49:50.297475 205575 out.go:179] * Pulling base image v0.0.48-1763789673-21948 ...
I1123 08:49:50.300489 205575 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f in local docker daemon
I1123 08:49:50.300510 205575 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker
I1123 08:49:50.300548 205575 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21969-2348/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-docker-overlay2-arm64.tar.lz4
I1123 08:49:50.300556 205575 cache.go:65] Caching tarball of preloaded images
I1123 08:49:50.300645 205575 preload.go:238] Found /home/jenkins/minikube-integration/21969-2348/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I1123 08:49:50.300651 205575 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on docker
I1123 08:49:50.300979 205575 profile.go:143] Saving config to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/config.json ...
I1123 08:49:50.300997 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/config.json: {Name:mkb96f698d54dbdd8fabf0fc90ca7634b42ad97e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:49:50.319780 205575 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f in local docker daemon, skipping pull
I1123 08:49:50.319791 205575 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f exists in daemon, skipping load
I1123 08:49:50.319804 205575 cache.go:243] Successfully downloaded all kic artifacts
I1123 08:49:50.319835 205575 start.go:360] acquireMachinesLock for scheduled-stop-796413: {Name:mka1128db5e215703cf4cf550b0264cfccd569b0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1123 08:49:50.319933 205575 start.go:364] duration metric: took 84.423µs to acquireMachinesLock for "scheduled-stop-796413"
I1123 08:49:50.319956 205575 start.go:93] Provisioning new machine with config: &{Name:scheduled-stop-796413 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:scheduled-stop-796413 Namespace:default APIServerHAVIP: A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I1123 08:49:50.320019 205575 start.go:125] createHost starting for "" (driver="docker")
I1123 08:49:50.323494 205575 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1123 08:49:50.323763 205575 start.go:159] libmachine.API.Create for "scheduled-stop-796413" (driver="docker")
I1123 08:49:50.323795 205575 client.go:173] LocalClient.Create starting
I1123 08:49:50.323868 205575 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem
I1123 08:49:50.323900 205575 main.go:143] libmachine: Decoding PEM data...
I1123 08:49:50.323919 205575 main.go:143] libmachine: Parsing certificate...
I1123 08:49:50.323971 205575 main.go:143] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21969-2348/.minikube/certs/cert.pem
I1123 08:49:50.323986 205575 main.go:143] libmachine: Decoding PEM data...
I1123 08:49:50.323996 205575 main.go:143] libmachine: Parsing certificate...
I1123 08:49:50.324352 205575 cli_runner.go:164] Run: docker network inspect scheduled-stop-796413 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1123 08:49:50.340333 205575 cli_runner.go:211] docker network inspect scheduled-stop-796413 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1123 08:49:50.340408 205575 network_create.go:284] running [docker network inspect scheduled-stop-796413] to gather additional debugging logs...
I1123 08:49:50.340422 205575 cli_runner.go:164] Run: docker network inspect scheduled-stop-796413
W1123 08:49:50.356107 205575 cli_runner.go:211] docker network inspect scheduled-stop-796413 returned with exit code 1
I1123 08:49:50.356128 205575 network_create.go:287] error running [docker network inspect scheduled-stop-796413]: docker network inspect scheduled-stop-796413: exit status 1
stdout:
[]
stderr:
Error response from daemon: network scheduled-stop-796413 not found
I1123 08:49:50.356140 205575 network_create.go:289] output of [docker network inspect scheduled-stop-796413]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network scheduled-stop-796413 not found
** /stderr **
I1123 08:49:50.356249 205575 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1123 08:49:50.371950 205575 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-2392889f6a40 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ea:ed:e9:cf:07:8c} reservation:<nil>}
I1123 08:49:50.372236 205575 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-c5cea0eb6604 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:06:e9:52:95:12:c2} reservation:<nil>}
I1123 08:49:50.372473 205575 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-177ee448abc9 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:1a:3b:a2:58:0e:f4} reservation:<nil>}
I1123 08:49:50.372802 205575 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40019b0cc0}
I1123 08:49:50.372817 205575 network_create.go:124] attempt to create docker network scheduled-stop-796413 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I1123 08:49:50.372874 205575 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=scheduled-stop-796413 scheduled-stop-796413
I1123 08:49:50.436434 205575 network_create.go:108] docker network scheduled-stop-796413 192.168.76.0/24 created
I1123 08:49:50.436456 205575 kic.go:121] calculated static IP "192.168.76.2" for the "scheduled-stop-796413" container
I1123 08:49:50.436537 205575 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1123 08:49:50.452273 205575 cli_runner.go:164] Run: docker volume create scheduled-stop-796413 --label name.minikube.sigs.k8s.io=scheduled-stop-796413 --label created_by.minikube.sigs.k8s.io=true
I1123 08:49:50.471454 205575 oci.go:103] Successfully created a docker volume scheduled-stop-796413
I1123 08:49:50.471527 205575 cli_runner.go:164] Run: docker run --rm --name scheduled-stop-796413-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=scheduled-stop-796413 --entrypoint /usr/bin/test -v scheduled-stop-796413:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f -d /var/lib
I1123 08:49:50.975520 205575 oci.go:107] Successfully prepared a docker volume scheduled-stop-796413
I1123 08:49:50.975585 205575 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker
I1123 08:49:50.975593 205575 kic.go:194] Starting extracting preloaded images to volume ...
I1123 08:49:50.975655 205575 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21969-2348/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v scheduled-stop-796413:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f -I lz4 -xf /preloaded.tar -C /extractDir
I1123 08:49:54.971718 205575 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21969-2348/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v scheduled-stop-796413:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f -I lz4 -xf /preloaded.tar -C /extractDir: (3.996018136s)
I1123 08:49:54.971739 205575 kic.go:203] duration metric: took 3.996143528s to extract preloaded images to volume ...
W1123 08:49:54.971875 205575 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I1123 08:49:54.971975 205575 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1123 08:49:55.028107 205575 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname scheduled-stop-796413 --name scheduled-stop-796413 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=scheduled-stop-796413 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=scheduled-stop-796413 --network scheduled-stop-796413 --ip 192.168.76.2 --volume scheduled-stop-796413:/var --security-opt apparmor=unconfined --memory=3072mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f
I1123 08:49:55.319977 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Running}}
I1123 08:49:55.350538 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:49:55.378486 205575 cli_runner.go:164] Run: docker exec scheduled-stop-796413 stat /var/lib/dpkg/alternatives/iptables
I1123 08:49:55.428506 205575 oci.go:144] the created container "scheduled-stop-796413" has a running status.
I1123 08:49:55.428532 205575 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa...
I1123 08:49:55.600650 205575 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1123 08:49:55.629190 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:49:55.657538 205575 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1123 08:49:55.657554 205575 kic_runner.go:114] Args: [docker exec --privileged scheduled-stop-796413 chown docker:docker /home/docker/.ssh/authorized_keys]
I1123 08:49:55.724888 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:49:55.747980 205575 machine.go:94] provisionDockerMachine start ...
I1123 08:49:55.748246 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:55.774606 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:49:55.774940 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:49:55.774946 205575 main.go:143] libmachine: About to run SSH command:
hostname
I1123 08:49:55.775645 205575 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I1123 08:49:58.928656 205575 main.go:143] libmachine: SSH cmd err, output: <nil>: scheduled-stop-796413
I1123 08:49:58.928679 205575 ubuntu.go:182] provisioning hostname "scheduled-stop-796413"
I1123 08:49:58.928744 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:58.945169 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:49:58.945530 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:49:58.945543 205575 main.go:143] libmachine: About to run SSH command:
sudo hostname scheduled-stop-796413 && echo "scheduled-stop-796413" | sudo tee /etc/hostname
I1123 08:49:59.101960 205575 main.go:143] libmachine: SSH cmd err, output: <nil>: scheduled-stop-796413
I1123 08:49:59.102097 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:59.120069 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:49:59.120409 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:49:59.120423 205575 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sscheduled-stop-796413' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 scheduled-stop-796413/g' /etc/hosts;
else
echo '127.0.1.1 scheduled-stop-796413' | sudo tee -a /etc/hosts;
fi
fi
I1123 08:49:59.269305 205575 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1123 08:49:59.269321 205575 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21969-2348/.minikube CaCertPath:/home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21969-2348/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21969-2348/.minikube}
I1123 08:49:59.269343 205575 ubuntu.go:190] setting up certificates
I1123 08:49:59.269351 205575 provision.go:84] configureAuth start
I1123 08:49:59.269410 205575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" scheduled-stop-796413
I1123 08:49:59.286786 205575 provision.go:143] copyHostCerts
I1123 08:49:59.286839 205575 exec_runner.go:144] found /home/jenkins/minikube-integration/21969-2348/.minikube/key.pem, removing ...
I1123 08:49:59.286845 205575 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21969-2348/.minikube/key.pem
I1123 08:49:59.286917 205575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21969-2348/.minikube/key.pem (1675 bytes)
I1123 08:49:59.287014 205575 exec_runner.go:144] found /home/jenkins/minikube-integration/21969-2348/.minikube/ca.pem, removing ...
I1123 08:49:59.287017 205575 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21969-2348/.minikube/ca.pem
I1123 08:49:59.287041 205575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21969-2348/.minikube/ca.pem (1082 bytes)
I1123 08:49:59.287097 205575 exec_runner.go:144] found /home/jenkins/minikube-integration/21969-2348/.minikube/cert.pem, removing ...
I1123 08:49:59.287100 205575 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21969-2348/.minikube/cert.pem
I1123 08:49:59.287122 205575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21969-2348/.minikube/cert.pem (1123 bytes)
I1123 08:49:59.287174 205575 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21969-2348/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca-key.pem org=jenkins.scheduled-stop-796413 san=[127.0.0.1 192.168.76.2 localhost minikube scheduled-stop-796413]
I1123 08:49:59.546527 205575 provision.go:177] copyRemoteCerts
I1123 08:49:59.546575 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1123 08:49:59.546615 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:59.564735 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:49:59.668986 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I1123 08:49:59.686886 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1123 08:49:59.704652 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1123 08:49:59.721921 205575 provision.go:87] duration metric: took 452.547446ms to configureAuth
I1123 08:49:59.721950 205575 ubuntu.go:206] setting minikube options for container-runtime
I1123 08:49:59.722126 205575 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
I1123 08:49:59.722175 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:59.739271 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:49:59.739571 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:49:59.739577 205575 main.go:143] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1123 08:49:59.889878 205575 main.go:143] libmachine: SSH cmd err, output: <nil>: overlay
I1123 08:49:59.889890 205575 ubuntu.go:71] root file system type: overlay
I1123 08:49:59.890017 205575 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I1123 08:49:59.890081 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:49:59.907980 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:49:59.908303 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:49:59.908376 205575 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target
Wants=network-online.target containerd.service
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=always
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \
-H fd:// --containerd=/run/containerd/containerd.sock \
-H unix:///var/run/docker.sock \
--default-ulimit=nofile=1048576:1048576 \
--tlsverify \
--tlscacert /etc/docker/ca.pem \
--tlscert /etc/docker/server.pem \
--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1123 08:50:00.148635 205575 main.go:143] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target
Wants=network-online.target containerd.service
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=always
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H fd:// --containerd=/run/containerd/containerd.sock -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
I1123 08:50:00.148724 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:00.186402 205575 main.go:143] libmachine: Using SSH client type: native
I1123 08:50:00.186725 205575 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32968 <nil> <nil>}
I1123 08:50:00.186739 205575 main.go:143] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1123 08:50:01.309070 205575 main.go:143] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2025-11-17 12:33:01.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2025-11-23 08:50:00.141979451 +0000
@@ -9,23 +9,34 @@
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
Restart=always
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H fd:// --containerd=/run/containerd/containerd.sock -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
+
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I1123 08:50:01.309089 205575 machine.go:97] duration metric: took 5.561097362s to provisionDockerMachine
I1123 08:50:01.309100 205575 client.go:176] duration metric: took 10.985300135s to LocalClient.Create
I1123 08:50:01.309111 205575 start.go:167] duration metric: took 10.985348226s to libmachine.API.Create "scheduled-stop-796413"
I1123 08:50:01.309119 205575 start.go:293] postStartSetup for "scheduled-stop-796413" (driver="docker")
I1123 08:50:01.309128 205575 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1123 08:50:01.309194 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1123 08:50:01.309232 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:01.329794 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:01.437981 205575 ssh_runner.go:195] Run: cat /etc/os-release
I1123 08:50:01.441584 205575 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1123 08:50:01.441603 205575 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1123 08:50:01.441613 205575 filesync.go:126] Scanning /home/jenkins/minikube-integration/21969-2348/.minikube/addons for local assets ...
I1123 08:50:01.441673 205575 filesync.go:126] Scanning /home/jenkins/minikube-integration/21969-2348/.minikube/files for local assets ...
I1123 08:50:01.441776 205575 filesync.go:149] local asset: /home/jenkins/minikube-integration/21969-2348/.minikube/files/etc/ssl/certs/41592.pem -> 41592.pem in /etc/ssl/certs
I1123 08:50:01.441891 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1123 08:50:01.449792 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/files/etc/ssl/certs/41592.pem --> /etc/ssl/certs/41592.pem (1708 bytes)
I1123 08:50:01.468135 205575 start.go:296] duration metric: took 158.98749ms for postStartSetup
I1123 08:50:01.468502 205575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" scheduled-stop-796413
I1123 08:50:01.486086 205575 profile.go:143] Saving config to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/config.json ...
I1123 08:50:01.486348 205575 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1123 08:50:01.486399 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:01.504445 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:01.606891 205575 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1123 08:50:01.611736 205575 start.go:128] duration metric: took 11.291702811s to createHost
I1123 08:50:01.611752 205575 start.go:83] releasing machines lock for "scheduled-stop-796413", held for 11.291812112s
I1123 08:50:01.611828 205575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" scheduled-stop-796413
I1123 08:50:01.629169 205575 ssh_runner.go:195] Run: cat /version.json
I1123 08:50:01.629211 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:01.629231 205575 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1123 08:50:01.629311 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:01.647957 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:01.650785 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:01.753224 205575 ssh_runner.go:195] Run: systemctl --version
I1123 08:50:01.844327 205575 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1123 08:50:01.849075 205575 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1123 08:50:01.849162 205575 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1123 08:50:01.877964 205575 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/10-crio-bridge.conflist.disabled] bridge cni config(s)
I1123 08:50:01.877980 205575 start.go:496] detecting cgroup driver to use...
I1123 08:50:01.878012 205575 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1123 08:50:01.878110 205575 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1123 08:50:01.893020 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1123 08:50:01.902628 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1123 08:50:01.912165 205575 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1123 08:50:01.912234 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1123 08:50:01.922029 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1123 08:50:01.931259 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1123 08:50:01.940355 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1123 08:50:01.949395 205575 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1123 08:50:01.957992 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1123 08:50:01.967513 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1123 08:50:01.976759 205575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1123 08:50:01.986017 205575 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1123 08:50:01.994064 205575 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1123 08:50:02.002066 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:02.119337 205575 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1123 08:50:02.206069 205575 start.go:496] detecting cgroup driver to use...
I1123 08:50:02.206109 205575 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1123 08:50:02.206174 205575 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1123 08:50:02.221189 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1123 08:50:02.236213 205575 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1123 08:50:02.258850 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1123 08:50:02.272644 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1123 08:50:02.286945 205575 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1123 08:50:02.302145 205575 ssh_runner.go:195] Run: which cri-dockerd
I1123 08:50:02.305978 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1123 08:50:02.313773 205575 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (192 bytes)
I1123 08:50:02.326536 205575 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1123 08:50:02.457170 205575 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1123 08:50:02.581999 205575 docker.go:575] configuring docker to use "cgroupfs" as cgroup driver...
I1123 08:50:02.582084 205575 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1123 08:50:02.596759 205575 ssh_runner.go:195] Run: sudo systemctl reset-failed docker
I1123 08:50:02.610235 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:02.747821 205575 ssh_runner.go:195] Run: sudo systemctl restart docker
I1123 08:50:03.148015 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1123 08:50:03.160988 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I1123 08:50:03.175233 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1123 08:50:03.189068 205575 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1123 08:50:03.319260 205575 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1123 08:50:03.447366 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:03.569237 205575 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1123 08:50:03.584514 205575 ssh_runner.go:195] Run: sudo systemctl reset-failed cri-docker.service
I1123 08:50:03.598559 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:03.713379 205575 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I1123 08:50:03.785006 205575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1123 08:50:03.799600 205575 start.go:543] Will wait 60s for socket path /var/run/cri-dockerd.sock
I1123 08:50:03.799670 205575 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I1123 08:50:03.803377 205575 start.go:564] Will wait 60s for crictl version
I1123 08:50:03.803435 205575 ssh_runner.go:195] Run: which crictl
I1123 08:50:03.807133 205575 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1123 08:50:03.832203 205575 start.go:580] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 29.0.2
RuntimeApiVersion: v1
I1123 08:50:03.832271 205575 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1123 08:50:03.854066 205575 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1123 08:50:03.881803 205575 out.go:252] * Preparing Kubernetes v1.34.1 on Docker 29.0.2 ...
I1123 08:50:03.881900 205575 cli_runner.go:164] Run: docker network inspect scheduled-stop-796413 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1123 08:50:03.898161 205575 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1123 08:50:03.902060 205575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1123 08:50:03.911558 205575 kubeadm.go:884] updating cluster {Name:scheduled-stop-796413 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:scheduled-stop-796413 Namespace:default APIServerHAVIP: APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock
: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1123 08:50:03.911662 205575 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker
I1123 08:50:03.911716 205575 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1123 08:50:03.930605 205575 docker.go:691] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.34.1
registry.k8s.io/kube-controller-manager:v1.34.1
registry.k8s.io/kube-scheduler:v1.34.1
registry.k8s.io/kube-proxy:v1.34.1
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/pause:3.10.1
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I1123 08:50:03.930616 205575 docker.go:621] Images already preloaded, skipping extraction
I1123 08:50:03.930678 205575 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1123 08:50:03.950740 205575 docker.go:691] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.34.1
registry.k8s.io/kube-scheduler:v1.34.1
registry.k8s.io/kube-controller-manager:v1.34.1
registry.k8s.io/kube-proxy:v1.34.1
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/pause:3.10.1
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I1123 08:50:03.950756 205575 cache_images.go:86] Images are preloaded, skipping loading
I1123 08:50:03.950764 205575 kubeadm.go:935] updating node { 192.168.76.2 8443 v1.34.1 docker true true} ...
I1123 08:50:03.950850 205575 kubeadm.go:947] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=scheduled-stop-796413 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:scheduled-stop-796413 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1123 08:50:03.950917 205575 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I1123 08:50:04.002535 205575 cni.go:84] Creating CNI manager for ""
I1123 08:50:04.002553 205575 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1123 08:50:04.002578 205575 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1123 08:50:04.002598 205575 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:scheduled-stop-796413 NodeName:scheduled-stop-796413 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1123 08:50:04.002731 205575 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "scheduled-stop-796413"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1123 08:50:04.002840 205575 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1123 08:50:04.014898 205575 binaries.go:51] Found k8s binaries, skipping transfer
I1123 08:50:04.014968 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1123 08:50:04.023330 205575 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (320 bytes)
I1123 08:50:04.037364 205575 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1123 08:50:04.051362 205575 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2222 bytes)
I1123 08:50:04.064895 205575 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1123 08:50:04.068423 205575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1123 08:50:04.078536 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:04.198107 205575 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1123 08:50:04.213838 205575 certs.go:69] Setting up /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413 for IP: 192.168.76.2
I1123 08:50:04.213849 205575 certs.go:195] generating shared ca certs ...
I1123 08:50:04.213863 205575 certs.go:227] acquiring lock for ca certs: {Name:mkb967cefa4168235b0943b8a057e4fc8b2f25ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.213999 205575 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21969-2348/.minikube/ca.key
I1123 08:50:04.214039 205575 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21969-2348/.minikube/proxy-client-ca.key
I1123 08:50:04.214045 205575 certs.go:257] generating profile certs ...
I1123 08:50:04.214096 205575 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.key
I1123 08:50:04.214106 205575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.crt with IP's: []
I1123 08:50:04.633344 205575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.crt ...
I1123 08:50:04.633361 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.crt: {Name:mk5ac02c2a8b06ffafd3280179291bd4a9f90081 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.633559 205575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.key ...
I1123 08:50:04.633566 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/client.key: {Name:mk1c0759c69b88e1b317462b6ab855b7a65c7fc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.633656 205575 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key.6f869704
I1123 08:50:04.633679 205575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt.6f869704 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I1123 08:50:04.807917 205575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt.6f869704 ...
I1123 08:50:04.807931 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt.6f869704: {Name:mk896157d53c8a2cf124e973038af7571f1a65a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.808118 205575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key.6f869704 ...
I1123 08:50:04.808126 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key.6f869704: {Name:mkfa6ab7db93da598baf480fc8f61fb69ffe2619 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.808203 205575 certs.go:382] copying /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt.6f869704 -> /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt
I1123 08:50:04.808313 205575 certs.go:386] copying /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key.6f869704 -> /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key
I1123 08:50:04.808364 205575 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.key
I1123 08:50:04.808375 205575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.crt with IP's: []
I1123 08:50:04.851211 205575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.crt ...
I1123 08:50:04.851228 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.crt: {Name:mk156b528b2e7ecab0ce133c274256c6b03f264c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.851443 205575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.key ...
I1123 08:50:04.851451 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.key: {Name:mk0e36b0695cc83e4af78cee034a7ffa5d2b57b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:04.851648 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/4159.pem (1338 bytes)
W1123 08:50:04.851690 205575 certs.go:480] ignoring /home/jenkins/minikube-integration/21969-2348/.minikube/certs/4159_empty.pem, impossibly tiny 0 bytes
I1123 08:50:04.851697 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca-key.pem (1675 bytes)
I1123 08:50:04.851723 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/ca.pem (1082 bytes)
I1123 08:50:04.851746 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/cert.pem (1123 bytes)
I1123 08:50:04.851769 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/certs/key.pem (1675 bytes)
I1123 08:50:04.851815 205575 certs.go:484] found cert: /home/jenkins/minikube-integration/21969-2348/.minikube/files/etc/ssl/certs/41592.pem (1708 bytes)
I1123 08:50:04.852439 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1123 08:50:04.869917 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1123 08:50:04.887933 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1123 08:50:04.907240 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1123 08:50:04.924792 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1123 08:50:04.942770 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1123 08:50:04.960174 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1123 08:50:04.977265 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/profiles/scheduled-stop-796413/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1123 08:50:04.994519 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/files/etc/ssl/certs/41592.pem --> /usr/share/ca-certificates/41592.pem (1708 bytes)
I1123 08:50:05.019484 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1123 08:50:05.041410 205575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21969-2348/.minikube/certs/4159.pem --> /usr/share/ca-certificates/4159.pem (1338 bytes)
I1123 08:50:05.062504 205575 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1123 08:50:05.076068 205575 ssh_runner.go:195] Run: openssl version
I1123 08:50:05.082361 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/41592.pem && ln -fs /usr/share/ca-certificates/41592.pem /etc/ssl/certs/41592.pem"
I1123 08:50:05.091350 205575 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/41592.pem
I1123 08:50:05.095275 205575 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 23 08:16 /usr/share/ca-certificates/41592.pem
I1123 08:50:05.095332 205575 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/41592.pem
I1123 08:50:05.136595 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/41592.pem /etc/ssl/certs/3ec20f2e.0"
I1123 08:50:05.145387 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1123 08:50:05.154080 205575 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1123 08:50:05.158129 205575 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 23 08:11 /usr/share/ca-certificates/minikubeCA.pem
I1123 08:50:05.158185 205575 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1123 08:50:05.199371 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1123 08:50:05.207534 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4159.pem && ln -fs /usr/share/ca-certificates/4159.pem /etc/ssl/certs/4159.pem"
I1123 08:50:05.215649 205575 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4159.pem
I1123 08:50:05.219266 205575 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 23 08:16 /usr/share/ca-certificates/4159.pem
I1123 08:50:05.219322 205575 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4159.pem
I1123 08:50:05.260088 205575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4159.pem /etc/ssl/certs/51391683.0"
I1123 08:50:05.268239 205575 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1123 08:50:05.271685 205575 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1123 08:50:05.271726 205575 kubeadm.go:401] StartCluster: {Name:scheduled-stop-796413 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1763789673-21948@sha256:bb10ebd3ca086eea12c038085866fb2f6cfa67385dcb830c4deb5e36ced6b53f Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:scheduled-stop-796413 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: S
SHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1123 08:50:05.271832 205575 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1123 08:50:05.287498 205575 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1123 08:50:05.295161 205575 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1123 08:50:05.302730 205575 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver
I1123 08:50:05.302797 205575 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1123 08:50:05.310388 205575 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1123 08:50:05.310404 205575 kubeadm.go:158] found existing configuration files:
I1123 08:50:05.310453 205575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1123 08:50:05.318494 205575 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1123 08:50:05.318549 205575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1123 08:50:05.325946 205575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1123 08:50:05.333717 205575 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1123 08:50:05.333770 205575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1123 08:50:05.340960 205575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1123 08:50:05.348721 205575 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1123 08:50:05.348797 205575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1123 08:50:05.356440 205575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1123 08:50:05.364121 205575 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1123 08:50:05.364186 205575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1123 08:50:05.371547 205575 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1123 08:50:05.409720 205575 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1
I1123 08:50:05.409769 205575 kubeadm.go:319] [preflight] Running pre-flight checks
I1123 08:50:05.437905 205575 kubeadm.go:319] [preflight] The system verification failed. Printing the output from the verification:
I1123 08:50:05.437975 205575 kubeadm.go:319] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1084-aws[0m
I1123 08:50:05.438008 205575 kubeadm.go:319] [0;37mOS[0m: [0;32mLinux[0m
I1123 08:50:05.438060 205575 kubeadm.go:319] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1123 08:50:05.438112 205575 kubeadm.go:319] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I1123 08:50:05.438161 205575 kubeadm.go:319] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1123 08:50:05.438208 205575 kubeadm.go:319] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1123 08:50:05.438255 205575 kubeadm.go:319] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1123 08:50:05.438301 205575 kubeadm.go:319] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1123 08:50:05.438351 205575 kubeadm.go:319] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1123 08:50:05.438398 205575 kubeadm.go:319] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1123 08:50:05.438448 205575 kubeadm.go:319] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I1123 08:50:05.505906 205575 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster
I1123 08:50:05.506023 205575 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1123 08:50:05.506121 205575 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1123 08:50:05.521700 205575 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1123 08:50:05.525369 205575 out.go:252] - Generating certificates and keys ...
I1123 08:50:05.525468 205575 kubeadm.go:319] [certs] Using existing ca certificate authority
I1123 08:50:05.525538 205575 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk
I1123 08:50:06.106201 205575 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key
I1123 08:50:06.757972 205575 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key
I1123 08:50:07.029365 205575 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key
I1123 08:50:07.326173 205575 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key
I1123 08:50:08.879559 205575 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key
I1123 08:50:08.879879 205575 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [localhost scheduled-stop-796413] and IPs [192.168.76.2 127.0.0.1 ::1]
I1123 08:50:10.000864 205575 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key
I1123 08:50:10.001127 205575 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [localhost scheduled-stop-796413] and IPs [192.168.76.2 127.0.0.1 ::1]
I1123 08:50:10.812405 205575 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key
I1123 08:50:11.222061 205575 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key
I1123 08:50:12.274534 205575 kubeadm.go:319] [certs] Generating "sa" key and public key
I1123 08:50:12.274791 205575 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1123 08:50:12.522413 205575 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file
I1123 08:50:13.151729 205575 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1123 08:50:14.086629 205575 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1123 08:50:14.404317 205575 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1123 08:50:14.605556 205575 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1123 08:50:14.606264 205575 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1123 08:50:14.609049 205575 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1123 08:50:14.612619 205575 out.go:252] - Booting up control plane ...
I1123 08:50:14.612725 205575 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1123 08:50:14.612801 205575 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1123 08:50:14.613151 205575 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1123 08:50:14.631688 205575 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1123 08:50:14.631789 205575 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1123 08:50:14.639249 205575 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1123 08:50:14.639602 205575 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1123 08:50:14.639835 205575 kubeadm.go:319] [kubelet-start] Starting the kubelet
I1123 08:50:14.777626 205575 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1123 08:50:14.777738 205575 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1123 08:50:15.779298 205575 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 1.001778226s
I1123 08:50:15.782801 205575 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1123 08:50:15.782888 205575 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.76.2:8443/livez
I1123 08:50:15.782996 205575 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1123 08:50:15.783074 205575 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1123 08:50:20.160189 205575 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 4.376847344s
I1123 08:50:21.793577 205575 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 6.010710186s
I1123 08:50:22.784526 205575 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 7.001572162s
I1123 08:50:22.804740 205575 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1123 08:50:22.822700 205575 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1123 08:50:22.845449 205575 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs
I1123 08:50:22.845647 205575 kubeadm.go:319] [mark-control-plane] Marking the node scheduled-stop-796413 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1123 08:50:22.859088 205575 kubeadm.go:319] [bootstrap-token] Using token: tgtupm.w6eory54jszl996b
I1123 08:50:22.862063 205575 out.go:252] - Configuring RBAC rules ...
I1123 08:50:22.862182 205575 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1123 08:50:22.869244 205575 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1123 08:50:22.881234 205575 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1123 08:50:22.887511 205575 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1123 08:50:22.895015 205575 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1123 08:50:22.901518 205575 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1123 08:50:23.192252 205575 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1123 08:50:23.626542 205575 kubeadm.go:319] [addons] Applied essential addon: CoreDNS
I1123 08:50:24.192130 205575 kubeadm.go:319] [addons] Applied essential addon: kube-proxy
I1123 08:50:24.193322 205575 kubeadm.go:319]
I1123 08:50:24.193388 205575 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!
I1123 08:50:24.193391 205575 kubeadm.go:319]
I1123 08:50:24.193574 205575 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:
I1123 08:50:24.193579 205575 kubeadm.go:319]
I1123 08:50:24.193602 205575 kubeadm.go:319] mkdir -p $HOME/.kube
I1123 08:50:24.193660 205575 kubeadm.go:319] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1123 08:50:24.193709 205575 kubeadm.go:319] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1123 08:50:24.193711 205575 kubeadm.go:319]
I1123 08:50:24.193764 205575 kubeadm.go:319] Alternatively, if you are the root user, you can run:
I1123 08:50:24.193767 205575 kubeadm.go:319]
I1123 08:50:24.193813 205575 kubeadm.go:319] export KUBECONFIG=/etc/kubernetes/admin.conf
I1123 08:50:24.193816 205575 kubeadm.go:319]
I1123 08:50:24.193866 205575 kubeadm.go:319] You should now deploy a pod network to the cluster.
I1123 08:50:24.193940 205575 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1123 08:50:24.194006 205575 kubeadm.go:319] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1123 08:50:24.194009 205575 kubeadm.go:319]
I1123 08:50:24.194092 205575 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities
I1123 08:50:24.194167 205575 kubeadm.go:319] and service account keys on each node and then running the following as root:
I1123 08:50:24.194170 205575 kubeadm.go:319]
I1123 08:50:24.194252 205575 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token tgtupm.w6eory54jszl996b \
I1123 08:50:24.194354 205575 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:541ba4e1634465eec56613ce58b24345248cbf921346f82d6eedc08dd4f425f7 \
I1123 08:50:24.194373 205575 kubeadm.go:319] --control-plane
I1123 08:50:24.194375 205575 kubeadm.go:319]
I1123 08:50:24.194459 205575 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:
I1123 08:50:24.194461 205575 kubeadm.go:319]
I1123 08:50:24.194541 205575 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token tgtupm.w6eory54jszl996b \
I1123 08:50:24.194642 205575 kubeadm.go:319] --discovery-token-ca-cert-hash sha256:541ba4e1634465eec56613ce58b24345248cbf921346f82d6eedc08dd4f425f7
I1123 08:50:24.198805 205575 kubeadm.go:319] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I1123 08:50:24.199040 205575 kubeadm.go:319] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1084-aws\n", err: exit status 1
I1123 08:50:24.199149 205575 kubeadm.go:319] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1123 08:50:24.199162 205575 cni.go:84] Creating CNI manager for ""
I1123 08:50:24.199175 205575 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1123 08:50:24.204119 205575 out.go:179] * Configuring bridge CNI (Container Networking Interface) ...
I1123 08:50:24.207029 205575 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I1123 08:50:24.214882 205575 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I1123 08:50:24.228464 205575 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1123 08:50:24.228591 205575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1123 08:50:24.228599 205575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes scheduled-stop-796413 minikube.k8s.io/updated_at=2025_11_23T08_50_24_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=50c3a8a3c03e8a84b6c978a884d21c3de8c6d4f1 minikube.k8s.io/name=scheduled-stop-796413 minikube.k8s.io/primary=true
I1123 08:50:24.247905 205575 ops.go:34] apiserver oom_adj: -16
I1123 08:50:24.363236 205575 kubeadm.go:1114] duration metric: took 134.715447ms to wait for elevateKubeSystemPrivileges
I1123 08:50:24.376317 205575 kubeadm.go:403] duration metric: took 19.104588377s to StartCluster
I1123 08:50:24.376349 205575 settings.go:142] acquiring lock: {Name:mkf03bfd2a7db4d4e96554c7c484a806ad551bc2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:24.376429 205575 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21969-2348/kubeconfig
I1123 08:50:24.377097 205575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21969-2348/kubeconfig: {Name:mkfad1c03e20fa85a44d6e3ee7902e4a382f5726 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1123 08:50:24.377335 205575 start.go:236] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I1123 08:50:24.377454 205575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1123 08:50:24.377815 205575 config.go:182] Loaded profile config "scheduled-stop-796413": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1
I1123 08:50:24.377781 205575 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1123 08:50:24.377849 205575 addons.go:70] Setting storage-provisioner=true in profile "scheduled-stop-796413"
I1123 08:50:24.377861 205575 addons.go:239] Setting addon storage-provisioner=true in "scheduled-stop-796413"
I1123 08:50:24.377867 205575 addons.go:70] Setting default-storageclass=true in profile "scheduled-stop-796413"
I1123 08:50:24.377878 205575 addons_storage_classes.go:34] enableOrDisableStorageClasses default-storageclass=true on "scheduled-stop-796413"
I1123 08:50:24.377882 205575 host.go:66] Checking if "scheduled-stop-796413" exists ...
I1123 08:50:24.378232 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:50:24.378422 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:50:24.382587 205575 out.go:179] * Verifying Kubernetes components...
I1123 08:50:24.388528 205575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1123 08:50:24.407169 205575 addons.go:239] Setting addon default-storageclass=true in "scheduled-stop-796413"
I1123 08:50:24.407196 205575 host.go:66] Checking if "scheduled-stop-796413" exists ...
I1123 08:50:24.407622 205575 cli_runner.go:164] Run: docker container inspect scheduled-stop-796413 --format={{.State.Status}}
I1123 08:50:24.437892 205575 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1123 08:50:24.440673 205575 addons.go:436] installing /etc/kubernetes/addons/storageclass.yaml
I1123 08:50:24.440702 205575 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1123 08:50:24.440769 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:24.444550 205575 addons.go:436] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1123 08:50:24.444562 205575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1123 08:50:24.444632 205575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" scheduled-stop-796413
I1123 08:50:24.463709 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:24.479300 205575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32968 SSHKeyPath:/home/jenkins/minikube-integration/21969-2348/.minikube/machines/scheduled-stop-796413/id_rsa Username:docker}
I1123 08:50:24.611598 205575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1123 08:50:24.697925 205575 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1123 08:50:24.825103 205575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1123 08:50:24.849203 205575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1123 08:50:25.101327 205575 start.go:977] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I1123 08:50:25.103110 205575 api_server.go:52] waiting for apiserver process to appear ...
I1123 08:50:25.103159 205575 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1123 08:50:25.370099 205575 api_server.go:72] duration metric: took 992.737807ms to wait for apiserver process to appear ...
I1123 08:50:25.370114 205575 api_server.go:88] waiting for apiserver healthz status ...
I1123 08:50:25.370143 205575 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1123 08:50:25.385955 205575 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1123 08:50:25.386843 205575 api_server.go:141] control plane version: v1.34.1
I1123 08:50:25.386858 205575 api_server.go:131] duration metric: took 16.7382ms to wait for apiserver health ...
I1123 08:50:25.386870 205575 system_pods.go:43] waiting for kube-system pods to appear ...
I1123 08:50:25.390263 205575 system_pods.go:59] 5 kube-system pods found
I1123 08:50:25.390285 205575 system_pods.go:61] "etcd-scheduled-stop-796413" [5f1537c0-10ad-4941-bfae-59c53a69be4f] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I1123 08:50:25.390293 205575 system_pods.go:61] "kube-apiserver-scheduled-stop-796413" [53bb5ad4-4bbf-441d-a590-ddf34b5e0d89] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I1123 08:50:25.390299 205575 system_pods.go:61] "kube-controller-manager-scheduled-stop-796413" [4c9d613a-e978-4dcf-a03f-366c7cb79758] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I1123 08:50:25.390305 205575 system_pods.go:61] "kube-scheduler-scheduled-stop-796413" [525b009c-9d35-491d-8906-d6838f301089] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I1123 08:50:25.390309 205575 system_pods.go:61] "storage-provisioner" [d205f714-6278-4f36-8211-e5acdee58e20] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
I1123 08:50:25.390314 205575 system_pods.go:74] duration metric: took 3.439741ms to wait for pod list to return data ...
I1123 08:50:25.390324 205575 kubeadm.go:587] duration metric: took 1.012969049s to wait for: map[apiserver:true system_pods:true]
I1123 08:50:25.390334 205575 node_conditions.go:102] verifying NodePressure condition ...
I1123 08:50:25.391082 205575 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
I1123 08:50:25.392856 205575 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I1123 08:50:25.392875 205575 node_conditions.go:123] node cpu capacity is 2
I1123 08:50:25.392886 205575 node_conditions.go:105] duration metric: took 2.548185ms to run NodePressure ...
I1123 08:50:25.392897 205575 start.go:242] waiting for startup goroutines ...
I1123 08:50:25.393931 205575 addons.go:530] duration metric: took 1.016147645s for enable addons: enabled=[storage-provisioner default-storageclass]
I1123 08:50:25.604688 205575 kapi.go:214] "coredns" deployment in "kube-system" namespace and "scheduled-stop-796413" context rescaled to 1 replicas
I1123 08:50:25.604717 205575 start.go:247] waiting for cluster config update ...
I1123 08:50:25.604737 205575 start.go:256] writing updated cluster config ...
I1123 08:50:25.605051 205575 ssh_runner.go:195] Run: rm -f paused
I1123 08:50:25.662154 205575 start.go:625] kubectl: 1.33.2, cluster: 1.34.1 (minor skew: 1)
I1123 08:50:25.665541 205575 out.go:179] * Done! kubectl is now configured to use "scheduled-stop-796413" cluster and "default" namespace by default
==> Docker <==
Nov 23 08:50:03 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:03.145602166Z" level=info msg="Daemon has completed initialization"
Nov 23 08:50:03 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:03.145784468Z" level=info msg="API listen on /var/run/docker.sock"
Nov 23 08:50:03 scheduled-stop-796413 systemd[1]: Started docker.service - Docker Application Container Engine.
Nov 23 08:50:03 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:03.147788396Z" level=info msg="API listen on /run/docker.sock"
Nov 23 08:50:03 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:03.147895613Z" level=info msg="API listen on [::]:2376"
Nov 23 08:50:03 scheduled-stop-796413 systemd[1]: Starting cri-docker.service - CRI Interface for Docker Application Container Engine...
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Starting cri-dockerd dev (HEAD)"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Connecting to docker on the Endpoint unix:///var/run/docker.sock"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Start docker client with request timeout 0s"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Hairpin mode is set to hairpin-veth"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Loaded network plugin cni"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Docker cri networking managed by network plugin cni"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Setting cgroupDriver cgroupfs"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:,},}"
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Starting the GRPC backend for the Docker CRI interface."
Nov 23 08:50:03 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:03Z" level=info msg="Start cri-dockerd grpc backend"
Nov 23 08:50:03 scheduled-stop-796413 systemd[1]: Started cri-docker.service - CRI Interface for Docker Application Container Engine.
Nov 23 08:50:16 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:16.387741898Z" level=info msg="sbJoin: gwep4 ''->'', gwep6 ''->''" eid=bc91ecab2095 ep=k8s_POD_kube-scheduler-scheduled-stop-796413_kube-system_946054c2d8965adb8b224cb69b534e22_0 net=host nid=69a4c6c2bb54
Nov 23 08:50:16 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:16.389904203Z" level=info msg="sbJoin: gwep4 ''->'', gwep6 ''->''" eid=e9176497c03f ep=k8s_POD_kube-controller-manager-scheduled-stop-796413_kube-system_82d5b8b31c5acd7f4dfe37a1a3c32eec_0 net=host nid=69a4c6c2bb54
Nov 23 08:50:16 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:16.408242750Z" level=info msg="sbJoin: gwep4 ''->'', gwep6 ''->''" eid=2605e13f204a ep=k8s_POD_kube-apiserver-scheduled-stop-796413_kube-system_40ae97d8160aa07683eec87faf1edaec_0 net=host nid=69a4c6c2bb54
Nov 23 08:50:16 scheduled-stop-796413 dockerd[1138]: time="2025-11-23T08:50:16.430680611Z" level=info msg="sbJoin: gwep4 ''->'', gwep6 ''->''" eid=19140efdc893 ep=k8s_POD_etcd-scheduled-stop-796413_kube-system_bfdff81fb38173300de0910fff3f9bbd_0 net=host nid=69a4c6c2bb54
Nov 23 08:50:16 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:16Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/1ae9600d12054bfcabca840674edeccfe602c86f5e6cc19de35a9ebaa09cf17a/resolv.conf as [nameserver 192.168.76.1 search us-east-2.compute.internal options edns0 trust-ad ndots:0]"
Nov 23 08:50:16 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:16Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/c702cbf0f18687d03e4af964f51a217c94ba8fb0441dab0b6c25c56c9c086a66/resolv.conf as [nameserver 192.168.76.1 search us-east-2.compute.internal options edns0 trust-ad ndots:0]"
Nov 23 08:50:16 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:16Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/0b0ba199aa02590affc94caa52db073cf2692c1468029ca5ad57fbbc02861e8a/resolv.conf as [nameserver 192.168.76.1 search us-east-2.compute.internal options edns0 trust-ad ndots:0]"
Nov 23 08:50:16 scheduled-stop-796413 cri-dockerd[1420]: time="2025-11-23T08:50:16Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/db0b31267851c6abc9ed1a177b3cbbf502d9ef0807ce5d11de677e2c28c25e51/resolv.conf as [nameserver 192.168.76.1 search us-east-2.compute.internal options edns0 trust-ad ndots:0]"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
e694ab7077984 a1894772a478e 11 seconds ago Running etcd 0 db0b31267851c etcd-scheduled-stop-796413 kube-system
cd9d660621916 7eb2c6ff0c5a7 11 seconds ago Running kube-controller-manager 0 0b0ba199aa025 kube-controller-manager-scheduled-stop-796413 kube-system
6e34c3ae88f48 43911e833d64d 11 seconds ago Running kube-apiserver 0 c702cbf0f1868 kube-apiserver-scheduled-stop-796413 kube-system
b6b9b78883664 b5f57ec6b9867 11 seconds ago Running kube-scheduler 0 1ae9600d12054 kube-scheduler-scheduled-stop-796413 kube-system
==> describe nodes <==
Name: scheduled-stop-796413
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=scheduled-stop-796413
kubernetes.io/os=linux
minikube.k8s.io/commit=50c3a8a3c03e8a84b6c978a884d21c3de8c6d4f1
minikube.k8s.io/name=scheduled-stop-796413
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_23T08_50_24_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 23 Nov 2025 08:50:20 +0000
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: scheduled-stop-796413
AcquireTime: <unset>
RenewTime: Sun, 23 Nov 2025 08:50:23 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 23 Nov 2025 08:50:23 +0000 Sun, 23 Nov 2025 08:50:17 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 23 Nov 2025 08:50:23 +0000 Sun, 23 Nov 2025 08:50:17 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 23 Nov 2025 08:50:23 +0000 Sun, 23 Nov 2025 08:50:17 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sun, 23 Nov 2025 08:50:23 +0000 Sun, 23 Nov 2025 08:50:17 +0000 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
Addresses:
InternalIP: 192.168.76.2
Hostname: scheduled-stop-796413
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: 7283ea1857f18f20a875c29069214c9d
System UUID: 72059934-e9c3-415e-bc5e-96db4414598c
Boot ID: f0c9765c-5929-456c-9b86-232a1f85b638
Kernel Version: 5.15.0-1084-aws
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://29.0.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
Non-terminated Pods: (4 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system etcd-scheduled-stop-796413 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 4s
kube-system kube-apiserver-scheduled-stop-796413 250m (12%) 0 (0%) 0 (0%) 0 (0%) 4s
kube-system kube-controller-manager-scheduled-stop-796413 200m (10%) 0 (0%) 0 (0%) 0 (0%) 4s
kube-system kube-scheduler-scheduled-stop-796413 100m (5%) 0 (0%) 0 (0%) 0 (0%) 4s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 650m (32%) 0 (0%)
memory 100Mi (1%) 0 (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4s kubelet Starting kubelet.
Warning CgroupV1 4s kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeAllocatableEnforced 4s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 4s kubelet Node scheduled-stop-796413 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4s kubelet Node scheduled-stop-796413 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4s kubelet Node scheduled-stop-796413 status is now: NodeHasSufficientPID
==> dmesg <==
[Nov23 07:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014894] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.530205] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.034171] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +0.728769] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.354006] kauditd_printk_skb: 36 callbacks suppressed
[Nov23 08:24] hrtimer: interrupt took 16658818 ns
==> etcd [e694ab707798] <==
{"level":"warn","ts":"2025-11-23T08:50:19.064796Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54528","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.111815Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54566","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.116903Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54550","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.127614Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54582","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.142487Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54592","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.161783Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54606","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.185363Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54628","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.216355Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54650","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.240388Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54670","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.263649Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54688","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.295494Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54708","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.321472Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54724","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.346714Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54734","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.375840Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54748","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.403313Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54752","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.432150Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54772","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.470230Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54788","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.484747Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54812","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.522885Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54820","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.553642Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54838","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.574742Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54864","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.599555Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54882","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.675715Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54912","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.726430Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54948","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-11-23T08:50:19.882110Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54968","server-name":"","error":"EOF"}
==> kernel <==
08:50:27 up 1:32, 0 user, load average: 1.87, 2.08, 2.49
Linux scheduled-stop-796413 5.15.0-1084-aws #91~20.04.1-Ubuntu SMP Fri May 2 07:00:04 UTC 2025 aarch64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kube-apiserver [6e34c3ae88f4] <==
I1123 08:50:20.995025 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
I1123 08:50:20.995555 1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
I1123 08:50:20.995779 1 aggregator.go:171] initial CRD sync complete...
I1123 08:50:20.997289 1 autoregister_controller.go:144] Starting autoregister controller
I1123 08:50:20.997442 1 cache.go:32] Waiting for caches to sync for autoregister controller
I1123 08:50:20.997530 1 cache.go:39] Caches are synced for autoregister controller
I1123 08:50:21.009213 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io
I1123 08:50:21.027607 1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
I1123 08:50:21.058220 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12
I1123 08:50:21.069904 1 default_servicecidr_controller.go:228] Setting default ServiceCIDR condition Ready to True
I1123 08:50:21.080820 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1123 08:50:21.083897 1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
I1123 08:50:21.687726 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I1123 08:50:21.696755 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I1123 08:50:21.696989 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1123 08:50:22.528233 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1123 08:50:22.581462 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1123 08:50:22.697326 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1123 08:50:22.708032 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I1123 08:50:22.709443 1 controller.go:667] quota admission added evaluator for: endpoints
I1123 08:50:22.714791 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1123 08:50:22.826386 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1123 08:50:23.600754 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1123 08:50:23.625184 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1123 08:50:23.634777 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
==> kube-controller-manager [cd9d66062191] <==
I1123 08:50:26.530451 1 resource_quota_monitor.go:227] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io"
I1123 08:50:26.530471 1 controllermanager.go:781] "Started controller" controller="resourcequota-controller"
I1123 08:50:26.530749 1 resource_quota_controller.go:300] "Starting resource quota controller" logger="resourcequota-controller"
I1123 08:50:26.530760 1 shared_informer.go:349] "Waiting for caches to sync" controller="resource quota"
I1123 08:50:26.530776 1 resource_quota_monitor.go:308] "QuotaMonitor running" logger="resourcequota-controller"
I1123 08:50:26.718499 1 controllermanager.go:781] "Started controller" controller="disruption-controller"
I1123 08:50:26.718532 1 disruption.go:457] "Sending events to api server." logger="disruption-controller"
I1123 08:50:26.718576 1 disruption.go:468] "Starting disruption controller" logger="disruption-controller"
I1123 08:50:26.718584 1 shared_informer.go:349] "Waiting for caches to sync" controller="disruption"
I1123 08:50:26.768281 1 controllermanager.go:781] "Started controller" controller="certificatesigningrequest-cleaner-controller"
I1123 08:50:26.768309 1 controllermanager.go:739] "Skipping a cloud provider controller" controller="cloud-node-lifecycle-controller"
I1123 08:50:26.768351 1 cleaner.go:83] "Starting CSR cleaner controller" logger="certificatesigningrequest-cleaner-controller"
I1123 08:50:26.919922 1 controllermanager.go:781] "Started controller" controller="volumeattributesclass-protection-controller"
I1123 08:50:26.920052 1 vac_protection_controller.go:206] "Starting VAC protection controller" logger="volumeattributesclass-protection-controller"
I1123 08:50:26.920070 1 shared_informer.go:349] "Waiting for caches to sync" controller="VAC protection"
I1123 08:50:27.118356 1 controllermanager.go:781] "Started controller" controller="validatingadmissionpolicy-status-controller"
I1123 08:50:27.118389 1 controllermanager.go:759] "Warning: skipping controller" controller="storage-version-migrator-controller"
I1123 08:50:27.118447 1 shared_informer.go:349] "Waiting for caches to sync" controller="validatingadmissionpolicy-status"
I1123 08:50:27.270246 1 controllermanager.go:781] "Started controller" controller="statefulset-controller"
I1123 08:50:27.270271 1 controllermanager.go:733] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"]
I1123 08:50:27.270367 1 stateful_set.go:169] "Starting stateful set controller" logger="statefulset-controller"
I1123 08:50:27.270379 1 shared_informer.go:349] "Waiting for caches to sync" controller="stateful set"
I1123 08:50:27.420470 1 controllermanager.go:781] "Started controller" controller="ttl-controller"
I1123 08:50:27.420616 1 ttl_controller.go:127] "Starting TTL controller" logger="ttl-controller"
I1123 08:50:27.420631 1 shared_informer.go:349] "Waiting for caches to sync" controller="TTL"
==> kube-scheduler [b6b9b7888366] <==
I1123 08:50:21.773895 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1123 08:50:21.777097 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1123 08:50:21.778145 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E1123 08:50:21.793918 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
I1123 08:50:21.778232 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1123 08:50:21.797586 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
E1123 08:50:21.797974 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1123 08:50:21.798456 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1123 08:50:21.798769 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1123 08:50:21.799157 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1123 08:50:21.799233 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1123 08:50:21.800858 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1123 08:50:21.801095 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1123 08:50:21.801341 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1123 08:50:21.801552 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1123 08:50:21.801743 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1123 08:50:21.802189 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_arm64.s:1223" type="*v1.ConfigMap"
E1123 08:50:21.802802 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1123 08:50:21.807818 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1123 08:50:21.807857 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1123 08:50:21.807977 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1123 08:50:21.808039 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1123 08:50:21.808075 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1123 08:50:21.808112 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
I1123 08:50:22.899637 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.860348 2271 kubelet_node_status.go:124] "Node was previously registered" node="scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.860464 2271 kubelet_node_status.go:78] "Successfully registered node" node="scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876653 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-ca-certs\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876712 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-flexvolume-dir\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876738 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-kubeconfig\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876758 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/40ae97d8160aa07683eec87faf1edaec-ca-certs\") pod \"kube-apiserver-scheduled-stop-796413\" (UID: \"40ae97d8160aa07683eec87faf1edaec\") " pod="kube-system/kube-apiserver-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876777 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/40ae97d8160aa07683eec87faf1edaec-k8s-certs\") pod \"kube-apiserver-scheduled-stop-796413\" (UID: \"40ae97d8160aa07683eec87faf1edaec\") " pod="kube-system/kube-apiserver-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876799 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-usr-local-share-ca-certificates\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876819 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/bfdff81fb38173300de0910fff3f9bbd-etcd-certs\") pod \"etcd-scheduled-stop-796413\" (UID: \"bfdff81fb38173300de0910fff3f9bbd\") " pod="kube-system/etcd-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876837 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/bfdff81fb38173300de0910fff3f9bbd-etcd-data\") pod \"etcd-scheduled-stop-796413\" (UID: \"bfdff81fb38173300de0910fff3f9bbd\") " pod="kube-system/etcd-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876859 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/40ae97d8160aa07683eec87faf1edaec-usr-local-share-ca-certificates\") pod \"kube-apiserver-scheduled-stop-796413\" (UID: \"40ae97d8160aa07683eec87faf1edaec\") " pod="kube-system/kube-apiserver-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876883 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-k8s-certs\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876906 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-usr-share-ca-certificates\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876931 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/40ae97d8160aa07683eec87faf1edaec-etc-ca-certificates\") pod \"kube-apiserver-scheduled-stop-796413\" (UID: \"40ae97d8160aa07683eec87faf1edaec\") " pod="kube-system/kube-apiserver-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876958 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/40ae97d8160aa07683eec87faf1edaec-usr-share-ca-certificates\") pod \"kube-apiserver-scheduled-stop-796413\" (UID: \"40ae97d8160aa07683eec87faf1edaec\") " pod="kube-system/kube-apiserver-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876977 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/82d5b8b31c5acd7f4dfe37a1a3c32eec-etc-ca-certificates\") pod \"kube-controller-manager-scheduled-stop-796413\" (UID: \"82d5b8b31c5acd7f4dfe37a1a3c32eec\") " pod="kube-system/kube-controller-manager-scheduled-stop-796413"
Nov 23 08:50:23 scheduled-stop-796413 kubelet[2271]: I1123 08:50:23.876994 2271 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/946054c2d8965adb8b224cb69b534e22-kubeconfig\") pod \"kube-scheduler-scheduled-stop-796413\" (UID: \"946054c2d8965adb8b224cb69b534e22\") " pod="kube-system/kube-scheduler-scheduled-stop-796413"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.528633 2271 apiserver.go:52] "Watching apiserver"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.570128 2271 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.730536 2271 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/etcd-scheduled-stop-796413"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.734692 2271 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-scheduled-stop-796413" podStartSLOduration=1.734672402 podStartE2EDuration="1.734672402s" podCreationTimestamp="2025-11-23 08:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-23 08:50:24.734420438 +0000 UTC m=+1.294405552" watchObservedRunningTime="2025-11-23 08:50:24.734672402 +0000 UTC m=+1.294657508"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.745906 2271 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-scheduled-stop-796413" podStartSLOduration=1.745885061 podStartE2EDuration="1.745885061s" podCreationTimestamp="2025-11-23 08:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-23 08:50:24.718294991 +0000 UTC m=+1.278280105" watchObservedRunningTime="2025-11-23 08:50:24.745885061 +0000 UTC m=+1.305870166"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: E1123 08:50:24.753469 2271 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"etcd-scheduled-stop-796413\" already exists" pod="kube-system/etcd-scheduled-stop-796413"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.769932 2271 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/etcd-scheduled-stop-796413" podStartSLOduration=1.769910375 podStartE2EDuration="1.769910375s" podCreationTimestamp="2025-11-23 08:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-23 08:50:24.748965834 +0000 UTC m=+1.308950957" watchObservedRunningTime="2025-11-23 08:50:24.769910375 +0000 UTC m=+1.329895497"
Nov 23 08:50:24 scheduled-stop-796413 kubelet[2271]: I1123 08:50:24.788056 2271 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-scheduled-stop-796413" podStartSLOduration=1.788037527 podStartE2EDuration="1.788037527s" podCreationTimestamp="2025-11-23 08:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-23 08:50:24.770343254 +0000 UTC m=+1.330328368" watchObservedRunningTime="2025-11-23 08:50:24.788037527 +0000 UTC m=+1.348022649"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p scheduled-stop-796413 -n scheduled-stop-796413
helpers_test.go:269: (dbg) Run: kubectl --context scheduled-stop-796413 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: storage-provisioner
helpers_test.go:282: ======> post-mortem[TestScheduledStopUnix]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context scheduled-stop-796413 describe pod storage-provisioner
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context scheduled-stop-796413 describe pod storage-provisioner: exit status 1 (102.68659ms)
** stderr **
Error from server (NotFound): pods "storage-provisioner" not found
** /stderr **
helpers_test.go:287: kubectl --context scheduled-stop-796413 describe pod storage-provisioner: exit status 1
helpers_test.go:175: Cleaning up "scheduled-stop-796413" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-arm64 delete -p scheduled-stop-796413
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-796413: (2.30959657s)
--- FAIL: TestScheduledStopUnix (40.57s)