=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:229: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220629182321-10138 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker --container-runtime=docker
E0629 18:23:23.097467 10138 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/functional-20220629175922-10138/client.crt: no such file or directory
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:229: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220629182321-10138 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker --container-runtime=docker: (57.085469448s)
version_upgrade_test.go:234: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220629182321-10138
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220629182321-10138: (10.817803475s)
version_upgrade_test.go:239: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-20220629182321-10138 status --format={{.Host}}
version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20220629182321-10138 status --format={{.Host}}: exit status 7 (116.306155ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:241: status error: exit status 7 (may be ok)
version_upgrade_test.go:250: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220629182321-10138 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker --container-runtime=docker
version_upgrade_test.go:250: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220629182321-10138 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker --container-runtime=docker: exit status 90 (6.548435887s)
-- stdout --
* [kubernetes-upgrade-20220629182321-10138] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=14420
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
* Using the docker driver based on existing profile
* Starting control plane node kubernetes-upgrade-20220629182321-10138 in cluster kubernetes-upgrade-20220629182321-10138
* Pulling base image ...
* Restarting existing docker container for "kubernetes-upgrade-20220629182321-10138" ...
-- /stdout --
** stderr **
I0629 18:24:30.105639 229299 out.go:296] Setting OutFile to fd 1 ...
I0629 18:24:30.105787 229299 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 18:24:30.105799 229299 out.go:309] Setting ErrFile to fd 2...
I0629 18:24:30.105806 229299 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 18:24:30.106313 229299 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/bin
I0629 18:24:30.106607 229299 out.go:303] Setting JSON to false
I0629 18:24:30.108557 229299 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":4021,"bootTime":1656523049,"procs":1027,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-1033-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0629 18:24:30.108623 229299 start.go:125] virtualization: kvm guest
I0629 18:24:30.111334 229299 out.go:177] * [kubernetes-upgrade-20220629182321-10138] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
I0629 18:24:30.113094 229299 notify.go:193] Checking for updates...
I0629 18:24:30.113101 229299 out.go:177] - MINIKUBE_LOCATION=14420
I0629 18:24:30.114762 229299 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0629 18:24:30.116241 229299 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
I0629 18:24:30.117835 229299 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube
I0629 18:24:30.119507 229299 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0629 18:24:30.121377 229299 config.go:178] Loaded profile config "kubernetes-upgrade-20220629182321-10138": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0629 18:24:30.121818 229299 driver.go:360] Setting default libvirt URI to qemu:///system
I0629 18:24:30.167625 229299 docker.go:137] docker version: linux-20.10.17
I0629 18:24:30.167761 229299 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 18:24:30.282681 229299 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:true NGoroutines:77 SystemTime:2022-06-29 18:24:30.19709314 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1033-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662787584 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-5 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 18:24:30.282781 229299 docker.go:254] overlay module found
I0629 18:24:30.284962 229299 out.go:177] * Using the docker driver based on existing profile
I0629 18:24:30.286478 229299 start.go:284] selected driver: docker
I0629 18:24:30.286498 229299 start.go:808] validating driver "docker" against &{Name:kubernetes-upgrade-20220629182321-10138 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-20220629182321-
10138 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 18:24:30.286626 229299 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0629 18:24:30.308905 229299 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 18:24:30.437524 229299 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:true NGoroutines:63 SystemTime:2022-06-29 18:24:30.344111913 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1033-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662787584 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-5 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 18:24:30.437812 229299 cni.go:95] Creating CNI manager for ""
I0629 18:24:30.437830 229299 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0629 18:24:30.437839 229299 start_flags.go:310] config:
{Name:kubernetes-upgrade-20220629182321-10138 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:kubernetes-upgrade-20220629182321-10138 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:
[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 18:24:30.440978 229299 out.go:177] * Starting control plane node kubernetes-upgrade-20220629182321-10138 in cluster kubernetes-upgrade-20220629182321-10138
I0629 18:24:30.442586 229299 cache.go:120] Beginning downloading kic base image for docker with docker
I0629 18:24:30.444038 229299 out.go:177] * Pulling base image ...
I0629 18:24:30.445516 229299 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime docker
I0629 18:24:30.445566 229299 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-docker-overlay2-amd64.tar.lz4
I0629 18:24:30.445580 229299 cache.go:57] Caching tarball of preloaded images
I0629 18:24:30.445611 229299 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
I0629 18:24:30.445857 229299 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0629 18:24:30.445880 229299 cache.go:60] Finished verifying existence of preloaded tar for v1.24.2 on docker
I0629 18:24:30.446046 229299 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/kubernetes-upgrade-20220629182321-10138/config.json ...
I0629 18:24:30.483609 229299 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
I0629 18:24:30.483655 229299 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
I0629 18:24:30.483675 229299 cache.go:208] Successfully downloaded all kic artifacts
I0629 18:24:30.483728 229299 start.go:352] acquiring machines lock for kubernetes-upgrade-20220629182321-10138: {Name:mk61978f37284f305a62428486c945e853cc5463 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0629 18:24:30.483835 229299 start.go:356] acquired machines lock for "kubernetes-upgrade-20220629182321-10138" in 77.665µs
I0629 18:24:30.483859 229299 start.go:94] Skipping create...Using existing machine configuration
I0629 18:24:30.483869 229299 fix.go:55] fixHost starting:
I0629 18:24:30.484104 229299 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220629182321-10138 --format={{.State.Status}}
I0629 18:24:30.525882 229299 fix.go:103] recreateIfNeeded on kubernetes-upgrade-20220629182321-10138: state=Stopped err=<nil>
W0629 18:24:30.525922 229299 fix.go:129] unexpected machine state, will restart: <nil>
I0629 18:24:30.528563 229299 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-20220629182321-10138" ...
I0629 18:24:30.530082 229299 cli_runner.go:164] Run: docker start kubernetes-upgrade-20220629182321-10138
I0629 18:24:31.018344 229299 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220629182321-10138 --format={{.State.Status}}
I0629 18:24:31.058163 229299 kic.go:416] container "kubernetes-upgrade-20220629182321-10138" state is running.
I0629 18:24:31.058633 229299 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220629182321-10138
I0629 18:24:31.094384 229299 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/kubernetes-upgrade-20220629182321-10138/config.json ...
I0629 18:24:31.094581 229299 machine.go:88] provisioning docker machine ...
I0629 18:24:31.094603 229299 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20220629182321-10138"
I0629 18:24:31.094644 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:31.131017 229299 main.go:134] libmachine: Using SSH client type: native
I0629 18:24:31.131194 229299 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 127.0.0.1 49356 <nil> <nil>}
I0629 18:24:31.131249 229299 main.go:134] libmachine: About to run SSH command:
sudo hostname kubernetes-upgrade-20220629182321-10138 && echo "kubernetes-upgrade-20220629182321-10138" | sudo tee /etc/hostname
I0629 18:24:31.131854 229299 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55236->127.0.0.1:49356: read: connection reset by peer
I0629 18:24:34.264299 229299 main.go:134] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20220629182321-10138
I0629 18:24:34.264378 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:34.307092 229299 main.go:134] libmachine: Using SSH client type: native
I0629 18:24:34.307328 229299 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 127.0.0.1 49356 <nil> <nil>}
I0629 18:24:34.307364 229299 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\skubernetes-upgrade-20220629182321-10138' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20220629182321-10138/g' /etc/hosts;
else
echo '127.0.1.1 kubernetes-upgrade-20220629182321-10138' | sudo tee -a /etc/hosts;
fi
fi
I0629 18:24:34.431612 229299 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0629 18:24:34.431648 229299 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/key.pem ServerCertR
emotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube}
I0629 18:24:34.431674 229299 ubuntu.go:177] setting up certificates
I0629 18:24:34.431684 229299 provision.go:83] configureAuth start
I0629 18:24:34.431742 229299 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220629182321-10138
I0629 18:24:34.476806 229299 provision.go:138] copyHostCerts
I0629 18:24:34.476899 229299 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem, removing ...
I0629 18:24:34.476921 229299 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem
I0629 18:24:34.476998 229299 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem (1082 bytes)
I0629 18:24:34.477116 229299 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem, removing ...
I0629 18:24:34.477133 229299 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem
I0629 18:24:34.477175 229299 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem (1123 bytes)
I0629 18:24:34.477255 229299 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem, removing ...
I0629 18:24:34.477272 229299 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem
I0629 18:24:34.477308 229299 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem (1679 bytes)
I0629 18:24:34.477389 229299 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-20220629182321-10138 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-20220629182321-10138]
I0629 18:24:34.856386 229299 provision.go:172] copyRemoteCerts
I0629 18:24:34.856454 229299 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0629 18:24:34.856503 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:34.895185 229299 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49356 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/kubernetes-upgrade-20220629182321-10138/id_rsa Username:docker}
I0629 18:24:34.984501 229299 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0629 18:24:35.007152 229299 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem --> /etc/docker/server.pem (1289 bytes)
I0629 18:24:35.024896 229299 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0629 18:24:35.042247 229299 provision.go:86] duration metric: configureAuth took 610.544462ms
I0629 18:24:35.042277 229299 ubuntu.go:193] setting minikube options for container-runtime
I0629 18:24:35.042432 229299 config.go:178] Loaded profile config "kubernetes-upgrade-20220629182321-10138": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0629 18:24:35.042477 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.084180 229299 main.go:134] libmachine: Using SSH client type: native
I0629 18:24:35.084353 229299 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 127.0.0.1 49356 <nil> <nil>}
I0629 18:24:35.084372 229299 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0629 18:24:35.204006 229299 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0629 18:24:35.204032 229299 ubuntu.go:71] root file system type: overlay
I0629 18:24:35.204189 229299 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0629 18:24:35.204236 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.239060 229299 main.go:134] libmachine: Using SSH client type: native
I0629 18:24:35.239258 229299 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 127.0.0.1 49356 <nil> <nil>}
I0629 18:24:35.239366 229299 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0629 18:24:35.371144 229299 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0629 18:24:35.371247 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.409382 229299 main.go:134] libmachine: Using SSH client type: native
I0629 18:24:35.409557 229299 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 127.0.0.1 49356 <nil> <nil>}
I0629 18:24:35.409590 229299 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0629 18:24:35.534765 229299 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0629 18:24:35.534803 229299 machine.go:91] provisioned docker machine in 4.440205833s
I0629 18:24:35.534817 229299 start.go:306] post-start starting for "kubernetes-upgrade-20220629182321-10138" (driver="docker")
I0629 18:24:35.534827 229299 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0629 18:24:35.534892 229299 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0629 18:24:35.534950 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.583314 229299 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49356 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/kubernetes-upgrade-20220629182321-10138/id_rsa Username:docker}
I0629 18:24:35.676284 229299 ssh_runner.go:195] Run: cat /etc/os-release
I0629 18:24:35.679114 229299 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0629 18:24:35.679149 229299 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0629 18:24:35.679162 229299 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0629 18:24:35.679170 229299 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0629 18:24:35.679181 229299 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/addons for local assets ...
I0629 18:24:35.679278 229299 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files for local assets ...
I0629 18:24:35.679360 229299 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/101382.pem -> 101382.pem in /etc/ssl/certs
I0629 18:24:35.679455 229299 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0629 18:24:35.688291 229299 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/101382.pem --> /etc/ssl/certs/101382.pem (1708 bytes)
I0629 18:24:35.707259 229299 start.go:309] post-start completed in 172.426558ms
I0629 18:24:35.707330 229299 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0629 18:24:35.707383 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.740576 229299 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49356 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/kubernetes-upgrade-20220629182321-10138/id_rsa Username:docker}
I0629 18:24:35.823386 229299 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0629 18:24:35.827050 229299 fix.go:57] fixHost completed within 5.343176817s
I0629 18:24:35.827075 229299 start.go:81] releasing machines lock for "kubernetes-upgrade-20220629182321-10138", held for 5.343227014s
I0629 18:24:35.827162 229299 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.873005 229299 ssh_runner.go:195] Run: systemctl --version
I0629 18:24:35.873076 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.873094 229299 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0629 18:24:35.873166 229299 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220629182321-10138
I0629 18:24:35.917203 229299 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49356 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/kubernetes-upgrade-20220629182321-10138/id_rsa Username:docker}
I0629 18:24:35.917603 229299 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49356 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/kubernetes-upgrade-20220629182321-10138/id_rsa Username:docker}
I0629 18:24:36.148623 229299 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0629 18:24:36.162009 229299 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0629 18:24:36.162080 229299 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0629 18:24:36.175827 229299 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0629 18:24:36.190663 229299 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0629 18:24:36.275859 229299 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0629 18:24:36.362216 229299 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0629 18:24:36.453404 229299 ssh_runner.go:195] Run: sudo systemctl restart docker
I0629 18:24:36.533267 229299 out.go:177]
W0629 18:24:36.534717 229299 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
W0629 18:24:36.534733 229299 out.go:239] *
*
W0629 18:24:36.535494 229299 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0629 18:24:36.537146 229299 out.go:177]
** /stderr **
version_upgrade_test.go:252: failed to upgrade with newest k8s version. args: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220629182321-10138 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker --container-runtime=docker : exit status 90
version_upgrade_test.go:255: (dbg) Run: kubectl --context kubernetes-upgrade-20220629182321-10138 version --output=json
version_upgrade_test.go:255: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-20220629182321-10138 version --output=json: exit status 1 (48.939402ms)
** stderr **
error: context "kubernetes-upgrade-20220629182321-10138" does not exist
** /stderr **
version_upgrade_test.go:257: error running kubectl: exit status 1
panic.go:482: *** TestKubernetesUpgrade FAILED at 2022-06-29 18:24:36.594641175 +0000 UTC m=+1874.601899574
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestKubernetesUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect kubernetes-upgrade-20220629182321-10138
helpers_test.go:235: (dbg) docker inspect kubernetes-upgrade-20220629182321-10138:
-- stdout --
[
{
"Id": "5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b",
"Created": "2022-06-29T18:23:31.354263333Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 229915,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-06-29T18:24:31.010055408Z",
"FinishedAt": "2022-06-29T18:24:29.591123724Z"
},
"Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
"ResolvConfPath": "/var/lib/docker/containers/5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b/hostname",
"HostsPath": "/var/lib/docker/containers/5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b/hosts",
"LogPath": "/var/lib/docker/containers/5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b/5e5564a07c020cb0be7f22f2271e8a6847fa4b5aa140e551fdfd2ac25732a06b-json.log",
"Name": "/kubernetes-upgrade-20220629182321-10138",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"kubernetes-upgrade-20220629182321-10138:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "kubernetes-upgrade-20220629182321-10138",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/155ff2bed89e76402b85c5e4ca84fb206024160420592ed6d785250907f1e65b-init/diff:/var/lib/docker/overlay2/37c3363cdb4e395fa4294c98c1b085432deaf141b32212293b8c7ab219096318/diff:/var/lib/docker/overlay2/4963be297c8a8b5b0904722e77decb2b26a26db7a76686a3e049e6926058ab53/diff:/var/lib/docker/overlay2/9f36dc166a2c0aa34b7b48377060f3903051f37b256b247bd9df131f0f46e979/diff:/var/lib/docker/overlay2/785aa409f129db550b879ad13b9a372bf1b0e76e127ad4bec7b0123a5511b758/diff:/var/lib/docker/overlay2/16f0d68a1bb077837b2552bb34c59c67dc1e12c9b1119ed2252d0528489507fc/diff:/var/lib/docker/overlay2/7ad5636db9b2db58863ffbf07b8213f95b2af7c196925b9050184928c789a276/diff:/var/lib/docker/overlay2/0ba3e8e6df2f2c9b0419030f977dffcaf2a9a32c9b123b777e8bfefd2f639d2f/diff:/var/lib/docker/overlay2/56011d37a8b87149f22dad5dbd6cfd5c8f051099793f0f68e8a6ae98fd189b16/diff:/var/lib/docker/overlay2/eb35419f9e8f0676723e6c99b6aafe1a61d3e3e27dd3cea01ad028a683190c23/diff:/var/lib/docker/overlay2/891096
f597290e105c440c52e72647d2084696bf7e890b9c94f61b54138d287a/diff:/var/lib/docker/overlay2/a9e2392c327bf2adeb6011549290471660c616057b464de6664dc3331b9f2e59/diff:/var/lib/docker/overlay2/6986f070a4e67900cce0c4d07ca249cb40a615d8553378e71ce8c9359433eb2d/diff:/var/lib/docker/overlay2/270c0b0ee2c96094b915ebf56d0dcd29596961b224d87a2db5a467fbbebbebb9/diff:/var/lib/docker/overlay2/281c890aaccc45cb967585dc3be6eab0e132a8b2eaccb953b3ceef6bf10ed199/diff:/var/lib/docker/overlay2/660acd9b56b18c9424caf72678a5f7680ac25cf728679391a2ba4de7834d50da/diff:/var/lib/docker/overlay2/2f6d9e0f15e73b6e6f640f95c2cd706a3eea2042d30e5efa20949367649bf299/diff:/var/lib/docker/overlay2/dea078a53575ee2c328b36bca2d454bdebba3839003e114112b1ede364396676/diff:/var/lib/docker/overlay2/4e1081d6fb3ff60b6c9ffcaa0f550fc05debe18a804e8d2b59f416cd629dfbbf/diff:/var/lib/docker/overlay2/affbce59a80eaf3362bada211e0c90f5c542e33dd9608e2e809586eb9633bdcf/diff:/var/lib/docker/overlay2/bbacc80b7c36d6116e837559a5c96f7acc59750e54401a487a6170268ca81da0/diff:/var/lib/d
ocker/overlay2/c99055c4d9c328200f4a6daed62ca739f0a2d84319b1e88e368d11c103f3c4c5/diff:/var/lib/docker/overlay2/b18767a820ba371be151b376cd58202c2ab479e6bc308181b5c9c725813379be/diff:/var/lib/docker/overlay2/339ff5625f6845d2a9ef08a2343407af3801fbae246217e04beaa7a071338dd8/diff:/var/lib/docker/overlay2/c7fc276082da5e9eb5ec2f1e674d449865774d4ad97069ef9f07352ae2f100c8/diff:/var/lib/docker/overlay2/61f2dd8f54d8092b579d841f75d70dc041178c06107b2468e201b936f2274a26/diff:/var/lib/docker/overlay2/8c17039f8c44ef680ec4cddf8150bf827975565fd3dba496414493fee76239e2/diff:/var/lib/docker/overlay2/a57cabe79bd390aa2ca1c8bfe98c1bdd17517106b4f6ed74fa14402fc28776f7/diff:/var/lib/docker/overlay2/64bef3de17ab81d4ab2e429beb764008f5955a7acacea6a71c257087396f475d/diff:/var/lib/docker/overlay2/b8ebe1d7d54b43c99ecda5d70590c9ba5f534204c8d5d456e9592a498d7a457a/diff:/var/lib/docker/overlay2/f2c6f29309dd2fc97c2e704df4da2dcf49440df5bdc2e40aaf916ed1e6b04b40/diff:/var/lib/docker/overlay2/b885152dd30a3ed06d58cfdad2fde1a3b329770d1aece301ed8f39e5e8c
f8b74/diff:/var/lib/docker/overlay2/a265b058fa93a76f4c7642f3bf619be34c87e2c864c60a549f6548d461f0c478/diff:/var/lib/docker/overlay2/ee08b4ff6ea8faa612ef705acf7610911982ab171337c96ca37b0e34e3b36ee4/diff:/var/lib/docker/overlay2/b20f2ad26b2cd0148e5254bf76c109ca72694333f019a83bd584fc1fd7c22ba9/diff:/var/lib/docker/overlay2/03bd20c1061a88a8eebed8fdf6ed8027ff67439dbc72bb92455ff618d78d8938/diff:/var/lib/docker/overlay2/d54faa27c48bc69d61e8b3814c7596305c32970435a3acf52c660836f9b4a597/diff:/var/lib/docker/overlay2/7d442cad99d301735bf299a2954424494c47085601bc90e329e41ef60f03b1e2/diff:/var/lib/docker/overlay2/d0afa6ac1464071f99741abe772377d9aed2c693d9e990c3c42fda30404da572/diff:/var/lib/docker/overlay2/99604df604f60301f16705d51759d2597e4ce5b782826f3cb86d38dda8be6bbb/diff:/var/lib/docker/overlay2/36741f04fb62079ab01cefb691ae026ed3f0b1438c0d97c4114abe5013932554/diff:/var/lib/docker/overlay2/0eeb07125bc8247554b164c310b0b1784a8944de2e4146317be2809011df5476/diff",
"MergedDir": "/var/lib/docker/overlay2/155ff2bed89e76402b85c5e4ca84fb206024160420592ed6d785250907f1e65b/merged",
"UpperDir": "/var/lib/docker/overlay2/155ff2bed89e76402b85c5e4ca84fb206024160420592ed6d785250907f1e65b/diff",
"WorkDir": "/var/lib/docker/overlay2/155ff2bed89e76402b85c5e4ca84fb206024160420592ed6d785250907f1e65b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "kubernetes-upgrade-20220629182321-10138",
"Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220629182321-10138/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "kubernetes-upgrade-20220629182321-10138",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220629182321-10138",
"name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220629182321-10138",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "1da588b419b5566e2b8e863f74c4f9005b089a4d721b65d7f67a7512f9d2f2c4",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "49356"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "49355"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "49352"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "49354"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "49353"
}
]
},
"SandboxKey": "/var/run/docker/netns/1da588b419b5",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"kubernetes-upgrade-20220629182321-10138": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": [
"5e5564a07c02",
"kubernetes-upgrade-20220629182321-10138"
],
"NetworkID": "6a8a3bfb01a955b1eea1d45f0e69a2711c6053690b72f664ac92c0bca7f34dc0",
"EndpointID": "1b029f26f23c7407a3f5f7d330239d8696fe6c2e2fbb850797291a3f6b5900dc",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:43:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220629182321-10138 -n kubernetes-upgrade-20220629182321-10138
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220629182321-10138 -n kubernetes-upgrade-20220629182321-10138: exit status 6 (456.266122ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0629 18:24:37.077918 233282 status.go:413] kubeconfig endpoint: extract IP: "kubernetes-upgrade-20220629182321-10138" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-14420-3605-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-20220629182321-10138" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-20220629182321-10138" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220629182321-10138
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220629182321-10138: (1.959144438s)
--- FAIL: TestKubernetesUpgrade (77.08s)