wrapper.sh] [INFO] Wrapping Test Command: `bash -c curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && ./../test-infra/experiment/compatibility-versions/e2e-two-steps-upgrade.sh` wrapper.sh] [INFO] Running in: gcr.io/k8s-staging-test-infra/krte:v20251021-e2c2c9806f-master wrapper.sh] [INFO] See: https://github.com/kubernetes/test-infra/blob/master/images/krte/wrapper.sh ================================================================================ wrapper.sh] [SETUP] Performing pre-test setup ... wrapper.sh] [SETUP] Docker in Docker enabled, initializing ... net.ipv6.conf.all.disable_ipv6 = 0 net.ipv6.conf.all.forwarding = 1 Starting Docker: docker. wrapper.sh] [SETUP] Waiting for Docker to be ready, sleeping for 1 seconds ... wrapper.sh] [SETUP] Done setting up Docker in Docker. wrapper.sh] [SETUP] Setting SOURCE_DATE_EPOCH for build reproducibility ... wrapper.sh] [SETUP] exported SOURCE_DATE_EPOCH=1763663200 ================================================================================ wrapper.sh] [TEST] Running Test Command: `bash -c curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && ./../test-infra/experiment/compatibility-versions/e2e-two-steps-upgrade.sh` ... kind e2e-k8s.sh + COMMON_SCRIPT=/home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/common.sh + source /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/common.sh ++ set -o errexit -o nounset -o xtrace ++ CLUSTER_NAME=kind ++ CONTROL_PLANE_COMPONENTS='kube-apiserver kube-controller-manager kube-scheduler' ++ CLEANED_UP=false + trap signal_handler INT TERM + main ++ mktemp -d -p /tmp kind-e2e-XXXXXX + TMP_DIR=/tmp/kind-e2e-8vGJog + echo 'Created temporary directory: /tmp/kind-e2e-8vGJog' Created temporary directory: /tmp/kind-e2e-8vGJog + export ARTIFACTS=/logs/artifacts + ARTIFACTS=/logs/artifacts + mkdir -p /logs/artifacts + export VERSION_DELTA=1 + VERSION_DELTA=1 ++ ./hack/print-workspace-status.sh + WORKSPACE_STATUS='STABLE_BUILD_GIT_COMMIT 5bcb7599736327cd8c6d23e398002354a6e40f68 STABLE_BUILD_SCM_STATUS clean STABLE_BUILD_SCM_REVISION v1.35.0-beta.0.6+5bcb7599736327 STABLE_BUILD_MAJOR_VERSION 1 STABLE_BUILD_MINOR_VERSION 35+ STABLE_DOCKER_TAG v1.35.0-beta.0.6_5bcb7599736327 STABLE_DOCKER_REGISTRY registry.k8s.io STABLE_DOCKER_PUSH_REGISTRY staging-k8s.gcr.io gitCommit 5bcb7599736327cd8c6d23e398002354a6e40f68 gitTreeState clean gitVersion v1.35.0-beta.0.6+5bcb7599736327 gitMajor 1 gitMinor 35+ buildDate 2025-11-20T18:26:40Z' ++ echo 'STABLE_BUILD_GIT_COMMIT 5bcb7599736327cd8c6d23e398002354a6e40f68 STABLE_BUILD_SCM_STATUS clean STABLE_BUILD_SCM_REVISION v1.35.0-beta.0.6+5bcb7599736327 STABLE_BUILD_MAJOR_VERSION 1 STABLE_BUILD_MINOR_VERSION 35+ STABLE_DOCKER_TAG v1.35.0-beta.0.6_5bcb7599736327 STABLE_DOCKER_REGISTRY registry.k8s.io STABLE_DOCKER_PUSH_REGISTRY staging-k8s.gcr.io gitCommit 5bcb7599736327cd8c6d23e398002354a6e40f68 gitTreeState clean gitVersion v1.35.0-beta.0.6+5bcb7599736327 gitMajor 1 gitMinor 35+ buildDate 2025-11-20T18:26:40Z' ++ awk '/^gitVersion / {print $2}' + GIT_VERSION=v1.35.0-beta.0.6+5bcb7599736327 + [[ v1.35.0-beta.0.6+5bcb7599736327 == *alpha.0* ]] ++ echo 'STABLE_BUILD_GIT_COMMIT 5bcb7599736327cd8c6d23e398002354a6e40f68 STABLE_BUILD_SCM_STATUS clean STABLE_BUILD_SCM_REVISION v1.35.0-beta.0.6+5bcb7599736327 STABLE_BUILD_MAJOR_VERSION 1 STABLE_BUILD_MINOR_VERSION 35+ STABLE_DOCKER_TAG v1.35.0-beta.0.6_5bcb7599736327 STABLE_DOCKER_REGISTRY registry.k8s.io STABLE_DOCKER_PUSH_REGISTRY staging-k8s.gcr.io gitCommit 5bcb7599736327cd8c6d23e398002354a6e40f68 gitTreeState clean gitVersion v1.35.0-beta.0.6+5bcb7599736327 gitMajor 1 gitMinor 35+ buildDate 2025-11-20T18:26:40Z' ++ awk '/^STABLE_BUILD_MAJOR_VERSION / {print $2}' + MAJOR_VERSION=1 ++ echo 'STABLE_BUILD_GIT_COMMIT 5bcb7599736327cd8c6d23e398002354a6e40f68 STABLE_BUILD_SCM_STATUS clean STABLE_BUILD_SCM_REVISION v1.35.0-beta.0.6+5bcb7599736327 STABLE_BUILD_MAJOR_VERSION 1 STABLE_BUILD_MINOR_VERSION 35+ STABLE_DOCKER_TAG v1.35.0-beta.0.6_5bcb7599736327 STABLE_DOCKER_REGISTRY registry.k8s.io STABLE_DOCKER_PUSH_REGISTRY staging-k8s.gcr.io gitCommit 5bcb7599736327cd8c6d23e398002354a6e40f68 gitTreeState clean gitVersion v1.35.0-beta.0.6+5bcb7599736327 gitMajor 1 gitMinor 35+ buildDate 2025-11-20T18:26:40Z' ++ awk '/^STABLE_BUILD_MINOR_VERSION / {split($2, minor, "+"); print minor[1]}' + MINOR_VERSION=35 + export CURRENT_VERSION=1.35 + CURRENT_VERSION=1.35 + export PREV_VERSION=1.34 + PREV_VERSION=1.34 + export EMULATED_VERSION=1.34 + EMULATED_VERSION=1.34 + KUBECONFIG=/root/.kube/kind-test-config + export KUBECONFIG + echo 'exported KUBECONFIG=/root/.kube/kind-test-config' exported KUBECONFIG=/root/.kube/kind-test-config + kind version kind v0.31.0-alpha+b2b72662ea4c00 go1.24.6 linux/amd64 + '[' -n '' ']' + res=0 + create_cluster + KIND_CLUSTER_LOG_LEVEL=4 + EMULATED_VERSION=1.34 + CLUSTER_LOG_FORMAT= + scheduler_extra_args=' "v": "4"' + controllerManager_extra_args=' "v": "4"' + apiServer_extra_args=' "v": "4"' + kubelet_extra_args=' "v": "4"' + '[' -n '' ']' + KUBELET_LOG_FORMAT= + '[' -n '' ']' + feature_gates='{"AllBeta":true}' + runtime_config='{"api/beta":"true", "api/ga":"true"}' + cat + NUM_NODES=2 + KIND_CREATE_ATTEMPTED=true + kind create cluster --image=kindest/node:v1.34.0 --retain --wait=1m -v=3 --config=/logs/artifacts/kind-config.yaml Creating cluster "kind" ... • Ensuring node image (kindest/node:v1.34.0) 🖼 ... DEBUG: docker/images.go:67] Pulling image: kindest/node:v1.34.0 ... ✓ Ensuring node image (kindest/node:v1.34.0) 🖼 • Preparing nodes 📦 📦 📦 ... ✓ Preparing nodes 📦 📦 📦 • Writing configuration 📜 ... DEBUG: config/config.go:96] Using the following kubeadm config for node kind-worker: apiServer: certSANs: - localhost - 127.0.0.1 extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true runtime-config: api/beta=true,api/ga=true v: "4" apiVersion: kubeadm.k8s.io/v1beta3 clusterName: kind controlPlaneEndpoint: kind-control-plane:6443 controllerManager: extraArgs: emulated-version: "1.34" enable-hostpath-provisioner: "true" feature-gates: AllBeta=true v: "4" kind: ClusterConfiguration kubernetesVersion: v1.34.0 networking: podSubnet: 10.244.0.0/16 serviceSubnet: 10.96.0.0/16 scheduler: extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true v: "4" --- apiVersion: kubeadm.k8s.io/v1beta3 bootstrapTokens: - token: abcdef.0123456789abcdef kind: InitConfiguration localAPIEndpoint: advertiseAddress: 172.18.0.3 bindPort: 6443 nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.3 node-labels: "" provider-id: kind://docker/kind/kind-worker v: "4" skipPhases: - preflight --- apiVersion: kubeadm.k8s.io/v1beta3 discovery: bootstrapToken: apiServerEndpoint: kind-control-plane:6443 token: abcdef.0123456789abcdef unsafeSkipCAVerification: true kind: JoinConfiguration nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.3 node-labels: "" provider-id: kind://docker/kind/kind-worker v: "4" skipPhases: - preflight --- apiVersion: kubelet.config.k8s.io/v1beta1 cgroupDriver: systemd cgroupRoot: /kubelet evictionHard: imagefs.available: 0% nodefs.available: 0% nodefs.inodesFree: 0% failSwapOn: false featureGates: AllBeta: true imageGCHighThresholdPercent: 100 kind: KubeletConfiguration --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 conntrack: maxPerCore: 0 featureGates: AllBeta: true iptables: minSyncPeriod: 1s kind: KubeProxyConfiguration mode: iptables DEBUG: config/config.go:96] Using the following kubeadm config for node kind-control-plane: apiServer: certSANs: - localhost - 127.0.0.1 extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true runtime-config: api/beta=true,api/ga=true v: "4" apiVersion: kubeadm.k8s.io/v1beta3 clusterName: kind controlPlaneEndpoint: kind-control-plane:6443 controllerManager: extraArgs: emulated-version: "1.34" enable-hostpath-provisioner: "true" feature-gates: AllBeta=true v: "4" kind: ClusterConfiguration kubernetesVersion: v1.34.0 networking: podSubnet: 10.244.0.0/16 serviceSubnet: 10.96.0.0/16 scheduler: extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true v: "4" --- apiVersion: kubeadm.k8s.io/v1beta3 bootstrapTokens: - token: abcdef.0123456789abcdef kind: InitConfiguration localAPIEndpoint: advertiseAddress: 172.18.0.4 bindPort: 6443 nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.4 node-labels: "" provider-id: kind://docker/kind/kind-control-plane v: "4" skipPhases: - preflight --- apiVersion: kubeadm.k8s.io/v1beta3 controlPlane: localAPIEndpoint: advertiseAddress: 172.18.0.4 bindPort: 6443 discovery: bootstrapToken: apiServerEndpoint: kind-control-plane:6443 token: abcdef.0123456789abcdef unsafeSkipCAVerification: true kind: JoinConfiguration nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.4 node-labels: "" provider-id: kind://docker/kind/kind-control-plane v: "4" skipPhases: - preflight --- apiVersion: kubelet.config.k8s.io/v1beta1 cgroupDriver: systemd cgroupRoot: /kubelet evictionHard: imagefs.available: 0% nodefs.available: 0% nodefs.inodesFree: 0% failSwapOn: false featureGates: AllBeta: true imageGCHighThresholdPercent: 100 kind: KubeletConfiguration --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 conntrack: maxPerCore: 0 featureGates: AllBeta: true iptables: minSyncPeriod: 1s kind: KubeProxyConfiguration mode: iptables DEBUG: config/config.go:96] Using the following kubeadm config for node kind-worker2: apiServer: certSANs: - localhost - 127.0.0.1 extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true runtime-config: api/beta=true,api/ga=true v: "4" apiVersion: kubeadm.k8s.io/v1beta3 clusterName: kind controlPlaneEndpoint: kind-control-plane:6443 controllerManager: extraArgs: emulated-version: "1.34" enable-hostpath-provisioner: "true" feature-gates: AllBeta=true v: "4" kind: ClusterConfiguration kubernetesVersion: v1.34.0 networking: podSubnet: 10.244.0.0/16 serviceSubnet: 10.96.0.0/16 scheduler: extraArgs: emulated-version: "1.34" feature-gates: AllBeta=true v: "4" --- apiVersion: kubeadm.k8s.io/v1beta3 bootstrapTokens: - token: abcdef.0123456789abcdef kind: InitConfiguration localAPIEndpoint: advertiseAddress: 172.18.0.2 bindPort: 6443 nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.2 node-labels: "" provider-id: kind://docker/kind/kind-worker2 v: "4" skipPhases: - preflight --- apiVersion: kubeadm.k8s.io/v1beta3 discovery: bootstrapToken: apiServerEndpoint: kind-control-plane:6443 token: abcdef.0123456789abcdef unsafeSkipCAVerification: true kind: JoinConfiguration nodeRegistration: criSocket: unix:///run/containerd/containerd.sock kubeletExtraArgs: node-ip: 172.18.0.2 node-labels: "" provider-id: kind://docker/kind/kind-worker2 v: "4" skipPhases: - preflight --- apiVersion: kubelet.config.k8s.io/v1beta1 cgroupDriver: systemd cgroupRoot: /kubelet evictionHard: imagefs.available: 0% nodefs.available: 0% nodefs.inodesFree: 0% failSwapOn: false featureGates: AllBeta: true imageGCHighThresholdPercent: 100 kind: KubeletConfiguration --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 conntrack: maxPerCore: 0 featureGates: AllBeta: true iptables: minSyncPeriod: 1s kind: KubeProxyConfiguration mode: iptables ✓ Writing configuration 📜 • Starting control-plane 🕹️ ... DEBUG: kubeadminit/init.go:96] I1121 13:53:59.335967 176 initconfiguration.go:260] loading configuration from "/kind/kubeadm.conf" W1121 13:53:59.336244 176 common.go:100] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old-config-file --new-config new-config-file', which will write the new, similar spec using a newer API version. W1121 13:53:59.336482 176 common.go:100] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old-config-file --new-config new-config-file', which will write the new, similar spec using a newer API version. W1121 13:53:59.336620 176 common.go:100] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "JoinConfiguration"). Please use 'kubeadm config migrate --old-config old-config-file --new-config new-config-file', which will write the new, similar spec using a newer API version. W1121 13:53:59.336723 176 initconfiguration.go:361] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration [init] Using Kubernetes version: v1.34.0 [certs] Using certificateDir folder "/etc/kubernetes/pki" I1121 13:53:59.337758 176 certs.go:111] creating a new certificate authority for ca [certs] Generating "ca" certificate and key I1121 13:53:59.390361 176 certs.go:472] validating certificate period for ca certificate [certs] Generating "apiserver" certificate and key [certs] apiserver serving cert is signed for DNS names [kind-control-plane kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 172.18.0.4 127.0.0.1] [certs] Generating "apiserver-kubelet-client" certificate and key I1121 13:53:59.644552 176 certs.go:111] creating a new certificate authority for front-proxy-ca [certs] Generating "front-proxy-ca" certificate and key I1121 13:53:59.745079 176 certs.go:472] validating certificate period for front-proxy-ca certificate [certs] Generating "front-proxy-client" certificate and key I1121 13:53:59.985541 176 certs.go:111] creating a new certificate authority for etcd-ca [certs] Generating "etcd/ca" certificate and key I1121 13:54:00.053460 176 certs.go:472] validating certificate period for etcd/ca certificate [certs] Generating "etcd/server" certificate and key [certs] etcd/server serving cert is signed for DNS names [kind-control-plane localhost] and IPs [172.18.0.4 127.0.0.1 ::1] [certs] Generating "etcd/peer" certificate and key [certs] etcd/peer serving cert is signed for DNS names [kind-control-plane localhost] and IPs [172.18.0.4 127.0.0.1 ::1] [certs] Generating "etcd/healthcheck-client" certificate and key [certs] Generating "apiserver-etcd-client" certificate and key I1121 13:54:00.403612 176 certs.go:77] creating new public/private key files for signing service account users [certs] Generating "sa" key and public key [kubeconfig] Using kubeconfig folder "/etc/kubernetes" I1121 13:54:00.607476 176 kubeconfig.go:111] creating kubeconfig file for admin.conf [kubeconfig] Writing "admin.conf" kubeconfig file I1121 13:54:00.818399 176 kubeconfig.go:111] creating kubeconfig file for super-admin.conf [kubeconfig] Writing "super-admin.conf" kubeconfig file I1121 13:54:00.845263 176 kubeconfig.go:111] creating kubeconfig file for kubelet.conf [kubeconfig] Writing "kubelet.conf" kubeconfig file I1121 13:54:01.111555 176 kubeconfig.go:111] creating kubeconfig file for controller-manager.conf [kubeconfig] Writing "controller-manager.conf" kubeconfig file I1121 13:54:01.196885 176 kubeconfig.go:111] creating kubeconfig file for scheduler.conf [kubeconfig] Writing "scheduler.conf" kubeconfig file [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" I1121 13:54:01.294298 176 local.go:67] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml" I1121 13:54:01.294314 176 manifests.go:125] [control-plane] getting StaticPodSpecs [control-plane] Using manifest folder "/etc/kubernetes/manifests" [control-plane] Creating static Pod manifest for "kube-apiserver" I1121 13:54:01.294438 176 certs.go:472] validating certificate period for CA certificate I1121 13:54:01.294479 176 manifests.go:151] [control-plane] adding volume "ca-certs" for component "kube-apiserver" I1121 13:54:01.294484 176 manifests.go:151] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver" I1121 13:54:01.294487 176 manifests.go:151] [control-plane] adding volume "k8s-certs" for component "kube-apiserver" I1121 13:54:01.294489 176 manifests.go:151] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver" I1121 13:54:01.294492 176 manifests.go:151] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver" [control-plane] Creating static Pod manifest for "kube-controller-manager" I1121 13:54:01.294828 176 manifests.go:180] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml" I1121 13:54:01.294833 176 manifests.go:125] [control-plane] getting StaticPodSpecs I1121 13:54:01.294933 176 manifests.go:151] [control-plane] adding volume "ca-certs" for component "kube-controller-manager" I1121 13:54:01.294936 176 manifests.go:151] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager" I1121 13:54:01.294938 176 manifests.go:151] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager" I1121 13:54:01.294940 176 manifests.go:151] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager" I1121 13:54:01.294943 176 manifests.go:151] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager" I1121 13:54:01.294946 176 manifests.go:151] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager" I1121 13:54:01.294949 176 manifests.go:151] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager" I1121 13:54:01.295230 176 manifests.go:180] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml" I1121 13:54:01.295234 176 manifests.go:125] [control-plane] getting StaticPodSpecs [control-plane] Creating static Pod manifest for "kube-scheduler" I1121 13:54:01.295310 176 manifests.go:151] [control-plane] adding volume "kubeconfig" for component "kube-scheduler" I1121 13:54:01.295854 176 manifests.go:180] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml" I1121 13:54:01.295880 176 kubelet.go:69] Stopping the kubelet [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml" [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Starting the kubelet I1121 13:54:01.370337 176 loader.go:402] Config loaded from file: /etc/kubernetes/admin.conf I1121 13:54:01.370583 176 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false I1121 13:54:01.370593 176 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false I1121 13:54:01.370596 176 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false I1121 13:54:01.370599 176 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true I1121 13:54:01.370602 176 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests" [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s [kubelet-check] The kubelet is healthy after 500.786504ms [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s [control-plane-check] Checking kube-apiserver at https://172.18.0.4:6443/livez [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez I1121 13:54:01.873589 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="" milliseconds=0 I1121 13:54:04.020060 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="403 Forbidden" milliseconds=1645 I1121 13:54:04.025847 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="403 Forbidden" milliseconds=4 [control-plane-check] kube-scheduler is healthy after 2.168626767s I1121 13:54:04.374364 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="403 Forbidden" milliseconds=0 I1121 13:54:04.873770 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="403 Forbidden" milliseconds=0 I1121 13:54:05.374467 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/livez?timeout=10s" status="200 OK" milliseconds=0 [control-plane-check] kube-apiserver is healthy after 3.501283201s [control-plane-check] kube-controller-manager is healthy after 6.50204788s I1121 13:54:08.375572 176 loader.go:402] Config loaded from file: /etc/kubernetes/admin.conf I1121 13:54:08.375902 176 loader.go:402] Config loaded from file: /etc/kubernetes/super-admin.conf I1121 13:54:08.376149 176 kubeconfig.go:657] ensuring that the ClusterRoleBinding for the kubeadm:cluster-admins Group exists I1121 13:54:08.376807 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="403 Forbidden" milliseconds=0 I1121 13:54:08.376864 176 kubeconfig.go:730] creating the ClusterRoleBinding for the kubeadm:cluster-admins Group by using super-admin.conf I1121 13:54:08.380530 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=3 I1121 13:54:08.380573 176 uploadconfig.go:111] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace I1121 13:54:08.381966 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:08.382958 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:08.383927 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:08.383972 176 uploadconfig.go:125] [upload-config] Uploading the kubelet component config to a ConfigMap [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster I1121 13:54:08.385260 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:08.386254 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:08.387115 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s" status="201 Created" milliseconds=0 [upload-certs] Skipping phase. Please see --upload-certs [mark-control-plane] Marking the node kind-control-plane as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers] [mark-control-plane] Marking the node kind-control-plane as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule] I1121 13:54:08.387892 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/nodes/kind-control-plane?timeout=10s" status="200 OK" milliseconds=0 I1121 13:54:08.390028 176 round_trippers.go:632] "Response" verb="PATCH" url="https://kind-control-plane:6443/api/v1/nodes/kind-control-plane?timeout=10s" status="200 OK" milliseconds=1 [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles I1121 13:54:08.390309 176 loader.go:402] Config loaded from file: /etc/kubernetes/admin.conf I1121 13:54:08.390997 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-abcdef?timeout=10s" status="404 Not Found" milliseconds=0 I1121 13:54:08.392074 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/secrets?timeout=10s" status="201 Created" milliseconds=0 [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes I1121 13:54:08.393039 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:08.393928 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=0 [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials I1121 13:54:08.394829 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=0 [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token I1121 13:54:08.395687 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=0 [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster I1121 13:54:08.396494 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=0 [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace I1121 13:54:08.396530 176 clusterinfo.go:58] [bootstrap-token] copying the cluster from admin.conf to the bootstrap kubeconfig I1121 13:54:08.396632 176 clusterinfo.go:70] [bootstrap-token] creating/updating ConfigMap in kube-public namespace I1121 13:54:08.397535 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:08.397562 176 clusterinfo.go:84] creating the RBAC rules for exposing the cluster-info ConfigMap in the kube-public namespace I1121 13:54:08.576896 176 request.go:683] "Waited before sending request" delay="179.273602ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles?timeout=10s" I1121 13:54:08.578521 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:08.776917 176 request.go:683] "Waited before sending request" delay="198.25204ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/rolebindings?timeout=10s" I1121 13:54:08.778464 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/rolebindings?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:08.778547 176 kubeletfinalize.go:90] [kubelet-finalize] Assuming that kubelet client certificate rotation is enabled: found "/var/lib/kubelet/pki/kubelet-client-current.pem" [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key I1121 13:54:08.778825 176 loader.go:402] Config loaded from file: /etc/kubernetes/kubelet.conf I1121 13:54:08.779030 176 kubeletfinalize.go:144] [kubelet-finalize] Restarting the kubelet to enable client certificate rotation I1121 13:54:08.870984 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/apis/apps/v1/namespaces/kube-system/deployments?labelSelector=k8s-app%3Dkube-dns" status="200 OK" milliseconds=2 I1121 13:54:08.872256 176 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/coredns?timeout=10s" status="404 Not Found" milliseconds=0 I1121 13:54:08.873648 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:08.977118 176 request.go:683] "Waited before sending request" delay="103.196786ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s" I1121 13:54:08.978555 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.177142 176 request.go:683] "Waited before sending request" delay="198.286131ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" I1121 13:54:09.178546 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.179891 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.182404 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/apps/v1/namespaces/kube-system/deployments?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.184884 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/services?timeout=10s" status="201 Created" milliseconds=2 [addons] Applied essential addon: CoreDNS I1121 13:54:09.186986 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.188816 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/apps/v1/namespaces/kube-system/daemonsets?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.189818 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s" status="201 Created" milliseconds=0 I1121 13:54:09.377153 176 request.go:683] "Waited before sending request" delay="187.264067ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" I1121 13:54:09.378513 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.576913 176 request.go:683] "Waited before sending request" delay="198.288744ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s" I1121 13:54:09.578290 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s" status="201 Created" milliseconds=1 I1121 13:54:09.776701 176 request.go:683] "Waited before sending request" delay="198.288484ms" reason="client-side throttling, not priority and fairness" verb="POST" URL="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s" I1121 13:54:09.778645 176 round_trippers.go:632] "Response" verb="POST" url="https://kind-control-plane:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s" status="201 Created" milliseconds=1 [addons] Applied essential addon: kube-proxy I1121 13:54:09.778981 176 loader.go:402] Config loaded from file: /etc/kubernetes/admin.conf I1121 13:54:09.779227 176 loader.go:402] Config loaded from file: /etc/kubernetes/admin.conf Your Kubernetes control-plane has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config Alternatively, if you are the root user, you can run: export KUBECONFIG=/etc/kubernetes/admin.conf You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of control-plane nodes by copying certificate authorities and service account keys on each node and then running the following as root: kubeadm join kind-control-plane:6443 --token \ --discovery-token-ca-cert-hash sha256:26f8564a256883236d4fa8aaeadb615ab1b12f9f93650c61f0c722528e2e384e \ --control-plane Then you can join any number of worker nodes by running the following on each as root: kubeadm join kind-control-plane:6443 --token \ --discovery-token-ca-cert-hash sha256:26f8564a256883236d4fa8aaeadb615ab1b12f9f93650c61f0c722528e2e384e ✓ Starting control-plane 🕹️ • Installing CNI 🔌 ... ✓ Installing CNI 🔌 • Installing StorageClass 💾 ... ✓ Installing StorageClass 💾 • Joining worker nodes 🚜 ... DEBUG: kubeadmjoin/join.go:147] I1121 13:54:11.080447 175 join.go:421] [preflight] found NodeName empty; using OS hostname as NodeName I1121 13:54:11.080483 175 joinconfiguration.go:82] loading configuration from "/kind/kubeadm.conf" W1121 13:54:11.080704 175 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=InitConfiguration W1121 13:54:11.080714 175 common.go:100] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "JoinConfiguration"). Please use 'kubeadm config migrate --old-config old-config-file --new-config new-config-file', which will write the new, similar spec using a newer API version. W1121 13:54:11.080867 175 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration W1121 13:54:11.080872 175 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeproxy.config.k8s.io/v1alpha1, Kind=KubeProxyConfiguration W1121 13:54:11.080874 175 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=ClusterConfiguration I1121 13:54:11.080958 175 controlplaneprepare.go:225] [download-certs] Skipping certs download I1121 13:54:11.080961 175 join.go:551] [preflight] Discovering cluster-info I1121 13:54:11.080967 175 token.go:71] [discovery] Created cluster-info discovery client, requesting info from "kind-control-plane:6443" I1121 13:54:11.081031 175 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false I1121 13:54:11.081036 175 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true I1121 13:54:11.081039 175 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false I1121 13:54:11.081043 175 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false I1121 13:54:11.081045 175 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false I1121 13:54:11.081189 175 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:11.085459 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=4 I1121 13:54:11.085549 175 token.go:249] [discovery] Retrying due to error: could not find a JWS signature in the cluster-info ConfigMap for token ID "abcdef" I1121 13:54:16.085508 175 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:16.089445 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=3 I1121 13:54:16.089563 175 token.go:249] [discovery] Retrying due to error: could not find a JWS signature in the cluster-info ConfigMap for token ID "abcdef" I1121 13:54:21.081540 175 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:21.084903 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=3 I1121 13:54:21.085224 175 token.go:113] [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "kind-control-plane:6443" I1121 13:54:21.085230 175 discovery.go:52] [discovery] Using provided TLSBootstrapToken as authentication credentials for the join process I1121 13:54:21.085239 175 join.go:565] [preflight] Fetching init configuration I1121 13:54:21.085243 175 join.go:654] [preflight] Retrieving KubeConfig objects [preflight] Reading configuration from the "kubeadm-config" ConfigMap in namespace "kube-system"... [preflight] Use 'kubeadm init phase upload-config kubeadm --config your-config-file' to re-upload it. I1121 13:54:21.088174 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s" status="200 OK" milliseconds=2 I1121 13:54:21.088689 175 kubeproxy.go:55] attempting to download the KubeProxyConfiguration from ConfigMap "kube-proxy" I1121 13:54:21.089434 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s" status="200 OK" milliseconds=0 I1121 13:54:21.090626 175 kubelet.go:73] attempting to download the KubeletConfiguration from ConfigMap "kubelet-config" I1121 13:54:21.091604 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kubelet-config?timeout=10s" status="200 OK" milliseconds=0 I1121 13:54:21.092343 175 initconfiguration.go:114] skip CRI socket detection, fill with the default CRI socket unix:///var/run/containerd/containerd.sock I1121 13:54:21.092440 175 interface.go:432] Looking for default routes with IPv4 addresses I1121 13:54:21.092444 175 interface.go:437] Default route transits interface "eth0" I1121 13:54:21.092489 175 interface.go:209] Interface eth0 is up I1121 13:54:21.092505 175 interface.go:257] Interface "eth0" has 3 addresses :[172.18.0.3/16 fc00:f853:ccd:e793::3/64 fe80::18c2:8cff:fee1:d40f/64]. I1121 13:54:21.092512 175 interface.go:224] Checking addr 172.18.0.3/16. I1121 13:54:21.092517 175 interface.go:231] IP found 172.18.0.3 I1121 13:54:21.092522 175 interface.go:263] Found valid IPv4 address 172.18.0.3 for interface "eth0". I1121 13:54:21.092526 175 interface.go:443] Found active IP 172.18.0.3 I1121 13:54:21.092661 175 kubelet.go:166] [kubelet-start] writing bootstrap kubelet config file at /etc/kubernetes/bootstrap-kubelet.conf I1121 13:54:21.093023 175 kubelet.go:181] [kubelet-start] writing CA certificate at /etc/kubernetes/pki/ca.crt I1121 13:54:21.093083 175 kubelet.go:197] [kubelet-start] Checking for an existing Node in the cluster with name "kind-worker" and status "Ready" I1121 13:54:21.093723 175 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/nodes/kind-worker?timeout=10s" status="404 Not Found" milliseconds=0 I1121 13:54:21.093763 175 kubelet.go:212] [kubelet-start] Stopping the kubelet [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml" [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Starting the kubelet [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s [kubelet-check] The kubelet is healthy after 500.461276ms [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap I1121 13:54:21.682968 175 loader.go:402] Config loaded from file: /etc/kubernetes/kubelet.conf I1121 13:54:21.683316 175 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache" I1121 13:54:21.683421 175 loader.go:402] Config loaded from file: /etc/kubernetes/kubelet.conf This node has joined the cluster: * Certificate signing request was sent to apiserver and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the control-plane to see this node join the cluster. DEBUG: kubeadmjoin/join.go:147] I1121 13:54:11.080217 177 join.go:421] [preflight] found NodeName empty; using OS hostname as NodeName I1121 13:54:11.080273 177 joinconfiguration.go:82] loading configuration from "/kind/kubeadm.conf" W1121 13:54:11.080513 177 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=InitConfiguration W1121 13:54:11.080527 177 common.go:100] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "JoinConfiguration"). Please use 'kubeadm config migrate --old-config old-config-file --new-config new-config-file', which will write the new, similar spec using a newer API version. W1121 13:54:11.080677 177 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration W1121 13:54:11.080680 177 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeproxy.config.k8s.io/v1alpha1, Kind=KubeProxyConfiguration W1121 13:54:11.080681 177 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=ClusterConfiguration I1121 13:54:11.080757 177 controlplaneprepare.go:225] [download-certs] Skipping certs download I1121 13:54:11.080761 177 join.go:551] [preflight] Discovering cluster-info I1121 13:54:11.080769 177 token.go:71] [discovery] Created cluster-info discovery client, requesting info from "kind-control-plane:6443" I1121 13:54:11.080857 177 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false I1121 13:54:11.080863 177 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true I1121 13:54:11.080865 177 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false I1121 13:54:11.080867 177 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false I1121 13:54:11.080869 177 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false I1121 13:54:11.081076 177 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:11.085405 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=4 I1121 13:54:11.085522 177 token.go:249] [discovery] Retrying due to error: could not find a JWS signature in the cluster-info ConfigMap for token ID "abcdef" I1121 13:54:16.085580 177 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:16.089694 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=4 I1121 13:54:16.089767 177 token.go:249] [discovery] Retrying due to error: could not find a JWS signature in the cluster-info ConfigMap for token ID "abcdef" I1121 13:54:21.085738 177 token.go:229] [discovery] Waiting for the cluster-info ConfigMap to receive a JWS signature for token ID "abcdef" I1121 13:54:21.088894 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s" status="200 OK" milliseconds=3 I1121 13:54:21.089186 177 token.go:113] [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "kind-control-plane:6443" I1121 13:54:21.089193 177 discovery.go:52] [discovery] Using provided TLSBootstrapToken as authentication credentials for the join process I1121 13:54:21.089201 177 join.go:565] [preflight] Fetching init configuration I1121 13:54:21.089204 177 join.go:654] [preflight] Retrieving KubeConfig objects [preflight] Reading configuration from the "kubeadm-config" ConfigMap in namespace "kube-system"... [preflight] Use 'kubeadm init phase upload-config kubeadm --config your-config-file' to re-upload it. I1121 13:54:21.091882 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s" status="200 OK" milliseconds=2 I1121 13:54:21.092404 177 kubeproxy.go:55] attempting to download the KubeProxyConfiguration from ConfigMap "kube-proxy" I1121 13:54:21.093114 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s" status="200 OK" milliseconds=0 I1121 13:54:21.093742 177 kubelet.go:73] attempting to download the KubeletConfiguration from ConfigMap "kubelet-config" I1121 13:54:21.094409 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/namespaces/kube-system/configmaps/kubelet-config?timeout=10s" status="200 OK" milliseconds=0 I1121 13:54:21.095096 177 initconfiguration.go:114] skip CRI socket detection, fill with the default CRI socket unix:///var/run/containerd/containerd.sock I1121 13:54:21.095177 177 interface.go:432] Looking for default routes with IPv4 addresses I1121 13:54:21.095180 177 interface.go:437] Default route transits interface "eth0" I1121 13:54:21.095218 177 interface.go:209] Interface eth0 is up I1121 13:54:21.095233 177 interface.go:257] Interface "eth0" has 3 addresses :[172.18.0.2/16 fc00:f853:ccd:e793::2/64 fe80::30ea:5cff:fe36:212d/64]. I1121 13:54:21.095240 177 interface.go:224] Checking addr 172.18.0.2/16. I1121 13:54:21.095245 177 interface.go:231] IP found 172.18.0.2 I1121 13:54:21.095249 177 interface.go:263] Found valid IPv4 address 172.18.0.2 for interface "eth0". I1121 13:54:21.095253 177 interface.go:443] Found active IP 172.18.0.2 I1121 13:54:21.095375 177 kubelet.go:166] [kubelet-start] writing bootstrap kubelet config file at /etc/kubernetes/bootstrap-kubelet.conf I1121 13:54:21.095655 177 kubelet.go:181] [kubelet-start] writing CA certificate at /etc/kubernetes/pki/ca.crt I1121 13:54:21.095702 177 kubelet.go:197] [kubelet-start] Checking for an existing Node in the cluster with name "kind-worker2" and status "Ready" I1121 13:54:21.096373 177 round_trippers.go:632] "Response" verb="GET" url="https://kind-control-plane:6443/api/v1/nodes/kind-worker2?timeout=10s" status="404 Not Found" milliseconds=0 I1121 13:54:21.096415 177 kubelet.go:212] [kubelet-start] Stopping the kubelet [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml" [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Starting the kubelet [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s [kubelet-check] The kubelet is healthy after 1.001185245s [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap I1121 13:54:22.183578 177 loader.go:402] Config loaded from file: /etc/kubernetes/kubelet.conf I1121 13:54:22.183921 177 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache" I1121 13:54:22.184038 177 loader.go:402] Config loaded from file: /etc/kubernetes/kubelet.conf This node has joined the cluster: * Certificate signing request was sent to apiserver and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the control-plane to see this node join the cluster. ✓ Joining worker nodes 🚜 • Waiting ≤ 1m0s for control-plane = Ready ⏳ ... ✓ Waiting ≤ 1m0s for control-plane = Ready ⏳ • Ready after 6s 💚 Set kubectl context to "kind-kind" You can now use your cluster with: kubectl cluster-info --context kind-kind Have a nice day! 👋 + kubectl version Client Version: v1.34.1 Kustomize Version: v5.7.1 Server Version: v1.34.0 + kubectl patch -n kube-system daemonset/kube-proxy --type=json '-p=[{"op": "add", "path": "/spec/template/spec/containers/0/command/-", "value": "--v=4" }]' daemonset.apps/kube-proxy patched + return 0 + UPGRADE_SCRIPT=/home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/kind-upgrade.sh + echo 'Upgrading cluster with /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/kind-upgrade.sh' Upgrading cluster with /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/kind-upgrade.sh + upgrade_cluster_components + RETRY_ATTEMPTS=5 + local attempt=1 + local success=false + bash /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/kind-upgrade.sh --no-kubelet + tee /logs/artifacts/upgrade-output-1.txt Unable to find image 'registry.k8s.io/build-image/kube-cross:v1.35.0-go1.25.3-bullseye.0' locally v1.35.0-go1.25.3-bullseye.0: Pulling from build-image/kube-cross 17506cf4b1b4: Pulling fs layer 870b81af81d8: Pulling fs layer 72dfca59daca: Pulling fs layer b13f2e9f6c71: Pulling fs layer 3adbbc83e99d: Pulling fs layer 4f4fb700ef54: Pulling fs layer a06a99bc7419: Pulling fs layer de7be3b80a7b: Pulling fs layer c2eed254918c: Pulling fs layer a949bcef8c2a: Pulling fs layer 4f4fb700ef54: Waiting a06a99bc7419: Waiting de7be3b80a7b: Waiting c2eed254918c: Waiting a949bcef8c2a: Waiting b13f2e9f6c71: Waiting 3adbbc83e99d: Waiting 72dfca59daca: Verifying Checksum 72dfca59daca: Download complete 17506cf4b1b4: Download complete b13f2e9f6c71: Verifying Checksum b13f2e9f6c71: Download complete 4f4fb700ef54: Verifying Checksum 4f4fb700ef54: Download complete 870b81af81d8: Verifying Checksum 870b81af81d8: Download complete a06a99bc7419: Verifying Checksum a06a99bc7419: Download complete de7be3b80a7b: Verifying Checksum de7be3b80a7b: Download complete 17506cf4b1b4: Pull complete a949bcef8c2a: Verifying Checksum a949bcef8c2a: Download complete 870b81af81d8: Pull complete 72dfca59daca: Pull complete c2eed254918c: Verifying Checksum c2eed254918c: Download complete b13f2e9f6c71: Pull complete 3adbbc83e99d: Verifying Checksum 3adbbc83e99d: Download complete 3adbbc83e99d: Pull complete 4f4fb700ef54: Pull complete a06a99bc7419: Pull complete de7be3b80a7b: Pull complete c2eed254918c: Pull complete a949bcef8c2a: Pull complete Digest: sha256:2d42755343ada0f56e9d381916edf5d2dbd00050643d4f558b9bcd891d3bdc81 Status: Downloaded newer image for registry.k8s.io/build-image/kube-cross:v1.35.0-go1.25.3-bullseye.0 go: downloading go1.25.4 (linux/amd64) Updated component kube-apiserver on node kind-control-plane Updated component kube-controller-manager on node kind-control-plane Updated component kube-scheduler on node kind-control-plane Unable to connect to the server: EOF KIND cluster kind updated successfully with version v1.35.0-beta.0.6+5bcb7599736327 + bash /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/kind-upgrade.sh --no-kubelet + tee /logs/artifacts/upgrade-output-2.txt Updated component kube-apiserver on node kind-control-plane Updated component kube-controller-manager on node kind-control-plane Updated component kube-scheduler on node kind-control-plane KIND cluster kind updated successfully with version v1.35.0-beta.0.6+5bcb7599736327 + '[' 1 -le 5 ']' + echo 'Attempt 1 of 5 to upgrade cluster...' Attempt 1 of 5 to upgrade cluster... + kind export kubeconfig --name kind Set kubectl context to "kind-kind" + kubectl version + grep 'Server Version:' + grep -q 1.35 WARNING: version difference between client (1.33) and server (1.35) exceeds the supported minor version skew of +/-1 + echo 'Upgrade successful! kubectl version reports 1.35' Upgrade successful! kubectl version reports 1.35 + success=true + break + true + return 0 + [[ 0 -ne 0 ]] + export PREV_RELEASE_BRANCH=release-1.34 + PREV_RELEASE_BRANCH=release-1.34 + PREV_RELEASE_REPO_PATH=/tmp/kind-e2e-8vGJog/prev-release-k8s + echo 'Cloning branch release-1.34 into /tmp/kind-e2e-8vGJog/prev-release-k8s' Cloning branch release-1.34 into /tmp/kind-e2e-8vGJog/prev-release-k8s + git clone --filter=blob:none --single-branch --branch release-1.34 https://github.com/kubernetes/kubernetes.git /tmp/kind-e2e-8vGJog/prev-release-k8s Cloning into '/tmp/kind-e2e-8vGJog/prev-release-k8s'... Updating files: 0% (2/27578) Updating files: 1% (276/27578) Updating files: 2% (552/27578) Updating files: 3% (828/27578) Updating files: 4% (1104/27578) Updating files: 5% (1379/27578) Updating files: 6% (1655/27578) Updating files: 7% (1931/27578) Updating files: 8% (2207/27578) Updating files: 9% (2483/27578) Updating files: 10% (2758/27578) Updating files: 11% (3034/27578) Updating files: 12% (3310/27578) Updating files: 13% (3586/27578) Updating files: 14% (3861/27578) Updating files: 15% (4137/27578) Updating files: 16% (4413/27578) Updating files: 17% (4689/27578) Updating files: 18% (4965/27578) Updating files: 19% (5240/27578) Updating files: 20% (5516/27578) Updating files: 21% (5792/27578) Updating files: 22% (6068/27578) Updating files: 23% (6343/27578) Updating files: 24% (6619/27578) Updating files: 25% (6895/27578) Updating files: 26% (7171/27578) Updating files: 27% (7447/27578) Updating files: 28% (7722/27578) Updating files: 29% (7998/27578) Updating files: 30% (8274/27578) Updating files: 31% (8550/27578) Updating files: 32% (8825/27578) Updating files: 33% (9101/27578) Updating files: 34% (9377/27578) Updating files: 35% (9653/27578) Updating files: 36% (9929/27578) Updating files: 37% (10204/27578) Updating files: 38% (10480/27578) Updating files: 39% (10756/27578) Updating files: 40% (11032/27578) Updating files: 41% (11307/27578) Updating files: 42% (11583/27578) Updating files: 43% (11859/27578) Updating files: 44% (12135/27578) Updating files: 45% (12411/27578) Updating files: 46% (12686/27578) Updating files: 47% (12962/27578) Updating files: 48% (13238/27578) Updating files: 49% (13514/27578) Updating files: 50% (13789/27578) Updating files: 51% (14065/27578) Updating files: 52% (14341/27578) Updating files: 53% (14617/27578) Updating files: 54% (14893/27578) Updating files: 55% (15168/27578) Updating files: 56% (15444/27578) Updating files: 57% (15720/27578) Updating files: 58% (15996/27578) Updating files: 59% (16272/27578) Updating files: 60% (16547/27578) Updating files: 61% (16823/27578) Updating files: 62% (17099/27578) Updating files: 63% (17375/27578) Updating files: 64% (17650/27578) Updating files: 65% (17926/27578) Updating files: 66% (18202/27578) Updating files: 67% (18478/27578) Updating files: 68% (18754/27578) Updating files: 69% (19029/27578) Updating files: 70% (19305/27578) Updating files: 71% (19581/27578) Updating files: 72% (19857/27578) Updating files: 73% (20132/27578) Updating files: 74% (20408/27578) Updating files: 75% (20684/27578) Updating files: 76% (20960/27578) Updating files: 77% (21236/27578) Updating files: 77% (21466/27578) Updating files: 78% (21511/27578) Updating files: 79% (21787/27578) Updating files: 80% (22063/27578) Updating files: 81% (22339/27578) Updating files: 82% (22614/27578) Updating files: 83% (22890/27578) Updating files: 84% (23166/27578) Updating files: 85% (23442/27578) Updating files: 86% (23718/27578) Updating files: 87% (23993/27578) Updating files: 88% (24269/27578) Updating files: 89% (24545/27578) Updating files: 90% (24821/27578) Updating files: 91% (25096/27578) Updating files: 92% (25372/27578) Updating files: 93% (25648/27578) Updating files: 94% (25924/27578) Updating files: 95% (26200/27578) Updating files: 96% (26475/27578) Updating files: 97% (26751/27578) Updating files: 98% (27027/27578) Updating files: 99% (27303/27578) Updating files: 100% (27578/27578) Updating files: 100% (27578/27578), done. + pushd /tmp/kind-e2e-8vGJog/prev-release-k8s /tmp/kind-e2e-8vGJog/prev-release-k8s /home/prow/go/src/k8s.io/kubernetes + build_test_bins release-1.34 + local release_branch=release-1.34 + GINKGO_SRC_DIR=vendor/github.com/onsi/ginkgo/v2/ginkgo + echo 'Building e2e.test binary from release branch release-1.34...' Building e2e.test binary from release branch release-1.34... + make all 'WHAT=cmd/kubectl test/e2e/e2e.test vendor/github.com/onsi/ginkgo/v2/ginkgo' go: downloading go1.24.9 (linux/amd64) +++ [1121 13:58:44] Building go targets for linux/amd64 github.com/onsi/ginkgo/v2/ginkgo (non-static) k8s.io/kubernetes/cmd/kubectl (static) k8s.io/kubernetes/test/e2e/e2e.test (test) + export PATH=/tmp/kind-e2e-8vGJog/prev-release-k8s/_output/bin:/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + PATH=/tmp/kind-e2e-8vGJog/prev-release-k8s/_output/bin:/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + echo 'Finished building e2e.test binary from release-1.34.' Finished building e2e.test binary from release-1.34. + run_e2e_tests + '[' ipv4 = ipv6 ']' + SKIP='Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' + FOCUS= + LABEL_FILTER= + '[' -z '' ']' + '[' -z '' ']' + FOCUS='\[Conformance\]' + '[' true = true ']' + export GINKGO_PARALLEL=y + GINKGO_PARALLEL=y + '[' -z 'Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' ']' + SKIP='\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' + export KUBERNETES_CONFORMANCE_TEST=y + KUBERNETES_CONFORMANCE_TEST=y + export KUBE_CONTAINER_RUNTIME=remote + KUBE_CONTAINER_RUNTIME=remote + export KUBE_CONTAINER_RUNTIME_ENDPOINT=unix:///run/containerd/containerd.sock + KUBE_CONTAINER_RUNTIME_ENDPOINT=unix:///run/containerd/containerd.sock + export KUBE_CONTAINER_RUNTIME_NAME=containerd + KUBE_CONTAINER_RUNTIME_NAME=containerd + GINKGO_PID=78036 + wait 78036 + ./hack/ginkgo-e2e.sh --provider=skeleton --num-nodes=2 '--ginkgo.focus=\[Conformance\]' '--ginkgo.skip=\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' --ginkgo.label-filter= --report-dir=/logs/artifacts --disable-log-dump=true Conformance test: not doing test setup. + set +x + /tmp/kind-e2e-8vGJog/prev-release-k8s/_output/bin/ginkgo --nodes=25 --poll-progress-after=60m --poll-progress-interval=5m --source-root=/tmp/kind-e2e-8vGJog/prev-release-k8s/cluster/.. --timeout=24h --silence-skips --force-newlines --no-color /tmp/kind-e2e-8vGJog/prev-release-k8s/_output/bin/e2e.test -- --kubeconfig=/root/.kube/kind-test-config --host=https://127.0.0.1:34981 --provider=skeleton --gce-project= --gce-zone= --gce-region= --gce-multizone=false --gke-cluster= --kube-master= --cluster-tag= --cloud-config-file= --repo-root=/tmp/kind-e2e-8vGJog/prev-release-k8s/cluster/.. --node-instance-group= --prefix=e2e --network=e2e --node-tag= --master-tag= --docker-config-file= --dns-domain=cluster.local --prepull-images=false --report-complete-ginkgo --report-complete-junit --provider=skeleton --num-nodes=2 '--ginkgo.focus=\[Conformance\]' '--ginkgo.skip=\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' --ginkgo.label-filter= --report-dir=/logs/artifacts --disable-log-dump=true Running Suite: Kubernetes e2e suite - /tmp/kind-e2e-8vGJog/prev-release-k8s/_output/bin ======================================================================================= Random Seed: 1763733632 - will randomize all specs Will run 389 of 7137 specs Running in parallel across 25 processes • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • Ran 389 of 7137 Specs in 361.922 seconds SUCCESS! -- 389 Passed | 0 Failed | 0 Pending | 6748 Skipped Ginkgo ran 1 suite in 6m5.621384648s Test Suite Passed + kubectl version Client Version: v1.34.2-1+d4672d9a9db568 Kustomize Version: v5.7.1 Server Version: v1.35.0-beta.0.6+5bcb7599736327 + export PATH=/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + PATH=/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + popd /home/prow/go/src/k8s.io/kubernetes + EMULATED_VERSION_UPGRADE_SCRIPT=/home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/emulated-version-upgrade.sh + echo 'Upgrading cluster with /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/emulated-version-upgrade.sh' Upgrading cluster with /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/emulated-version-upgrade.sh + /home/prow/go/src/k8s.io/kubernetes/../test-infra/experiment/compatibility-versions/emulated-version-upgrade.sh + tee /logs/artifacts/emulated-upgrade-output.txt Removed emulated-version flag of component kube-apiserver static pod on node kind-control-plane if present Removed emulation-forward-compatible flag of component kube-apiserver static pod on node kind-control-plane if present Removed emulated-version flag of component kube-controller-manager static pod on node kind-control-plane if present Removed emulation-forward-compatible flag of component kube-controller-manager static pod on node kind-control-plane if present Removed emulated-version flag of component kube-scheduler static pod on node kind-control-plane if present Removed emulation-forward-compatible flag of component kube-scheduler static pod on node kind-control-plane if present docker: 'docker cp' requires 2 arguments Usage: docker cp [OPTIONS] CONTAINER:SRC_PATH DEST_PATH|- docker cp [OPTIONS] SRC_PATH|- CONTAINER:DEST_PATH Run 'docker cp --help' for more information + kubectl version Client Version: v1.33.5-dispatcher Kustomize Version: v5.6.0 Server Version: v1.35.0-beta.0.6+5bcb7599736327 WARNING: version difference between client (1.33) and server (1.35) exceeds the supported minor version skew of +/-1 + build_test_bins 1.35 + local release_branch=1.35 + GINKGO_SRC_DIR=vendor/github.com/onsi/ginkgo/v2/ginkgo + echo 'Building e2e.test binary from release branch 1.35...' Building e2e.test binary from release branch 1.35... + make all 'WHAT=cmd/kubectl test/e2e/e2e.test vendor/github.com/onsi/ginkgo/v2/ginkgo' go: downloading go1.25.4 (linux/amd64) +++ [1121 14:07:23] Building go targets for linux/amd64 github.com/onsi/ginkgo/v2/ginkgo (non-static) k8s.io/kubernetes/cmd/kubectl (static) k8s.io/kubernetes/test/e2e/e2e.test (test) + export PATH=/home/prow/go/src/k8s.io/kubernetes/_output/bin:/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + PATH=/home/prow/go/src/k8s.io/kubernetes/_output/bin:/home/prow/go/bin:/home/prow/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + echo 'Finished building e2e.test binary from 1.35.' Finished building e2e.test binary from 1.35. + run_e2e_tests + '[' ipv4 = ipv6 ']' + SKIP='\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' + FOCUS='\[Conformance\]' + LABEL_FILTER= + '[' -z '\[Conformance\]' ']' + '[' true = true ']' + export GINKGO_PARALLEL=y + GINKGO_PARALLEL=y + '[' -z '\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' ']' + SKIP='\[Serial\]|\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' + export KUBERNETES_CONFORMANCE_TEST=y + KUBERNETES_CONFORMANCE_TEST=y + export KUBE_CONTAINER_RUNTIME=remote + KUBE_CONTAINER_RUNTIME=remote + export KUBE_CONTAINER_RUNTIME_ENDPOINT=unix:///run/containerd/containerd.sock + KUBE_CONTAINER_RUNTIME_ENDPOINT=unix:///run/containerd/containerd.sock + export KUBE_CONTAINER_RUNTIME_NAME=containerd + KUBE_CONTAINER_RUNTIME_NAME=containerd + GINKGO_PID=242207 + wait 242207 + ./hack/ginkgo-e2e.sh --provider=skeleton --num-nodes=2 '--ginkgo.focus=\[Conformance\]' '--ginkgo.skip=\[Serial\]|\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' --ginkgo.label-filter= --report-dir=/logs/artifacts --disable-log-dump=true Conformance test: not doing test setup. + set +x + /home/prow/go/src/k8s.io/kubernetes/_output/bin/ginkgo --nodes=25 --poll-progress-after=60m --poll-progress-interval=5m --source-root=/home/prow/go/src/k8s.io/kubernetes/cluster/.. --timeout=24h --silence-skips --force-newlines --no-color /home/prow/go/src/k8s.io/kubernetes/_output/bin/e2e.test -- --kubeconfig=/root/.kube/kind-test-config --host=https://127.0.0.1:34981 --provider=skeleton --gce-project= --gce-zone= --gce-region= --gce-multizone=false --gke-cluster= --kube-master= --cluster-tag= --cloud-config-file= --repo-root=/home/prow/go/src/k8s.io/kubernetes/cluster/.. --node-instance-group= --prefix=e2e --network=e2e --node-tag= --master-tag= --docker-config-file= --dns-domain=cluster.local --prepull-images=false --report-complete-ginkgo --report-complete-junit --provider=skeleton --num-nodes=2 '--ginkgo.focus=\[Conformance\]' '--ginkgo.skip=\[Serial\]|\[Serial\]|Alpha|Disruptive|Slow|Flaky|IPv6|LoadBalancer|PodSecurityPolicy|nfs' --ginkgo.label-filter= --report-dir=/logs/artifacts --disable-log-dump=true Running Suite: Kubernetes e2e suite - /home/prow/go/src/k8s.io/kubernetes/_output/bin ===================================================================================== Random Seed: 1763734146 - will randomize all specs Will run 406 of 7348 specs Running in parallel across 25 processes • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • Ran 406 of 7348 Specs in 386.323 seconds SUCCESS! -- 406 Passed | 0 Failed | 0 Pending | 6942 Skipped Ginkgo ran 1 suite in 6m30.2197196s Test Suite Passed + cleanup + '[' false = true ']' + '[' true = true ']' + kind export logs /logs/artifacts Exporting logs for cluster "kind" to: /logs/artifacts + kind delete cluster Deleting cluster "kind" ... Deleted nodes: ["kind-control-plane" "kind-worker2" "kind-worker"] + rm -f _output/bin/e2e.test + '[' -n /tmp/kind-e2e-8vGJog ']' + rm -rf /tmp/kind-e2e-8vGJog + CLEANED_UP=true + exit 0 wrapper.sh] [TEST] Test Command exit code: 0 wrapper.sh] [CLEANUP] Waiting 30 seconds for pods stopped with terminationGracePeriod:30 wrapper.sh] [CLEANUP] Cleaning up after Docker in Docker ... wrapper.sh] [CLEANUP] Waiting for docker to stop for 30 seconds Stopping Docker: dockerProgram process in pidfile '/var/run/docker-ssd.pid', 1 process(es), refused to die. wrapper.sh] [CLEANUP] Done cleaning up after Docker in Docker. ================================================================================ wrapper.sh] Exiting 0