W0314 04:26:10.124] bootstrap.py is deprecated! Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md I0314 04:26:10.124] Args: --job=fei-e2e-ccm --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=fei-e2e-ccm --repo=k8s.io/kubernetes=v1.14.0-alpha.1 --repo=github.com/feiskyer/cloud-provider-azure=master:4c53be1a930a8929120745a3dfb072f51b12460b,4:6117870c016c425b1dfb244a7a2b7fa71566ab18 --root=/go/src --service-account=/etc/service-account/service-account.json --timeout=200 --upload=gs://kubernetes-upstream/pr-logs --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=3 --acsengine-admin-username=azureuser '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.14 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-ccm=True --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://gist.githubusercontent.com/ritazh/ddab154ac18e22d776efb067da5ac058/raw/b5f284c759c9eabcc6576250d61f757f1436764a/ccm.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.31.2/aks-engine-v0.31.2-linux-amd64.tar.gz --timeout=420m I0314 04:26:10.124] Bootstrap fei-e2e-ccm... I0314 04:26:10.129] Builder: 3af5819f-4611-11e9-918b-16773c0c7aed I0314 04:26:10.130] Image: gcr.io/k8s-testimages/kubekins-e2e:v20190313-3d10a416d-master I0314 04:26:10.130] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176 I0314 04:26:10.130] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0314 04:26:10.612] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I0314 04:26:10.648] process 207 exited with code 0 after 0.0m I0314 04:26:10.648] Call: gcloud config get-value account I0314 04:26:10.921] process 219 exited with code 0 after 0.0m I0314 04:26:10.922] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I0314 04:26:10.922] Root: /go/src I0314 04:26:10.922] cd to /go/src I0314 04:26:10.922] Checkout: /go/src/k8s.io/kubernetes v1.14.0-alpha.1 to /go/src/k8s.io/kubernetes I0314 04:26:10.922] Call: git init k8s.io/kubernetes I0314 04:26:10.929] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/ I0314 04:26:10.929] process 231 exited with code 0 after 0.0m I0314 04:26:10.929] Call: git config --local user.name 'K8S Bootstrap' I0314 04:26:10.933] process 232 exited with code 0 after 0.0m I0314 04:26:10.933] Call: git config --local user.email k8s_bootstrap@localhost I0314 04:26:10.936] process 233 exited with code 0 after 0.0m I0314 04:26:10.936] Call: git fetch --quiet --tags https://github.com/kubernetes/kubernetes v1.14.0-alpha.1 I0314 04:27:11.954] process 234 exited with code 0 after 1.0m I0314 04:27:11.955] Call: git checkout -B test FETCH_HEAD W0314 04:27:14.277] Switched to a new branch 'test' I0314 04:27:14.290] process 249 exited with code 0 after 0.0m I0314 04:27:14.291] Call: git show -s --format=format:%ct HEAD I0314 04:27:14.321] process 250 exited with code 0 after 0.0m I0314 04:27:14.322] Checkout: /go/src/github.com/feiskyer/cloud-provider-azure master:4c53be1a930a8929120745a3dfb072f51b12460b,4:6117870c016c425b1dfb244a7a2b7fa71566ab18 to /go/src/github.com/feiskyer/cloud-provider-azure I0314 04:27:14.322] Call: git init github.com/feiskyer/cloud-provider-azure I0314 04:27:14.327] Initialized empty Git repository in /go/src/github.com/feiskyer/cloud-provider-azure/.git/ I0314 04:27:14.327] process 251 exited with code 0 after 0.0m I0314 04:27:14.327] Call: git config --local user.name 'K8S Bootstrap' I0314 04:27:14.331] process 252 exited with code 0 after 0.0m I0314 04:27:14.331] Call: git config --local user.email k8s_bootstrap@localhost I0314 04:27:14.336] process 253 exited with code 0 after 0.0m I0314 04:27:14.336] Call: git fetch --quiet --tags https://github.com/feiskyer/cloud-provider-azure master +refs/pull/4/head:refs/pr/4 I0314 04:27:15.886] process 254 exited with code 0 after 0.0m I0314 04:27:15.887] Call: git checkout -B test 4c53be1a930a8929120745a3dfb072f51b12460b W0314 04:27:16.253] Switched to a new branch 'test' I0314 04:27:16.256] process 266 exited with code 0 after 0.0m I0314 04:27:16.256] Call: git show -s --format=format:%ct HEAD I0314 04:27:16.260] process 267 exited with code 0 after 0.0m I0314 04:27:16.260] Call: git merge --no-ff -m 'Merge +refs/pull/4/head:refs/pr/4' 6117870c016c425b1dfb244a7a2b7fa71566ab18 I0314 04:27:16.593] Merge made by the 'recursive' strategy. I0314 04:27:16.595] tests/e2e/utils/service_utils.go | 6 +++++- I0314 04:27:16.595] tests/e2e/utils/utils.go | 2 +- I0314 04:27:16.595] 2 files changed, 6 insertions(+), 2 deletions(-) I0314 04:27:16.595] process 268 exited with code 0 after 0.0m I0314 04:27:16.596] Configure environment... I0314 04:27:16.596] Call: git show -s --format=format:%ct HEAD I0314 04:27:16.627] process 270 exited with code 0 after 0.0m I0314 04:27:16.627] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0314 04:27:17.127] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I0314 04:27:17.247] process 271 exited with code 0 after 0.0m I0314 04:27:17.248] Call: gcloud config get-value account I0314 04:27:17.506] process 283 exited with code 0 after 0.0m I0314 04:27:17.506] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I0314 04:27:17.507] Call: bash -c ' set -o errexit set -o nounset export KUBE_ROOT=. source hack/lib/version.sh kube::version::get_version_vars echo $KUBE_GIT_VERSION ' I0314 04:27:17.779] process 295 exited with code 0 after 0.0m I0314 04:27:17.779] Start 1106048774653874176 at v1.14.0-alpha.1... I0314 04:27:17.781] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_XRjzj5 gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/started.json I0314 04:27:19.382] process 325 exited with code 0 after 0.0m I0314 04:27:19.383] Call: gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176' cp /tmp/gsutil_38kYYY gs://kubernetes-upstream/pr-logs/directory/fei-e2e-ccm/1106048774653874176.txt I0314 04:27:20.927] process 503 exited with code 0 after 0.0m I0314 04:27:20.928] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=3 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.14 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-ccm=True --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://gist.githubusercontent.com/ritazh/ddab154ac18e22d776efb067da5ac058/raw/b5f284c759c9eabcc6576250d61f757f1436764a/ccm.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.31.2/aks-engine-v0.31.2-linux-amd64.tar.gz --timeout=420m W0314 04:27:20.972] starts with local mode W0314 04:27:20.973] Environment: W0314 04:27:20.973] ARTIFACTS=/workspace/_artifacts W0314 04:27:20.974] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W0314 04:27:20.974] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W0314 04:27:20.974] AZURE_CREDENTIALS=/etc/azure-cred/credentials W0314 04:27:20.974] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub W0314 04:27:20.974] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer W0314 04:27:20.975] BAZEL_REMOTE_CACHE_ENABLED=false W0314 04:27:20.975] BAZEL_VERSION=0.21.0 W0314 04:27:20.975] BOOTSTRAP_MIGRATION=yes W0314 04:27:20.975] BUILD_ID=1106048774653874176 W0314 04:27:20.975] BUILD_NUMBER=1106048774653874176 W0314 04:27:20.976] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W0314 04:27:20.976] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud W0314 04:27:20.976] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W0314 04:27:20.976] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W0314 04:27:20.976] CLOUD_CONFIG=random W0314 04:27:20.976] DECK_PORT=tcp://10.0.160.83:80 W0314 04:27:20.977] DECK_PORT_80_TCP=tcp://10.0.160.83:80 W0314 04:27:20.977] DECK_PORT_80_TCP_ADDR=10.0.160.83 W0314 04:27:20.977] DECK_PORT_80_TCP_PORT=80 W0314 04:27:20.977] DECK_PORT_80_TCP_PROTO=tcp W0314 04:27:20.977] DECK_SERVICE_HOST=10.0.160.83 W0314 04:27:20.977] DECK_SERVICE_PORT=80 W0314 04:27:20.977] DOCKER_IN_DOCKER_ENABLED=true W0314 04:27:20.978] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/artifacts W0314 04:27:20.978] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W0314 04:27:20.978] GOPATH=/go W0314 04:27:20.978] GO_TARBALL=go1.12.linux-amd64.tar.gz W0314 04:27:20.978] HOME=/workspace W0314 04:27:20.979] HOOK_PORT=tcp://10.0.144.133:8888 W0314 04:27:20.979] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888 W0314 04:27:20.979] HOOK_PORT_8888_TCP_ADDR=10.0.144.133 W0314 04:27:20.979] HOOK_PORT_8888_TCP_PORT=8888 W0314 04:27:20.979] HOOK_PORT_8888_TCP_PROTO=tcp W0314 04:27:20.979] HOOK_SERVICE_HOST=10.0.144.133 W0314 04:27:20.979] HOOK_SERVICE_PORT=8888 W0314 04:27:20.980] HOSTNAME=3af5819f-4611-11e9-918b-16773c0c7aed W0314 04:27:20.980] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20190313-3d10a416d-master W0314 04:27:20.980] INSTANCE_PREFIX=bootstrap-e2e W0314 04:27:20.980] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine W0314 04:27:20.980] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub W0314 04:27:20.980] JOB_NAME=fei-e2e-ccm W0314 04:27:20.981] JOB_SPEC={"type":"presubmit","job":"fei-e2e-ccm","buildid":"1106048774653874176","prowjobid":"3af5819f-4611-11e9-918b-16773c0c7aed","refs":{"org":"feiskyer","repo":"cloud-provider-azure","repo_link":"https://github.com/feiskyer/cloud-provider-azure","base_ref":"master","base_sha":"4c53be1a930a8929120745a3dfb072f51b12460b","base_link":"https://github.com/feiskyer/cloud-provider-azure/commit/4c53be1a930a8929120745a3dfb072f51b12460b","pulls":[{"number":4,"author":"feiskyer","sha":"6117870c016c425b1dfb244a7a2b7fa71566ab18","link":"https://github.com/feiskyer/cloud-provider-azure/pull/4","commit_link":"https://github.com/feiskyer/cloud-provider-azure/pull/4/commits/6117870c016c425b1dfb244a7a2b7fa71566ab18","author_link":"https://github.com/feiskyer"}]}} W0314 04:27:20.981] JOB_TYPE=presubmit W0314 04:27:20.981] KUBERNETES_PORT=tcp://10.0.0.1:443 W0314 04:27:20.982] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443 W0314 04:27:20.982] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1 W0314 04:27:20.982] KUBERNETES_PORT_443_TCP_PORT=443 W0314 04:27:20.982] KUBERNETES_PORT_443_TCP_PROTO=tcp W0314 04:27:20.982] KUBERNETES_SERVICE_HOST=10.0.0.1 W0314 04:27:20.982] KUBERNETES_SERVICE_PORT=443 W0314 04:27:20.983] KUBERNETES_SERVICE_PORT_HTTPS=443 W0314 04:27:20.983] KUBETEST_IN_DOCKER=true W0314 04:27:20.983] KUBETEST_MANUAL_DUMP=y W0314 04:27:20.983] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W0314 04:27:20.983] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W0314 04:27:20.983] KUBE_VERBOSE=0 W0314 04:27:20.983] NODE_NAME=3af5819f-4611-11e9-918b-16773c0c7aed W0314 04:27:20.984] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W0314 04:27:20.984] PROW_JOB_ID=3af5819f-4611-11e9-918b-16773c0c7aed W0314 04:27:20.984] PULL_BASE_REF=master W0314 04:27:20.984] PULL_BASE_SHA=4c53be1a930a8929120745a3dfb072f51b12460b W0314 04:27:20.984] PULL_NUMBER=4 W0314 04:27:20.984] PULL_PULL_SHA=6117870c016c425b1dfb244a7a2b7fa71566ab18 W0314 04:27:20.985] PULL_REFS=master:4c53be1a930a8929120745a3dfb072f51b12460b,4:6117870c016c425b1dfb244a7a2b7fa71566ab18 W0314 04:27:20.985] PWD=/workspace W0314 04:27:20.985] REGISTRY=k8sprowinternal.azurecr.io W0314 04:27:20.985] REPO_NAME=cloud-provider-azure W0314 04:27:20.985] REPO_OWNER=feiskyer W0314 04:27:20.985] SHLVL=2 W0314 04:27:20.986] SOURCE_DATE_EPOCH=1547549196 W0314 04:27:20.986] TERM=xterm W0314 04:27:20.986] TIDE_PORT=tcp://10.0.180.53:80 W0314 04:27:20.986] TIDE_PORT_80_TCP=tcp://10.0.180.53:80 W0314 04:27:20.986] TIDE_PORT_80_TCP_ADDR=10.0.180.53 W0314 04:27:20.986] TIDE_PORT_80_TCP_PORT=80 W0314 04:27:20.986] TIDE_PORT_80_TCP_PROTO=tcp W0314 04:27:20.987] TIDE_SERVICE_HOST=10.0.180.53 W0314 04:27:20.987] TIDE_SERVICE_PORT=80 W0314 04:27:20.987] WORKSPACE=/workspace W0314 04:27:20.987] _=./test-infra/jenkins/bootstrap.py W0314 04:27:20.988] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=3', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.14', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://gist.githubusercontent.com/ritazh/ddab154ac18e22d776efb067da5ac058/raw/b5f284c759c9eabcc6576250d61f757f1436764a/ccm.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.31.2/aks-engine-v0.31.2-linux-amd64.tar.gz', '--timeout=420m') W0314 04:27:20.991] 2019/03/14 04:27:20 main.go:320: Limiting testing to 7h0m0s W0314 04:27:20.991] 2019/03/14 04:27:20 azure.go:112: Reading credentials file /etc/azure-cred/credentials W0314 04:27:20.992] 2019/03/14 04:27:20 process.go:153: Running: make -C /go/src/k8s.io/kubernetes bazel-release W0314 04:27:21.008] WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files: W0314 04:27:21.008] /go/src/k8s.io/kubernetes/.bazelrc W0314 04:27:21.009] Extracting Bazel installation... I0314 04:27:21.110] make: Entering directory '/go/src/k8s.io/kubernetes' W0314 04:27:37.010] Starting local Bazel server and connecting to it... W0314 04:27:39.414] INFO: Invocation ID: 7b2c9932-1fb9-4c79-abdb-8cba97839a64 W0314 04:27:39.668] Loading: W0314 04:27:39.672] Loading: 0 packages loaded W0314 04:27:40.675] Loading: 0 packages loaded W0314 04:27:41.676] Loading: 0 packages loaded W0314 04:27:43.375] Loading: 0 packages loaded W0314 04:27:44.678] Loading: 0 packages loaded W0314 04:27:44.678] currently loading: build/release-tars W0314 04:27:46.567] Loading: 0 packages loaded W0314 04:27:46.568] currently loading: build/release-tars W0314 04:27:47.080] Analyzing: target //build/release-tars:release-tars (1 packages loaded, 0 targets configured) W0314 04:27:48.241] Analyzing: target //build/release-tars:release-tars (23 packages loaded, 33 targets configured) W0314 04:27:50.248] Analyzing: target //build/release-tars:release-tars (37 packages loaded, 725 targets configured) W0314 04:27:52.075] Analyzing: target //build/release-tars:release-tars (51 packages loaded, 1190 targets configured) W0314 04:27:54.055] Analyzing: target //build/release-tars:release-tars (58 packages loaded, 1199 targets configured) W0314 04:28:00.117] Analyzing: target //build/release-tars:release-tars (58 packages loaded, 1199 targets configured) W0314 04:28:01.117] INFO: SHA256 (https://codeload.github.com/golang/tools/zip/3e7aa9e59977626dc60433e9aeadf1bb63d28295) = 2384fa91351a7414b643c5230422ce45f5aa2be8a82727609afd4e64e6973a30 W0314 04:28:03.234] Analyzing: target //build/release-tars:release-tars (434 packages loaded, 7560 targets configured) W0314 04:28:06.890] Analyzing: target //build/release-tars:release-tars (963 packages loaded, 9029 targets configured) W0314 04:28:11.013] Analyzing: target //build/release-tars:release-tars (1465 packages loaded, 13377 targets configured) W0314 04:28:15.757] Analyzing: target //build/release-tars:release-tars (2036 packages loaded, 19644 targets configured) W0314 04:28:21.698] Analyzing: target //build/release-tars:release-tars (2251 packages loaded, 24931 targets configured) W0314 04:28:27.779] INFO: Analysed target //build/release-tars:release-tars (2252 packages loaded, 25182 targets configured). W0314 04:28:27.809] INFO: Found 1 target... W0314 04:28:28.625] [0 / 9] [-----] Writing file build/release-tars/_server-addons.args W0314 04:28:36.297] [69 / 3,380] GoCompile vendor/github.com/spf13/pflag/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/spf13/pflag.a [for host]; 1s linux-sandbox ... (8 actions running) W0314 04:28:45.125] [93 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 4s linux-sandbox ... (6 actions, 5 running) W0314 04:28:55.393] [112 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 14s linux-sandbox ... (8 actions, 7 running) W0314 04:29:07.928] [134 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 27s linux-sandbox ... (8 actions running) W0314 04:29:23.018] [164 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 42s linux-sandbox ... (8 actions running) W0314 04:29:38.653] [208 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 58s linux-sandbox ... (8 actions running) W0314 04:29:56.974] [258 / 3,380] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 76s linux-sandbox ... (5 actions running) W0314 04:30:21.839] [321 / 3,380] GoCompile vendor/github.com/vmware/govmomi/vim25/types/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/vmware/govmomi/vim25/types.a; 21s linux-sandbox ... (8 actions running) W0314 04:30:46.635] [377 / 3,380] GoCompile vendor/github.com/pborman/uuid/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/pborman/uuid.a; 4s linux-sandbox ... (8 actions, 7 running) W0314 04:31:14.909] [444 / 3,380] GoCompile vendor/golang.org/x/crypto/ed25519/internal/edwards25519/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/golang.org/x/crypto/ed25519/internal/edwards25519.a; 3s linux-sandbox ... (8 actions running) W0314 04:31:47.604] [507 / 3,380] GoCompile staging/src/k8s.io/apimachinery/pkg/conversion/queryparams/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/conversion/queryparams.a; 2s linux-sandbox ... (8 actions running) W0314 04:32:25.471] [583 / 3,380] GoCompile vendor/github.com/spf13/pflag/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/spf13/pflag.a; 6s linux-sandbox ... (8 actions, 7 running) W0314 04:33:09.146] [682 / 3,380] GoCompile vendor/github.com/Azure/go-autorest/autorest/date/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/Azure/go-autorest/autorest/date.a; 4s linux-sandbox ... (7 actions running) W0314 04:33:59.737] [776 / 3,380] GoCompile vendor/github.com/coreos/etcd/raft/raftpb/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/coreos/etcd/raft/raftpb.a; 5s linux-sandbox ... (8 actions, 7 running) W0314 04:34:57.398] [869 / 3,380] GoCompile vendor/github.com/pelletier/go-toml/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/pelletier/go-toml.a; 3s linux-sandbox ... (8 actions, 7 running) W0314 04:36:03.830] [1,410 / 3,380] GoCompile pkg/cloudprovider/providers/vsphere/vclib/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/cloudprovider/providers/vsphere/vclib.a; 3s linux-sandbox ... (8 actions running) W0314 04:37:19.779] [1,596 / 3,380] GoCompile vendor/github.com/go-openapi/strfmt/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/go-openapi/strfmt.a; 4s linux-sandbox ... (8 actions running) W0314 04:38:50.105] [1,765 / 3,419] GoCompile vendor/github.com/vmware/govmomi/vim25/types/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/vmware/govmomi/vim25/types.a; 24s linux-sandbox ... (8 actions, 7 running) W0314 04:40:14.429] INFO: From : W0314 04:40:14.432] 2019/03/14 04:40:06 Code for OpenAPI definitions generated W0314 04:40:31.028] [1,906 / 3,469] GoCompile staging/src/k8s.io/apiextensions-apiserver/pkg/apis/apiextensions/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiextensions-apiserver/pkg/apis/apiextensions.a; 5s linux-sandbox ... (8 actions, 7 running) W0314 04:42:28.326] [2,088 / 3,469] GoCompile staging/src/k8s.io/apiserver/pkg/audit/util/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/audit/util.a; 4s linux-sandbox ... (8 actions, 7 running) W0314 04:44:41.888] [2,343 / 3,469] GoCompile pkg/apis/core/helper/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/apis/core/helper.a; 3s linux-sandbox ... (8 actions running) W0314 04:47:15.557] [2,604 / 3,469] GoLink cmd/gendocs/linux_amd64_stripped/gendocs; 22s linux-sandbox ... (8 actions, 7 running) W0314 04:50:12.023] [2,872 / 3,469] GoCompile pkg/cloudprovider/providers/gce/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/cloudprovider/providers/gce.a; 12s linux-sandbox ... (8 actions running) W0314 04:53:35.211] [3,118 / 3,663] GoLink cmd/genman/linux_amd64_stripped/genman; 105s linux-sandbox ... (8 actions running) W0314 04:57:29.079] [3,411 / 3,850] GoCompile staging/src/k8s.io/api/core/v1/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/api/core/v1.a; 16s linux-sandbox ... (7 actions running) W0314 05:01:58.251] [3,816 / 3,909] GoLink cmd/kubelet/linux_amd64_stripped/kubelet; 102s linux-sandbox ... (8 actions running) W0314 05:07:07.375] [4,311 / 4,433] GoLink cmd/cloud-controller-manager/linux_amd64_pure_stripped/cloud-controller-manager; 51s linux-sandbox ... (8 actions, 7 running) W0314 05:11:02.830] Slow read: a 1450682-byte read from /workspace/.cache/bazel/_bazel_root/48d5366022b4e3197674c8d6e2bee219/execroot/__main__/bazel-out/k8-fastbuild/bin/staging/src/k8s.io/apiextensions-apiserver/pkg/apiserver/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.a took 5228 ms. W0314 05:13:04.174] [4,692 / 4,694] PackageTar build/release-tars/_server-bin.tar; 4s linux-sandbox W0314 05:13:53.773] Target //build/release-tars:release-tars up-to-date: W0314 05:13:53.774] bazel-bin/build/release-tars/kubernetes.tar.gz W0314 05:13:53.774] bazel-bin/build/release-tars/kubernetes-client-linux-amd64.tar.gz W0314 05:13:53.777] bazel-bin/build/release-tars/kubernetes-node-linux-amd64.tar.gz W0314 05:13:53.777] bazel-bin/build/release-tars/kubernetes-server-linux-amd64.tar.gz W0314 05:13:53.778] bazel-bin/build/release-tars/kubernetes-manifests.tar.gz W0314 05:13:53.778] bazel-bin/build/release-tars/kubernetes-src.tar.gz W0314 05:13:53.778] bazel-bin/build/release-tars/kubernetes-test.tar.gz W0314 05:13:53.823] INFO: Elapsed time: 2792.720s, Critical Path: 624.29s W0314 05:13:53.823] INFO: 4601 processes: 4601 linux-sandbox. W0314 05:13:53.832] INFO: Build completed successfully, 4694 total actions W0314 05:13:53.834] INFO: Build completed successfully, 4694 total actions W0314 05:13:53.841] 2019/03/14 05:13:53 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 46m32.849688307s W0314 05:13:53.842] 2019/03/14 05:13:53 util.go:255: Flushing memory. I0314 05:13:53.942] make: Leaving directory '/go/src/k8s.io/kubernetes' W0314 05:14:05.089] 2019/03/14 05:14:05 azure.go:666: Deleting resource group: kubetest-756c065c-4611-11e9-906b-0242b7c8d9da. W0314 05:14:05.532] 2019/03/14 05:14:05 azure.go:422: CWD /go/src/k8s.io/kubernetes W0314 05:14:05.532] 2019/03/14 05:14:05 azure.go:441: Attempting Docker login with azure cred. W0314 05:14:06.581] 2019/03/14 05:14:06 azure.go:450: Docker login success. W0314 05:14:06.581] 2019/03/14 05:14:06 azure.go:465: Building ccm. W0314 05:14:06.582] 2019/03/14 05:14:06 util.go:46: Warning: Couldn't find directory src/k8s.io/cloud-provider-azure under any of GOPATH /go, defaulting to /go/src/k8s.io/cloud-provider-azure W0314 05:14:06.582] 2019/03/14 05:14:06 azure.go:467: projectPath /go/src/k8s.io/cloud-provider-azure W0314 05:14:06.582] 2019/03/14 05:14:06 process.go:153: Running: docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1106048774653874176-fd0f07d5 . W0314 05:14:06.582] 2019/03/14 05:14:06 process.go:155: Step 'docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1106048774653874176-fd0f07d5 .' finished in 254.502µs W0314 05:14:06.583] 2019/03/14 05:14:06 azure.go:666: Deleting resource group: kubetest-756c065c-4611-11e9-906b-0242b7c8d9da. W0314 05:14:06.593] 2019/03/14 05:14:06 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W0314 05:14:06.593] 2019/03/14 05:14:06 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W0314 05:14:07.396] 2019/03/14 05:14:07 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 802.623165ms W0314 05:14:07.397] 2019/03/14 05:14:07 main.go:307: Something went wrong: starting e2e cluster: error building cloud controller manager error starting docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1106048774653874176-fd0f07d5 .: fork/exec /usr/bin/docker: no such file or directory W0314 05:14:07.399] Traceback (most recent call last): W0314 05:14:07.399] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 764, in W0314 05:14:07.400] main(parse_args()) W0314 05:14:07.400] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 615, in main W0314 05:14:07.400] mode.start(runner_args) W0314 05:14:07.400] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W0314 05:14:07.400] check_env(env, self.command, *args) W0314 05:14:07.400] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W0314 05:14:07.401] subprocess.check_call(cmd, env=env) W0314 05:14:07.401] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W0314 05:14:07.401] raise CalledProcessError(retcode, cmd) W0314 05:14:07.401] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=3', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.14', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://gist.githubusercontent.com/ritazh/ddab154ac18e22d776efb067da5ac058/raw/b5f284c759c9eabcc6576250d61f757f1436764a/ccm.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.31.2/aks-engine-v0.31.2-linux-amd64.tar.gz', '--timeout=420m')' returned non-zero exit status 1 E0314 05:14:07.407] Command failed I0314 05:14:07.407] process 681 exited with code 1 after 46.8m E0314 05:14:07.407] FAIL: fei-e2e-ccm I0314 05:14:07.407] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0314 05:14:08.200] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I0314 05:14:08.236] process 7766 exited with code 0 after 0.0m I0314 05:14:08.236] Call: gcloud config get-value account I0314 05:14:08.500] process 7778 exited with code 0 after 0.0m I0314 05:14:08.501] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I0314 05:14:08.501] Upload result and artifacts... I0314 05:14:08.501] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176 I0314 05:14:08.502] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/artifacts W0314 05:14:09.867] CommandException: One or more URLs matched no objects. E0314 05:14:09.972] Command failed I0314 05:14:09.972] process 7790 exited with code 1 after 0.0m W0314 05:14:09.972] Remote dir gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/artifacts not exist yet I0314 05:14:09.973] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/artifacts I0314 05:14:11.741] process 7932 exited with code 0 after 0.0m I0314 05:14:11.741] Call: git rev-parse HEAD I0314 05:14:11.746] process 8456 exited with code 0 after 0.0m I0314 05:14:11.746] Call: git rev-parse HEAD I0314 05:14:11.751] process 8457 exited with code 0 after 0.0m I0314 05:14:11.751] Call: gsutil stat gs://kubernetes-upstream/pr-logs/directory/fei-e2e-ccm/jobResultsCache.json I0314 05:14:12.824] process 8458 exited with code 0 after 0.0m I0314 05:14:12.825] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/fei-e2e-ccm/jobResultsCache.json#1552534165005830' I0314 05:14:14.082] process 8600 exited with code 0 after 0.0m I0314 05:14:14.083] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1552534165005830 cp /tmp/gsutil_gv9lOY gs://kubernetes-upstream/pr-logs/directory/fei-e2e-ccm/jobResultsCache.json I0314 05:14:15.559] process 8744 exited with code 0 after 0.0m I0314 05:14:15.560] Call: gsutil stat gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/jobResultsCache.json I0314 05:14:16.629] process 8922 exited with code 0 after 0.0m I0314 05:14:16.630] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/jobResultsCache.json#1552534167560877' I0314 05:14:17.863] process 9064 exited with code 0 after 0.0m I0314 05:14:17.864] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1552534167560877 cp /tmp/gsutil_YIJNpv gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/jobResultsCache.json I0314 05:14:19.441] process 9208 exited with code 0 after 0.0m I0314 05:14:19.442] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_RwuaqY gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/1106048774653874176/finished.json I0314 05:14:20.870] process 9386 exited with code 0 after 0.0m I0314 05:14:20.871] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_F_trNU gs://kubernetes-upstream/pr-logs/directory/fei-e2e-ccm/latest-build.txt I0314 05:14:22.376] process 9564 exited with code 0 after 0.0m I0314 05:14:22.377] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_rxYeiP gs://kubernetes-upstream/pr-logs/pull/feiskyer_cloud-provider-azure/4/fei-e2e-ccm/latest-build.txt I0314 05:14:23.897] process 9742 exited with code 0 after 0.0m