Docker in Docker enabled, initializing... ================================================================================ Starting Docker: docker. Waiting for docker to be ready, sleeping for 1 seconds. [Barnacle] 2019/12/11 23:49:22 Cleaning up Docker data root... [Barnacle] 2019/12/11 23:49:22 Removing all containers. [Barnacle] 2019/12/11 23:49:22 Removing recently created images. [Barnacle] 2019/12/11 23:49:22 Pruning dangling images. [Barnacle] 2019/12/11 23:49:22 Pruning volumes. [Barnacle] 2019/12/11 23:49:22 Volume Prune results: {"VolumesDeleted":[],"SpaceReclaimed":0} [Barnacle] 2019/12/11 23:49:22 Done cleaning up Docker data root. Remaining docker images and volumes are: REPOSITORY TAG IMAGE ID CREATED SIZE DRIVER VOLUME NAME Cleaning up binfmt_misc ... ================================================================================ Done setting up docker in docker. Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] + kubetest --test --up --down --deployment=acsengine --build=host-go --provider=azure --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.17 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-hyperkube --acsengine-location=westus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://gist.githubusercontent.com/chewong/facb90983ad2337a0049538cf82f9bf9/raw/5a5bad9e47b137a684f2fa98d645175315aa8161/linux.json --acsengine-download-url=https://chuwon.blob.core.windows.net/aks-engine/aks-engine-master-linux-amd64.tar.gz --ginkgo-parallel=5 '--test_args=--ginkgo.flakeAttempts=2 --ginkgo.focus=azure-disk --ginkgo.skip=\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|default\sfs.*should\sverify\scontainer\scannot\swrite\sto\ssubpath\sreadonly\svolumes' --timeout=420m 2019/12/11 23:49:23 main.go:332: Limiting testing to 7h0m0s 2019/12/11 23:49:23 azure.go:274: Reading credentials file /etc/azure-cred/credentials 2019/12/11 23:49:23 azure.go:823: CWD /home/prow/go/src/github.com/Azure/kubernetes 2019/12/11 23:49:23 azure.go:842: Attempting Docker login with azure cred. 2019/12/11 23:49:24 azure.go:851: Docker login success. 2019/12/11 23:49:24 process.go:153: Running: make -C /home/prow/go/src/k8s.io/kubernetes all make: Entering directory '/home/prow/go/src/k8s.io/kubernetes' make[1]: Entering directory '/home/prow/go/src/k8s.io/kubernetes' +++ [1211 23:49:32] Building go targets for linux/amd64: ./vendor/k8s.io/code-generator/cmd/deepcopy-gen +++ [1211 23:49:38] Building go targets for linux/amd64: ./vendor/k8s.io/code-generator/cmd/defaulter-gen +++ [1211 23:49:44] Building go targets for linux/amd64: ./vendor/k8s.io/code-generator/cmd/conversion-gen +++ [1211 23:49:54] Building go targets for linux/amd64: ./vendor/k8s.io/kube-openapi/cmd/openapi-gen +++ [1211 23:50:04] Building go targets for linux/amd64: ./vendor/github.com/go-bindata/go-bindata/go-bindata make[1]: Leaving directory '/home/prow/go/src/k8s.io/kubernetes' +++ [1211 23:50:06] Building go targets for linux/amd64: cmd/kube-proxy cmd/kube-apiserver cmd/kube-controller-manager cmd/kubelet cmd/kubeadm cmd/kube-scheduler vendor/k8s.io/apiextensions-apiserver cluster/gce/gci/mounter cmd/kubectl cmd/gendocs cmd/genkubedocs cmd/genman cmd/genyaml cmd/genswaggertypedocs cmd/linkcheck vendor/github.com/onsi/ginkgo/ginkgo test/e2e/e2e.test cluster/images/conformance/go-runner cmd/kubemark vendor/github.com/onsi/ginkgo/ginkgo test/e2e_node/e2e_node.test make: Leaving directory '/home/prow/go/src/k8s.io/kubernetes' 2019/12/11 23:54:34 process.go:155: Step 'make -C /home/prow/go/src/k8s.io/kubernetes all' finished in 5m9.792429792s 2019/12/11 23:54:34 util.go:265: Flushing memory. 2019/12/11 23:54:54 azure.go:1137: Deleting resource group: kubetest-dbc440ef-1c70-11ea-b07f-024230431169. 2019/12/11 23:54:55 azure.go:900: Building hyperkube. 2019/12/11 23:54:55 azure.go:916: Pushing hyperkube. 2019/12/11 23:54:55 process.go:153: Running: make -C /home/prow/go/src/k8s.io/kubernetes/cluster/images/hyperkube push 2019/12/11 23:56:25 process.go:155: Step 'make -C /home/prow/go/src/k8s.io/kubernetes/cluster/images/hyperkube push' finished in 1m29.712567006s 2019/12/11 23:56:25 azure.go:923: Custom hyperkube image: k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1204910662308859904 2019/12/11 23:56:25 azure.go:964: downloading /root/aks344659636/kubernetes.json from https://gist.githubusercontent.com/chewong/facb90983ad2337a0049538cf82f9bf9/raw/5a5bad9e47b137a684f2fa98d645175315aa8161/linux.json. 2019/12/11 23:56:25 util.go:42: curl https://gist.githubusercontent.com/chewong/facb90983ad2337a0049538cf82f9bf9/raw/5a5bad9e47b137a684f2fa98d645175315aa8161/linux.json 2019/12/11 23:56:25 azure.go:664: downloading /root/aks-engine.tar.gz from https://chuwon.blob.core.windows.net/aks-engine/aks-engine-master-linux-amd64.tar.gz. 2019/12/11 23:56:25 util.go:42: curl https://chuwon.blob.core.windows.net/aks-engine/aks-engine-master-linux-amd64.tar.gz 2019/12/11 23:56:25 azure.go:691: Extracting tar file /root/aks-engine.tar.gz into directory /home/prow/go/src/github.com/Azure/kubernetes . 2019/12/11 23:56:25 process.go:153: Running: tar -xzf /root/aks-engine.tar.gz --strip 1 2019/12/11 23:56:25 process.go:155: Step 'tar -xzf /root/aks-engine.tar.gz --strip 1' finished in 116.497161ms 2019/12/11 23:56:25 process.go:153: Running: /home/prow/go/src/github.com/Azure/kubernetes/aks-engine generate /root/aks344659636/kubernetes.json --output-directory /root/aks344659636 Error: validating API model after populating values: customHyperkubeImage has no effect in Kubernetes version 1.17.0 or above Usage: aks-engine generate [flags] Flags: -m, --api-model string path to your cluster definition file --ca-certificate-path string path to the CA certificate to use for Kubernetes PKI assets --ca-private-key-path string path to the CA private key to use for Kubernetes PKI assets --client-id string client id --client-secret string client secret -h, --help help for generate --no-pretty-print skip pretty printing the output -o, --output-directory string output directory (derived from FQDN if absent) --parameters-only only output parameters files --set stringArray set values on the command line (can specify multiple or separate values with commas: key1=val1,key2=val2) Global Flags: --debug enable verbose debug logs 2019/12/11 23:56:25 process.go:155: Step '/home/prow/go/src/github.com/Azure/kubernetes/aks-engine generate /root/aks344659636/kubernetes.json --output-directory /root/aks344659636' finished in 164.97396ms 2019/12/11 23:56:25 azure.go:1137: Deleting resource group: kubetest-dbc440ef-1c70-11ea-b07f-024230431169. 2019/12/11 23:56:25 main.go:319: Something went wrong: starting e2e cluster: failed to generate ARM templates: failed to generate ARM templates: error during /home/prow/go/src/github.com/Azure/kubernetes/aks-engine generate /root/aks344659636/kubernetes.json --output-directory /root/aks344659636: exit status 1. + EXIT_VALUE=1 + set +o xtrace Cleaning up after docker in docker. ================================================================================ [Barnacle] 2019/12/11 23:56:25 Cleaning up Docker data root... [Barnacle] 2019/12/11 23:56:25 Removing all containers. [Barnacle] 2019/12/11 23:56:25 Removing recently created images. [Barnacle] 2019/12/11 23:56:25 Deleting image: [k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1204910662308859904 k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1204910662308859904] with ID: sha256:794f07cd3752c2480c95dacb6625f38349de4bef5217ee051ac1eb538cda7b6c and size 855010756 [Barnacle] 2019/12/11 23:56:25 Pruning dangling images. [Barnacle] 2019/12/11 23:56:25 Pruning volumes. [Barnacle] 2019/12/11 23:56:25 Volume Prune results: {"VolumesDeleted":[],"SpaceReclaimed":0} [Barnacle] 2019/12/11 23:56:25 Done cleaning up Docker data root. Remaining docker images and volumes are: REPOSITORY TAG IMAGE ID CREATED SIZE k8s.gcr.io/debian-hyperkube-base-amd64 0.12.1 a46476511725 10 months ago 393MB DRIVER VOLUME NAME Cleaning up binfmt_misc ... ================================================================================ Done cleaning up after docker in docker.