INFO[2024-08-10T05:44:09Z] ci-operator version v20240809-280ef67b6      
INFO[2024-08-10T05:44:09Z] Loading configuration from https://config.ci.openshift.org for openshift/cluster-node-tuning-operator@master 
INFO[2024-08-10T05:44:10Z] Resolved source https://github.com/openshift/cluster-node-tuning-operator to master@6d625b5a, merging: #1129 e9952ee6 @ffromani 
WARN[2024-08-10T05:44:10Z] skipped directory "..2024_08_10_05_43_57.1281063494" when creating secret from directory "/secrets/ci-pull-credentials" 
WARN[2024-08-10T05:44:10Z] skipped directory "..2024_08_10_05_43_57.3063485441" when creating secret from directory "/usr/local/e2e-aws-operator-cluster-profile" 
INFO[2024-08-10T05:44:10Z] Loading information from https://config.ci.openshift.org for integrated stream ocp/4.18 
INFO[2024-08-10T05:44:10Z] Loading information from https://config.ci.openshift.org for integrated stream ocp/4.18 
INFO[2024-08-10T05:44:10Z] Building release initial from a snapshot of ocp/4.18 
INFO[2024-08-10T05:44:10Z] Building release latest from a snapshot of ocp/4.18 
INFO[2024-08-10T05:44:10Z] Using namespace https://console-openshift-console.apps.build03.ky4t.p1.openshiftapps.com/k8s/cluster/projects/ci-op-q69b2z86 
INFO[2024-08-10T05:44:10Z] Running [input:root], [input:ocp_4.17_base-rhel9], [input:ocp_builder_rhel-9-golang-1.22-openshift-4.17], [input:origin-centos-8], [input:ocp-4.12-upi-installer], [input:ocp-4.14-upi-installer], [input:ocp-4.16-upi-installer], [release-inputs:initial], [release-inputs:latest], src, cluster-node-tuning-operator, [output:stable:cluster-node-tuning-operator], [images], [release:latest], e2e-aws-operator 
INFO[2024-08-10T05:44:10Z] Tagging ocp/4.14:upi-installer into pipeline:ocp-4.14-upi-installer. 
INFO[2024-08-10T05:44:10Z] Tagging openshift/release:rhel-9-release-golang-1.22-openshift-4.17 into pipeline:root. 
INFO[2024-08-10T05:44:10Z] Tagging ocp/4.16:upi-installer into pipeline:ocp-4.16-upi-installer. 
INFO[2024-08-10T05:44:10Z] Tagging origin/centos:8 into pipeline:origin-centos-8. 
INFO[2024-08-10T05:44:10Z] Tagging ocp/4.12:upi-installer into pipeline:ocp-4.12-upi-installer. 
INFO[2024-08-10T05:44:10Z] Tagging ocp/builder:rhel-9-golang-1.22-openshift-4.17 into pipeline:ocp_builder_rhel-9-golang-1.22-openshift-4.17. 
INFO[2024-08-10T05:44:10Z] Tagging ocp/4.18:base-rhel9 into pipeline:ocp_4.17_base-rhel9. 
INFO[2024-08-10T05:44:10Z] Waiting to import tags on imagestream (after taking snapshot) ci-op-q69b2z86/stable-initial ... 
INFO[2024-08-10T05:44:10Z] Waiting to import tags on imagestream (after taking snapshot) ci-op-q69b2z86/stable ... 
INFO[2024-08-10T05:44:16Z] Building src                                 
INFO[2024-08-10T05:44:16Z] Found existing build "src-amd64"             
INFO[2024-08-10T05:45:51Z] Build src-amd64 succeeded after 1m35s        
INFO[2024-08-10T05:45:51Z] Image ci-op-q69b2z86/pipeline:src created     for-build=src
INFO[2024-08-10T05:45:51Z] Building cluster-node-tuning-operator        
INFO[2024-08-10T05:45:52Z] Created build "cluster-node-tuning-operator-amd64" 
INFO[2024-08-10T05:47:11Z] Imported tags on imagestream (after taking snapshot) ci-op-q69b2z86/stable-initial 
INFO[2024-08-10T05:47:11Z] Imported tags on imagestream (after taking snapshot) ci-op-q69b2z86/stable 
INFO[2024-08-10T05:49:22Z] Build cluster-node-tuning-operator-amd64 succeeded after 3m30s 
INFO[2024-08-10T05:49:23Z] Image ci-op-q69b2z86/pipeline:cluster-node-tuning-operator created  for-build=cluster-node-tuning-operator
INFO[2024-08-10T05:49:23Z] Tagging cluster-node-tuning-operator into stable 
INFO[2024-08-10T05:49:23Z] Creating release image registry.build03.ci.openshift.org/ci-op-q69b2z86/release:latest. 
INFO[2024-08-10T05:50:24Z] Snapshot integration stream into release 4.18.0-0.ci.test-2024-08-10-054923-ci-op-q69b2z86-latest to tag release:latest  
INFO[2024-08-10T05:50:24Z] Acquiring leases for test e2e-aws-operator: [aws-quota-slice] 
INFO[2024-08-10T05:50:24Z] Acquired 1 lease(s) for aws-quota-slice: [us-east-1--aws-quota-slice-27] 
INFO[2024-08-10T05:50:24Z] Acquiring IP Pool leases for test e2e-aws-operator: aws-ip-pools-us-east-1 
INFO[2024-08-10T05:50:24Z] Acquired 13 ip pool lease(s) for aws-ip-pools-us-east-1: [688006b7-16d8-4bfa-90ca-b525f71332db 313f2857-57f1-4dc8-803a-8d187df02b54 204b9ba3-6c83-482a-94f1-3a8703b09212 691c8080-6f39-4cc3-bb20-05bba5f6b12d f3575edb-3d0a-4738-8aa9-9a3a02de2079 9a18fae5-b11c-40ab-914c-aca9cb417773 0cbf9668-81ce-400d-b82a-8f5058fcb1ea 5cd720b4-d21c-40ad-b595-1c5b2c7e065c 18ce598d-f84d-49c9-b7f8-ab6c153127a8 98917921-7df8-4f48-9cc0-e90776d658ab a25bb953-d7de-43b3-bc99-47255d434a7b d918abe9-01ac-4256-a009-48f6b07557b1 af752da2-ae14-4d7f-9316-b4b4fce87600] 
INFO[2024-08-10T05:50:24Z] Running multi-stage test e2e-aws-operator    
INFO[2024-08-10T05:50:25Z] Running multi-stage phase pre                
INFO[2024-08-10T05:50:25Z] Running step e2e-aws-operator-ipi-conf.      
INFO[2024-08-10T05:50:33Z] Step e2e-aws-operator-ipi-conf succeeded after 8s. 
INFO[2024-08-10T05:50:33Z] Running step e2e-aws-operator-ipi-conf-telemetry. 
INFO[2024-08-10T05:50:41Z] Step e2e-aws-operator-ipi-conf-telemetry succeeded after 7s. 
INFO[2024-08-10T05:50:41Z] Running step e2e-aws-operator-ipi-conf-aws.  
INFO[2024-08-10T05:50:54Z] Step e2e-aws-operator-ipi-conf-aws succeeded after 13s. 
INFO[2024-08-10T05:50:54Z] Running step e2e-aws-operator-ipi-conf-aws-byo-ipv4-pool-public. 
INFO[2024-08-10T05:51:04Z] Step e2e-aws-operator-ipi-conf-aws-byo-ipv4-pool-public succeeded after 9s. 
INFO[2024-08-10T05:51:04Z] Running step e2e-aws-operator-ipi-install-monitoringpvc. 
INFO[2024-08-10T05:51:12Z] Step e2e-aws-operator-ipi-install-monitoringpvc succeeded after 8s. 
INFO[2024-08-10T05:51:12Z] Running step e2e-aws-operator-ipi-install-rbac. 
INFO[2024-08-10T05:51:20Z] Step e2e-aws-operator-ipi-install-rbac succeeded after 7s. 
INFO[2024-08-10T05:51:20Z] Running step e2e-aws-operator-openshift-cluster-bot-rbac. 
INFO[2024-08-10T05:51:24Z] there are 8 unused ip-pool addresses to release 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 688006b7-16d8-4bfa-90ca-b525f71332db 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 313f2857-57f1-4dc8-803a-8d187df02b54 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 204b9ba3-6c83-482a-94f1-3a8703b09212 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 691c8080-6f39-4cc3-bb20-05bba5f6b12d 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: f3575edb-3d0a-4738-8aa9-9a3a02de2079 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 9a18fae5-b11c-40ab-914c-aca9cb417773 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 0cbf9668-81ce-400d-b82a-8f5058fcb1ea 
INFO[2024-08-10T05:51:24Z] releasing unused ip-pool lease: 5cd720b4-d21c-40ad-b595-1c5b2c7e065c 
INFO[2024-08-10T05:51:28Z] Step e2e-aws-operator-openshift-cluster-bot-rbac succeeded after 8s. 
INFO[2024-08-10T05:51:28Z] Running step e2e-aws-operator-ipi-install-hosted-loki. 
INFO[2024-08-10T05:51:36Z] Step e2e-aws-operator-ipi-install-hosted-loki succeeded after 8s. 
INFO[2024-08-10T05:51:36Z] Running step e2e-aws-operator-ipi-install-install. 
INFO[2024-08-10T06:25:15Z] Step e2e-aws-operator-ipi-install-install succeeded after 33m39s. 
INFO[2024-08-10T06:25:15Z] Running step e2e-aws-operator-ipi-install-times-collection. 
INFO[2024-08-10T06:25:23Z] Step e2e-aws-operator-ipi-install-times-collection succeeded after 7s. 
INFO[2024-08-10T06:25:23Z] Running step e2e-aws-operator-nodes-readiness. 
INFO[2024-08-10T06:25:33Z] Step e2e-aws-operator-nodes-readiness succeeded after 9s. 
INFO[2024-08-10T06:25:33Z] Running step e2e-aws-operator-multiarch-validate-nodes. 
INFO[2024-08-10T06:25:41Z] Step e2e-aws-operator-multiarch-validate-nodes succeeded after 8s. 
INFO[2024-08-10T06:25:41Z] Step phase pre succeeded after 35m16s.       
INFO[2024-08-10T06:25:41Z] Running multi-stage phase test               
INFO[2024-08-10T06:25:41Z] Running step e2e-aws-operator-test.          
INFO[2024-08-10T06:31:48Z] Logs for container test in pod e2e-aws-operator-test: 
INFO[2024-08-10T06:31:48Z] GOOS=linux GO111MODULE=on GOFLAGS=-mod=vendor go build -o _output/go-bindata ./vendor/github.com/kevinburke/go-bindata/go-bindata
_output/go-bindata -mode 420 -modtime 1 -pkg manifests -o pkg/manifests/bindata.go assets/...
gofmt -s -w pkg/manifests/bindata.go
for d in core basic reboots reboots/sno deferred; do \
  KUBERNETES_CONFIG="/tmp/kubeconfig-3609473233" GOOS=linux GO111MODULE=on GOFLAGS=-mod=vendor go test -v -timeout 40m ./test/e2e/$d -ginkgo.v -ginkgo.no-color -ginkgo.fail-fast -ginkgo.label-filter=!flaky || exit; \
done
=== RUN   TestNodeTuningOperator
Running Suite: Node Tuning Operator e2e tests: core - /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/core
=============================================================================================================================
Random Seed: 1723271177

Will run 1 of 1 specs
------------------------------
[core][cluster_version] Node Tuning Operator host, container OS and cluster version host, container OS and cluster version retrievable
/go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/core/cluster_version.go:20
  STEP: getting a list of worker nodes @ 08/10/24 06:26:17.913
  STEP: getting a TuneD Pod running on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:17.933
  STEP: getting the host OS version on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:17.938
  NAME="Red Hat Enterprise Linux CoreOS"
  ID="rhcos"
  ID_LIKE="rhel fedora"
  VERSION="416.94.202405210347-0"
  VERSION_ID="4.16"
  VARIANT="CoreOS"
  VARIANT_ID=coreos
  PLATFORM_ID="platform:el9"
  PRETTY_NAME="Red Hat Enterprise Linux CoreOS 416.94.202405210347-0"
  ANSI_COLOR="0;31"
  CPE_NAME="cpe:/o:redhat:enterprise_linux:9::baseos::coreos"
  HOME_URL="https://www.redhat.com/"
  DOCUMENTATION_URL="https://docs.okd.io/latest/welcome/index.html"
  BUG_REPORT_URL="https://access.redhat.com/labs/rhir/"
  REDHAT_BUGZILLA_PRODUCT="OpenShift Container Platform"
  REDHAT_BUGZILLA_PRODUCT_VERSION="4.16"
  REDHAT_SUPPORT_PRODUCT="OpenShift Container Platform"
  REDHAT_SUPPORT_PRODUCT_VERSION="4.16"
  OPENSHIFT_VERSION="4.16"
  RHEL_VERSION=9.4
  OSTREE_VERSION="416.94.202405210347-0"

  STEP: getting the TuneD container OS version @ 08/10/24 06:26:18.12
  NAME="Red Hat Enterprise Linux"
  VERSION="9.2 (Plow)"
  ID="rhel"
  ID_LIKE="fedora"
  VERSION_ID="9.2"
  PLATFORM_ID="platform:el9"
  PRETTY_NAME="Red Hat Enterprise Linux 9.2 (Plow)"
  ANSI_COLOR="0;31"
  LOGO="fedora-logo-icon"
  CPE_NAME="cpe:/o:redhat:enterprise_linux:9::baseos"
  HOME_URL="https://www.redhat.com/"
  DOCUMENTATION_URL="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9"
  BUG_REPORT_URL="https://issues.redhat.com/"

  REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 9"
  REDHAT_BUGZILLA_PRODUCT_VERSION=9.2
  REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
  REDHAT_SUPPORT_PRODUCT_VERSION="9.2"

  STEP: getting the cluster version @ 08/10/24 06:26:18.276
  run command 'oc [get clusterversion version -o jsonpath='{.status.desired.version}']':
    out='4.18.0-0.ci.test-2024-08-10-054923-ci-op-q69b2z86-latest'
    err=
    ret=<nil>
• [0.453 seconds]
------------------------------

Ran 1 of 1 Specs in 0.454 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestNodeTuningOperator (0.45s)
PASS
ok  	github.com/openshift/cluster-node-tuning-operator/test/e2e/core	0.467s
=== RUN   TestNodeTuningOperator
Running Suite: Node Tuning Operator e2e tests: basic - /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic
===============================================================================================================================
Random Seed: 1723271180

Will run 15 of 15 specs
------------------------------
[basic][tuned_errors_and_recovery] Cause TuneD daemon errors and recover TuneD daemon errors and recovery Cause TuneD daemon errors on invalid profile load and recover after the profile deletion
/go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/tuned_errors_and_recovery.go:47
  STEP: getting a list of worker nodes @ 08/10/24 06:26:20.152
  STEP: getting a TuneD Pod running on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:20.167
  STEP: labelling node ip-10-0-117-12.ec2.internal with label tuned.openshift.io/cause-tuned-failure @ 08/10/24 06:26:20.173
  run command 'oc [label node --overwrite ip-10-0-117-12.ec2.internal tuned.openshift.io/cause-tuned-failure=]':
    out=node/ip-10-0-117-12.ec2.internal labeled
    err=
    ret=<nil>
  STEP: waiting for ClusterOperator/node-tuning condition Available reason AsExpected @ 08/10/24 06:26:20.284
  STEP: creating the custom profile ../testing_manifests/cause_tuned_failure.yaml @ 08/10/24 06:26:20.292
  run command 'oc [create -n openshift-cluster-node-tuning-operator -f ../testing_manifests/cause_tuned_failure.yaml]':
    out=tuned.tuned.openshift.io/openshift-cause-tuned-failure created
    err=
    ret=<nil>
  STEP: waiting for ClusterOperator/node-tuning condition Available reason ProfileDegraded @ 08/10/24 06:26:20.395
  STEP: creating the custom profile ../testing_manifests/dummy.yaml @ 08/10/24 06:26:25.404
  run command 'oc [create -n openshift-cluster-node-tuning-operator -f ../testing_manifests/dummy.yaml]':
    out=tuned.tuned.openshift.io/openshift-dummy created
    err=
    ret=<nil>
  STEP: waiting for ClusterOperator/node-tuning condition Available reason AsExpected @ 08/10/24 06:26:25.498
  STEP: deleting the custom profile ../testing_manifests/cause_tuned_failure.yaml @ 08/10/24 06:26:30.502
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../testing_manifests/cause_tuned_failure.yaml]':
    out=tuned.tuned.openshift.io "openshift-cause-tuned-failure" deleted
    err=
    ret=<nil>
  STEP: deleting the custom profile ../testing_manifests/dummy.yaml @ 08/10/24 06:26:30.596
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../testing_manifests/dummy.yaml]':
    out=tuned.tuned.openshift.io "openshift-dummy" deleted
    err=
    ret=<nil>
  STEP: waiting for ClusterOperator/node-tuning condition Available reason AsExpected @ 08/10/24 06:26:30.704
  STEP: removing label tuned.openshift.io/cause-tuned-failure from node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:30.709
  run command 'oc [label node --overwrite ip-10-0-117-12.ec2.internal tuned.openshift.io/cause-tuned-failure-]':
    out=node/ip-10-0-117-12.ec2.internal labeled
    err=
    ret=<nil>
  STEP: cluster changes rollback @ 08/10/24 06:26:30.813
  run command 'oc [label node --overwrite ip-10-0-117-12.ec2.internal tuned.openshift.io/cause-tuned-failure-]':
    out=label "tuned.openshift.io/cause-tuned-failure" not found.
  node/ip-10-0-117-12.ec2.internal not labeled
    err=
    ret=<nil>
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../testing_manifests/cause_tuned_failure.yaml]':
    out=
    err=Error from server (NotFound): error when deleting "../testing_manifests/cause_tuned_failure.yaml": tuneds.tuned.openshift.io "openshift-cause-tuned-failure" not found
    ret=exit status 1
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../testing_manifests/dummy.yaml]':
    out=
    err=Error from server (NotFound): error when deleting "../testing_manifests/dummy.yaml": tuneds.tuned.openshift.io "openshift-dummy" not found
    ret=exit status 1
  run command 'oc [exec -n openshift-cluster-node-tuning-operator tuned-9bvqh -- rm -rf /etc/tuned/openshift-dummy]':
    out=
    err=
    ret=<nil>
• [11.094 seconds]
------------------------------
[basic][custom_pod_labels] Node Tuning Operator custom profile, Pod labels custom profile: Pod labels net.ipv4.tcp_tw_reuse set
/go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/custom_pod_labels.go:39
  STEP: getting a list of worker nodes @ 08/10/24 06:26:31.246
  STEP: getting a TuneD Pod running on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:31.253
  STEP: waiting for TuneD profile openshift-node on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:31.258
  STEP: getting the current value of net.ipv4.tcp_tw_reuse in Pod tuned-9bvqh @ 08/10/24 06:26:31.261
  STEP: labelling Pod tuned-9bvqh with label tuned.openshift.io/ingress @ 08/10/24 06:26:31.409
  run command 'oc [label pod --overwrite -n openshift-cluster-node-tuning-operator tuned-9bvqh tuned.openshift.io/ingress=]':
    out=pod/tuned-9bvqh labeled
    err=
    ret=<nil>
  STEP: creating the custom ingress profile ../../../examples/ingress.yaml @ 08/10/24 06:26:31.513
  run command 'oc [create -n openshift-cluster-node-tuning-operator -f ../../../examples/ingress.yaml]':
    out=tuned.tuned.openshift.io/openshift-ingress created
    err=
    ret=<nil>
  STEP: ensuring the custom worker node profile was set @ 08/10/24 06:26:31.606
  STEP: removing label tuned.openshift.io/ingress from Pod tuned-9bvqh @ 08/10/24 06:26:36.769
  run command 'oc [label pod --overwrite -n openshift-cluster-node-tuning-operator tuned-9bvqh tuned.openshift.io/ingress-]':
    out=pod/tuned-9bvqh labeled
    err=
    ret=<nil>
  STEP: ensuring the original net.ipv4.tcp_tw_reuse value (2) is set in Pod tuned-9bvqh @ 08/10/24 06:26:36.874
  STEP: deleting the custom ingress profile ../../../examples/ingress.yaml @ 08/10/24 06:26:47.03
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../../../examples/ingress.yaml]':
    out=tuned.tuned.openshift.io "openshift-ingress" deleted
    err=
    ret=<nil>
  STEP: cluster changes rollback @ 08/10/24 06:26:47.125
  run command 'oc [label pod --overwrite -n openshift-cluster-node-tuning-operator tuned-9bvqh tuned.openshift.io/ingress-]':
    out=label "tuned.openshift.io/ingress" not found.
  pod/tuned-9bvqh not labeled
    err=
    ret=<nil>
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../../../examples/ingress.yaml]':
    out=
    err=Error from server (NotFound): error when deleting "../../../examples/ingress.yaml": tuneds.tuned.openshift.io "openshift-ingress" not found
    ret=exit status 1
• [16.064 seconds]
------------------------------
[basic][sysctl_d_override] Node Tuning Operator /etc/sysctl.d/*.conf override sysctl.d override net.ipv4.neigh.default.gc_thresh1 set
/go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:48
  STEP: getting a list of worker nodes @ 08/10/24 06:26:47.31
  STEP: getting a TuneD Pod running on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:47.319
  STEP: waiting for TuneD profile openshift-node on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:47.328
  STEP: getting the current value of net.ipv4.neigh.default.gc_thresh1 in Pod tuned-9bvqh @ 08/10/24 06:26:47.333
  STEP: writing /host/etc/sysctl.d/zzz.conf override file on the host with net.ipv4.neigh.default.gc_thresh1=256 @ 08/10/24 06:26:47.479
  run command 'oc [exec -n openshift-cluster-node-tuning-operator tuned-9bvqh -- sh -c echo net.ipv4.neigh.default.gc_thresh1=256 > /host/etc/sysctl.d/zzz.conf; sync /host/etc/sysctl.d/zzz.conf]':
    out=
    err=
    ret=<nil>
  run command 'oc [rsh -n openshift-cluster-node-tuning-operator tuned-9bvqh cat /host/etc/sysctl.d/zzz.conf]':
    out=net.ipv4.neigh.default.gc_thresh1=256
    err=
    ret=<nil>
  STEP: deleting Pod tuned-9bvqh @ 08/10/24 06:26:47.771
  run command 'oc [delete -n openshift-cluster-node-tuning-operator pod tuned-9bvqh --wait]':
    out=pod "tuned-9bvqh" deleted
    err=
    ret=<nil>
  STEP: waiting for a new TuneD Pod to be ready on node ip-10-0-117-12.ec2.internal @ 08/10/24 06:26:48.249
  STEP: ensuring new net.ipv4.neigh.default.gc_thresh1 value (256) is set in Pod tuned-6w6sd @ 08/10/24 06:26:48.254
  [FAILED] in [It] - /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:98 @ 08/10/24 06:31:48.406
  STEP: cluster changes rollback @ 08/10/24 06:31:48.407
  run command 'oc [label node --overwrite ip-10-0-117-12.ec2.internal tuned.openshift.io/sysctl-override-]':
    out=label "tuned.openshift.io/sysctl-override" not found.
  node/ip-10-0-117-12.ec2.internal not labeled
    err=
    ret=<nil>
  run command 'oc [exec -n openshift-cluster-node-tuning-operator tuned-6w6sd -- rm /host/etc/sysctl.d/zzz.conf]':
    out=
    err=
    ret=<nil>
  run command 'oc [delete -n openshift-cluster-node-tuning-operator -f ../testing_manifests/sysctl_override.yaml]':
    out=
    err=Error from server (NotFound): error when deleting "../testing_manifests/sysctl_override.yaml": tuneds.tuned.openshift.io "openshift-profile" not found
    ret=exit status 1
• [FAILED] [301.432 seconds]
[basic][sysctl_d_override] Node Tuning Operator /etc/sysctl.d/*.conf override sysctl.d override [It] net.ipv4.neigh.default.gc_thresh1 set
/go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:48

  [FAILED] Unexpected error:
      <*errors.errorString | 0xc00022ed60>: 
      sysctl net.ipv4.neigh.default.gc_thresh1=8192 in Pod tuned-6w6sd, expected 256: command [sysctl -n net.ipv4.neigh.default.gc_thresh1] outputs 8192 (leading/trailing whitespace trimmed) in Pod tuned-6w6sd, expected 256 (waited 5m0.152435901s): out=; err=failed to run [sysctl -n net.ipv4.neigh.default.gc_thresh1] in pod openshift-cluster-node-tuning-operator/tuned-6w6sd:
        out=
        err=error: unable to upgrade connection: container not found ("tuned")
      
        ret=exit status 1
      {
          s: "sysctl net.ipv4.neigh.default.gc_thresh1=8192 in Pod tuned-6w6sd, expected 256: command [sysctl -n net.ipv4.neigh.default.gc_thresh1] outputs 8192 (leading/trailing whitespace trimmed) in Pod tuned-6w6sd, expected 256 (waited 5m0.152435901s): out=; err=failed to run [sysctl -n net.ipv4.neigh.default.gc_thresh1] in pod openshift-cluster-node-tuning-operator/tuned-6w6sd:\n  out=\n  err=error: unable to upgrade connection: container not found (\"tuned\")\n\n  ret=exit status 1",
      }
  occurred
  In [It] at: /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:98 @ 08/10/24 06:31:48.406
------------------------------
SSSSSSSSSSSS

Summarizing 1 Failure:
  [FAIL] [basic][sysctl_d_override] Node Tuning Operator /etc/sysctl.d/*.conf override sysctl.d override [It] net.ipv4.neigh.default.gc_thresh1 set
  /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:98

Ran 3 of 15 Specs in 328.591 seconds
FAIL! -- 2 Passed | 1 Failed | 0 Pending | 12 Skipped
--- FAIL: TestNodeTuningOperator (328.59s)
FAIL
FAIL	github.com/openshift/cluster-node-tuning-operator/test/e2e/basic	328.604s
FAIL
make: *** [Makefile:103: test-e2e] Error 1
{"component":"entrypoint","error":"wrapped process failed: exit status 2","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2024-08-10T06:31:48Z"}
error: failed to execute wrapped command: exit status 2 
INFO[2024-08-10T06:31:48Z] Step e2e-aws-operator-test failed after 6m7s. 
INFO[2024-08-10T06:31:48Z] Step phase test failed after 6m7s.           
INFO[2024-08-10T06:31:48Z] Running multi-stage phase post               
INFO[2024-08-10T06:31:48Z] Running step e2e-aws-operator-gather-aws-console. 
INFO[2024-08-10T06:32:04Z] Step e2e-aws-operator-gather-aws-console succeeded after 15s. 
INFO[2024-08-10T06:32:04Z] Running step e2e-aws-operator-gather-must-gather. 
INFO[2024-08-10T06:33:33Z] Step e2e-aws-operator-gather-must-gather succeeded after 1m29s. 
INFO[2024-08-10T06:33:33Z] Running step e2e-aws-operator-gather-extra.  
INFO[2024-08-10T06:34:43Z] Step e2e-aws-operator-gather-extra succeeded after 1m9s. 
INFO[2024-08-10T06:34:43Z] Running step e2e-aws-operator-gather-audit-logs. 
INFO[2024-08-10T06:35:02Z] Step e2e-aws-operator-gather-audit-logs succeeded after 19s. 
INFO[2024-08-10T06:35:02Z] Running step e2e-aws-operator-ipi-deprovision-deprovision. 
INFO[2024-08-10T06:40:41Z] Step e2e-aws-operator-ipi-deprovision-deprovision succeeded after 5m39s. 
INFO[2024-08-10T06:40:41Z] Step phase post succeeded after 8m52s.       
INFO[2024-08-10T06:40:41Z] Releasing ip pool leases for test e2e-aws-operator 
INFO[2024-08-10T06:40:41Z] Releasing leases for test e2e-aws-operator   
INFO[2024-08-10T06:40:42Z] Ran for 56m31s                               
ERRO[2024-08-10T06:40:42Z] Some steps failed:                           
ERRO[2024-08-10T06:40:42Z] 
  * could not run steps: step e2e-aws-operator failed: "e2e-aws-operator" test steps failed: "e2e-aws-operator" pod "e2e-aws-operator-test" failed: could not watch pod: the pod ci-op-q69b2z86/e2e-aws-operator-test failed after 6m7s (failed containers: test): ContainerFailed one or more containers exited

Container test exited with code 2, reason Error
---
thresh1=8192 in Pod tuned-6w6sd, expected 256: command [sysctl -n net.ipv4.neigh.default.gc_thresh1] outputs 8192 (leading/trailing whitespace trimmed) in Pod tuned-6w6sd, expected 256 (waited 5m0.152435901s): out=; err=failed to run [sysctl -n net.ipv4.neigh.default.gc_thresh1] in pod openshift-cluster-node-tuning-operator/tuned-6w6sd:
        out=
        err=error: unable to upgrade connection: container not found ("tuned")
      
        ret=exit status 1
      {
          s: "sysctl net.ipv4.neigh.default.gc_thresh1=8192 in Pod tuned-6w6sd, expected 256: command [sysctl -n net.ipv4.neigh.default.gc_thresh1] outputs 8192 (leading/trailing whitespace trimmed) in Pod tuned-6w6sd, expected 256 (waited 5m0.152435901s): out=; err=failed to run [sysctl -n net.ipv4.neigh.default.gc_thresh1] in pod openshift-cluster-node-tuning-operator/tuned-6w6sd:\n  out=\n  err=error: unable to upgrade connection: container not found (\"tuned\")\n\n  ret=exit status 1",
      }
  occurred
  In [It] at: /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:98 @ 08/10/24 06:31:48.406
------------------------------
SSSSSSSSSSSS

Summarizing 1 Failure:
  [FAIL] [basic][sysctl_d_override] Node Tuning Operator /etc/sysctl.d/*.conf override sysctl.d override [It] net.ipv4.neigh.default.gc_thresh1 set
  /go/src/github.com/openshift/cluster-node-tuning-operator/test/e2e/basic/sysctl_d_override.go:98

Ran 3 of 15 Specs in 328.591 seconds
FAIL! -- 2 Passed | 1 Failed | 0 Pending | 12 Skipped
--- FAIL: TestNodeTuningOperator (328.59s)
FAIL
FAIL	github.com/openshift/cluster-node-tuning-operator/test/e2e/basic	328.604s
FAIL
make: *** [Makefile:103: test-e2e] Error 1
{"component":"entrypoint","error":"wrapped process failed: exit status 2","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2024-08-10T06:31:48Z"}
error: failed to execute wrapped command: exit status 2
---
Link to step on registry info site: https://steps.ci.openshift.org/reference/test
Link to job on registry info site: https://steps.ci.openshift.org/job?org=openshift&repo=cluster-node-tuning-operator&branch=master&test=e2e-aws-operator 
INFO[2024-08-10T06:40:42Z] Reporting job state 'failed' with reason 'executing_graph:step_failed:utilizing_lease:executing_test:utilizing_ip_pool:executing_test:executing_multi_stage_test'