More zuul jobs, and generate JUnitXML reports for KUTTL

[tosky]

Add KUTTL and tempest zuul jobs (meant to replace the prow ones in the long term)

KUTTL: generate JUnitXML reports

• switch the type to XML (the accepted value is 'xml' lowercase, not uppercase);
• tune the name a bit to highlight it is a report;
• add the new reportGranularity parameter which is supported by kuttl 0.20.0 and will restore the pre-1.17 JUnitXML format (granularity by test case, instead of by step).
• remove the URL of kuttl, so that it is not tied to a specific release.

Depends-On: openstack-k8s-operators/ci-framework#2628

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[tosky]

recheck

[tosky]

recheck

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/221c1d8cef254360b7773aa19f68653c

❌ openstack-k8s-operators-content-provider FAILURE in 4m 31s
⚠️ glance-operator-kuttl SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider (non-voting)
⚠️ glance-operator-tempest SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider (non-voting)

[tosky]

recheck

[tosky]

recheck

[tosky]

recheck

[tosky]

recheck

[tosky]

recheck

[fmount]

Thanks @tosky for starting this. It's very useful.
I see zuul based kuttl tests are failing, mostly because of missing resources of the openshift environment [1], which fails to schedule Glance Pods on a scale out operation.
I'll recheck to see if it's consistent, but in general that is a signal that we might want to review the amount of resources assigned to the crc VM.

[1] https://logserver.rdoproject.org/78/678/34557ae2934d5fe0fe2e9a1671d75d90b0a74e20/github-check/glance-operator-kuttl/bc30e93/controller/ci-framework-data/logs/openstack-k8s-operators-openstack-must-gather/namespaces/glance-kuttl-tests/events.log

[fmount]

recheck

[tosky]

One of the errors may not be linked to resource issues though:

<testcase classname="tests" name="glance_single" timestamp="2025-01-07T19:38:42.296545869-05:00" time="2.420" assertions="8">
<failure message="failed in step 1-deploy_glance" type="">
command "oc kustomize ../../../../config/samples/layout/single | oc apply -n..." failed, exit status 1
</failure>
</testcase>

[fmount]

/approve
/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: fmount, tosky

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [fmount]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment