Envtest tags and release binaries are not generated for each k8s release

[pmalek]

Problem statement

It seems that envtest tags (e.g. https://github.com/kubernetes-sigs/controller-tools/releases/tag/envtest-v1.35.0) and accompanying release assets/binaries are created on demand and not for every k8s release.

This causes issues in test pipelines where users use 1 version of k8s against which they test. That version can be used for envtest, kind image and other versions in the pipeline.

As of today, kindest/node tags 1.34.3 and 1.34.2 exist but envtest has only been tagged for 1.34.1 (https://github.com/kubernetes-sigs/controller-tools/releases/tag/envtest-v1.34.1).

This creates inconsistency in testing pipelines and requires special care.

Proposed solution

Create envtest tags, release and release assets for each k8s release.

[sbueringer]

We are definitely not going to manually create envtest binaries for every release.

I don't see a way how we can automate it.

Given that setup-envtest + envtest is basically only downloading a few binaries, I would recommend to just directly consume Kubernetes and etcd release artifacts instead.

[sbueringer]

If someone has an idea on how this can be fully automated, feel free to bring it up.

[pmalek]

I just glanced at the source but doesn't this basically boil down to adding a file in https://github.com/kubernetes-sigs/controller-tools/tree/main/hack/envtest/_matrix just like 52f5e83 did it?

Then https://github.com/kubernetes-sigs/controller-tools/blob/main/.github/workflows/tools-releases.yml runs and creates a PR which updates envtest-releases.yaml.

So as long as we automate creation of a PR with new file in https://github.com/kubernetes-sigs/controller-tools/tree/main/hack/envtest/_matrix this should be achievable, right?

[sbueringer]

We are not allowed anymore to create PRs from actions, see: #1113 (comment)

At this point every envtest release requires to create 2 PRs in controller-tools manually, e.g.:

• ✨Release envtest v1.35.0 #1317
• 🌱 Promotion of envtest release for Kubernetes v1.35.0 #1319