Sitelet https://github.com/kubernetes/kops/pull/18485
Skip to content

scaletest: report experiment variant after kubetest2 runs - #18485

Merged
k8s-ci-robot merged 1 commit into
kubernetes:masterfrom
Jefftree:scaletest-variant-after-kubetest2
Jun 18, 2026
Merged

k8s-ci-robot merged 1 commit into
kubernetes:masterfrom
Jefftree:scaletest-variant-after-kubetest2

Conversation

@Jefftree

Copy link
Copy Markdown
Member

The variant added in #18476 shows up as "missing" in the TestGrid column header:
https://testgrid.k8s.io/sig-scalability-gce#pull-kubernetes-e2e-gce-master-scale-performance-5000

The metadata.json write needs to happen after the kubetest2 command finishes, otherwise kubetest2 overwrites it.

Part of kubernetes/test-infra#37273

/assign @serathius

@k8s-ci-robot k8s-ci-robot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Jun 18, 2026
@k8s-ci-robot
k8s-ci-robot requested review from dims and hakman June 18, 2026 03:14
@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jun 18, 2026
"${CLUSTERLOADER2_ARGS[@]}"
"${CLUSTERLOADER2_ARGS[@]}" || rc=$?

# Add the variant after kubetest2, which would otherwise overwrite metadata.json.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you saying there is no feature of kubetest that would ask it to add this metadata for us? We need to hack around and add it ourselves.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't find anything around it, we're the only ones trying to setup a custom testgrid. dra doesn't use kubetest2 so they had no problems with the metadata injection. Can probably add a feature in kubetest2 but that will probably take some effort/time

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good, thanks for looking into that.

@serathius

Copy link
Copy Markdown
Member

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 18, 2026
@k8s-ci-robot

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: serathius

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 18, 2026
@hakman

hakman commented Jun 18, 2026

Copy link
Copy Markdown
Member

@Jefftree

Errors from shellcheck:

In ./tests/e2e/scenarios/scalability/run-test.sh line 274:
      && mv "${ARTIFACTS}/metadata.json.tmp" "${ARTIFACTS}/metadata.json" || true
      ^-- SC2015 (info): Note that A && B || C is not if-then-else. C may run when A is true.

For more information:
  https://www.shellcheck.net/wiki/SC2015 -- Note that A && B || C is not if-t...

/lgtm cancel

@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 18, 2026
@Jefftree
Jefftree force-pushed the scaletest-variant-after-kubetest2 branch from 7520d00 to 70848b4 Compare June 18, 2026 14:22
@Jefftree

Copy link
Copy Markdown
Member Author

@Jefftree

Errors from shellcheck:

In ./tests/e2e/scenarios/scalability/run-test.sh line 274:
      && mv "${ARTIFACTS}/metadata.json.tmp" "${ARTIFACTS}/metadata.json" || true
      ^-- SC2015 (info): Note that A && B || C is not if-then-else. C may run when A is true.

For more information:
  https://www.shellcheck.net/wiki/SC2015 -- Note that A && B || C is not if-t...

/lgtm cancel

Working around set -e 😅. Hopefully fixed now.

@hakman

hakman commented Jun 18, 2026

Copy link
Copy Markdown
Member

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 18, 2026
@k8s-ci-robot
k8s-ci-robot merged commit f54e1d7 into kubernetes:master Jun 18, 2026
28 checks passed
@Jefftree
Jefftree deleted the scaletest-variant-after-kubetest2 branch June 26, 2026 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants