Sitelet https://github.com/DataDog/dd-trace-java/pull/12264
Skip to content

Update APM SDK benchmarks reference - #12264

Open
dd-octo-sts[bot] wants to merge 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20260823
Open

Update APM SDK benchmarks reference#12264
dd-octo-sts[bot] wants to merge 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20260823

Conversation

@dd-octo-sts

@dd-octo-sts dd-octo-sts Bot commented Aug 23, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

This PR updates the pinned apm-sdks-benchmarks GitLab CI includes and runtime clones to
DataDog/apm-sdks-benchmarks@e5d09cd128f01d08aadd55f68712cb66fa5f600b.

Motivation

Keep Java SDK benchmarks current while retaining reproducible CI configuration.

Contributor Checklist

  • Verify CI passes successfully

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts Bot added type: feature Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Aug 23, 2026
@dd-octo-sts
dd-octo-sts Bot requested review from a team as code owners August 23, 2026 04:16
@dd-octo-sts
dd-octo-sts Bot requested review from bric3 and randomanderson and removed request for a team August 23, 2026 04:16
@datadog-prod-us1-5

This comment has been minimized.

@dd-octo-sts

dd-octo-sts Bot commented Aug 23, 2026

Copy link
Copy Markdown
Contributor Author

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.97 s 14.01 s [-1.3%; +0.7%] (no difference)
startup:insecure-bank:tracing:Agent 12.88 s 12.97 s [-1.3%; -0.1%] (maybe better)
startup:petclinic:appsec:Agent 16.45 s 16.79 s [-6.5%; +2.5%] (no difference)
startup:petclinic:iast:Agent 16.92 s 16.91 s [-0.6%; +0.8%] (no difference)
startup:petclinic:profiling:Agent 16.85 s 16.94 s [-1.8%; +0.7%] (no difference)
startup:petclinic:sca:Agent 16.90 s 16.39 s [+2.1%; +4.1%] (significantly worse)
startup:petclinic:tracing:Agent 15.61 s 16.27 s [-8.0%; -0.0%] (maybe better)

Commit: 2c72ee96 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@datadog-prod-us1-5 datadog-prod-us1-5 Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

All benchmark includes and the runtime clone variable use the same new pinned commit through one YAML anchor. No changed line creates a concrete failure mode.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Datadog Autotest · Commit 2c72ee9 · What is Autotest? · @DataDog review to ask questions · Any feedback? Reach out in #autotest

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants