Skip to content

chore: remove jmh from projects that don't have any benchmarks #8854

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
May 20, 2025
Merged

chore: remove jmh from projects that don't have any benchmarks #8854

merged 2 commits into from
May 20, 2025

Conversation

bric3
Copy link
Contributor

@bric3 bric3 commented May 20, 2025

What Does This Do

Remove jmh gradle plugin when the project actually has no benchmarks

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested a review from a team as a code owner May 20, 2025 12:58
@bric3 bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 20, 2025
sarahchen6
sarahchen6 approved these changes May 20, 2025
View reviewed changes
Copy link
Contributor

@sarahchen6 sarahchen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙌

mcculls
mcculls reviewed May 20, 2025
View reviewed changes
components/yaml/build.gradle.kts
@@ -1,13 +1,9 @@
plugins {
id("me.champeau.jmh")
`java-library`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't this added by applying $rootDir/gradle/java.gradle below?

Copy link
Contributor Author

@bric3 bric3 May 20, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. It is, but in kotlin DSL scripts, the apply(from = ) style doesn't give access to generated configuration type-safe accessors like implementation used in this project. Only the plugins block triggers this.
Access to implementation in particular is available only with the java-library plugin or if another plugin depends on it like me.champeau.jmh.

In general Gradle doesn't recommend the apply(from = ) style at all anymore (for various reasons), instead they recommend using convention plugins. Those would inherit any applied plugins.

@pr-commenter
Copy link

pr-commenter bot commented May 20, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master remove-jmh-if-no-benchmarks
git_commit_date 1747743756 1747746440
git_commit_sha 0ebd52b 861e629
release_version 1.50.0-SNAPSHOT~0ebd52ba72 1.50.0-SNAPSHOT~861e629d36
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747748813 1747748813
ci_job_id 945838326 945838326
ci_pipeline_id 65605981 65605981
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qba76gvb-project-304-concurrent-0-09eoglrq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qba76gvb-project-304-concurrent-0-09eoglrq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1015439
Total [baseline] (8.652 s) : 0, 8652490
Agent [candidate] (1.024 s) : 0, 1024357
Total [candidate] (8.674 s) : 0, 8674002
section iast
Agent [baseline] (1.144 s) : 0, 1144279
Total [baseline] (9.23 s) : 0, 9229875
Agent [candidate] (1.156 s) : 0, 1156366
Total [candidate] (9.269 s) : 0, 9269095
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.149 s) : 0, 1148968
Total [baseline] (9.218 s) : 0, 9217589
Agent [candidate] (1.151 s) : 0, 1150905
Total [candidate] (9.201 s) : 0, 9200826
section iast_TELEMETRY_OFF
Agent [baseline] (1.146 s) : 0, 1145731
Total [baseline] (9.247 s) : 0, 9247049
Agent [candidate] (1.145 s) : 0, 1145227
Total [candidate] (9.28 s) : 0, 9279580
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.015 s -
Agent iast 1.144 s 128.84 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.149 s 133.529 ms (13.1%)
Agent iast_TELEMETRY_OFF 1.146 s 130.292 ms (12.8%)
Total tracing 8.652 s -
Total iast 9.23 s 577.385 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.218 s 565.099 ms (6.5%)
Total iast_TELEMETRY_OFF 9.247 s 594.559 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent iast 1.156 s 132.009 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 126.548 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.145 s 120.87 ms (11.8%)
Total tracing 8.674 s -
Total iast 9.269 s 595.093 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.201 s 526.824 ms (6.1%)
Total iast_TELEMETRY_OFF 9.28 s 605.578 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.399 ms) : 0, 680399
BytebuddyAgent [candidate] (684.572 ms) : 0, 684572
GlobalTracer [baseline] (239.307 ms) : 0, 239307
GlobalTracer [candidate] (241.18 ms) : 0, 241180
AppSec [baseline] (54.174 ms) : 0, 54174
AppSec [candidate] (54.597 ms) : 0, 54597
Debugger [baseline] (8.298 ms) : 0, 8298
Debugger [candidate] (8.413 ms) : 0, 8413
Remote Config [baseline] (703.856 µs) : 0, 704
Remote Config [candidate] (708.034 µs) : 0, 708
Telemetry [baseline] (9.011 ms) : 0, 9011
Telemetry [candidate] (11.291 ms) : 0, 11291
section iast
BytebuddyAgent [baseline] (798.472 ms) : 0, 798472
BytebuddyAgent [candidate] (807.03 ms) : 0, 807030
GlobalTracer [baseline] (229.902 ms) : 0, 229902
GlobalTracer [candidate] (231.801 ms) : 0, 231801
IAST [baseline] (28.938 ms) : 0, 28938
IAST [candidate] (29.493 ms) : 0, 29493
AppSec [baseline] (49.276 ms) : 0, 49276
AppSec [candidate] (49.826 ms) : 0, 49826
Debugger [baseline] (5.854 ms) : 0, 5854
Debugger [candidate] (5.981 ms) : 0, 5981
Remote Config [baseline] (592.741 µs) : 0, 593
Remote Config [candidate] (595.523 µs) : 0, 596
Telemetry [baseline] (7.832 ms) : 0, 7832
Telemetry [candidate] (7.92 ms) : 0, 7920
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.986 ms) : 0, 801986
BytebuddyAgent [candidate] (801.923 ms) : 0, 801923
GlobalTracer [baseline] (230.367 ms) : 0, 230367
GlobalTracer [candidate] (231.94 ms) : 0, 231940
IAST [baseline] (28.3 ms) : 0, 28300
IAST [candidate] (27.044 ms) : 0, 27044
AppSec [baseline] (50.509 ms) : 0, 50509
AppSec [candidate] (51.92 ms) : 0, 51920
Debugger [baseline] (5.876 ms) : 0, 5876
Debugger [candidate] (5.931 ms) : 0, 5931
Remote Config [baseline] (585.205 µs) : 0, 585
Remote Config [candidate] (596.0 µs) : 0, 596
Telemetry [baseline] (7.88 ms) : 0, 7880
Telemetry [candidate] (7.937 ms) : 0, 7937
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.305 ms) : 0, 798305
BytebuddyAgent [candidate] (798.627 ms) : 0, 798627
GlobalTracer [baseline] (230.637 ms) : 0, 230637
GlobalTracer [candidate] (230.254 ms) : 0, 230254
IAST [baseline] (22.296 ms) : 0, 22296
IAST [candidate] (23.088 ms) : 0, 23088
AppSec [baseline] (56.276 ms) : 0, 56276
AppSec [candidate] (55.403 ms) : 0, 55403
Debugger [baseline] (6.065 ms) : 0, 6065
Debugger [candidate] (5.985 ms) : 0, 5985
Remote Config [baseline] (620.656 µs) : 0, 621
Remote Config [candidate] (595.563 µs) : 0, 596
Telemetry [baseline] (7.964 ms) : 0, 7964
Telemetry [candidate] (7.787 ms) : 0, 7787
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019417
Total [baseline] (10.506 s) : 0, 10506174
Agent [candidate] (1.022 s) : 0, 1021991
Total [candidate] (10.508 s) : 0, 10508244
section appsec
Agent [baseline] (1.161 s) : 0, 1161167
Total [baseline] (10.699 s) : 0, 10699418
Agent [candidate] (1.164 s) : 0, 1163709
Total [candidate] (10.745 s) : 0, 10745166
section iast
Agent [baseline] (1.158 s) : 0, 1157603
Total [baseline] (10.872 s) : 0, 10871706
Agent [candidate] (1.15 s) : 0, 1150272
Total [candidate] (10.945 s) : 0, 10945201
section profiling
Agent [baseline] (1.286 s) : 0, 1285547
Total [baseline] (10.91 s) : 0, 10909975
Agent [candidate] (1.277 s) : 0, 1276704
Total [candidate] (10.827 s) : 0, 10827325
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.161 s 141.75 ms (13.9%)
Agent iast 1.158 s 138.186 ms (13.6%)
Agent profiling 1.286 s 266.13 ms (26.1%)
Total tracing 10.506 s -
Total appsec 10.699 s 193.243 ms (1.8%)
Total iast 10.872 s 365.531 ms (3.5%)
Total profiling 10.91 s 403.801 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent appsec 1.164 s 141.719 ms (13.9%)
Agent iast 1.15 s 128.282 ms (12.6%)
Agent profiling 1.277 s 254.713 ms (24.9%)
Total tracing 10.508 s -
Total appsec 10.745 s 236.922 ms (2.3%)
Total iast 10.945 s 436.957 ms (4.2%)
Total profiling 10.827 s 319.081 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.465 ms) : 0, 682465
BytebuddyAgent [candidate] (684.072 ms) : 0, 684072
GlobalTracer [baseline] (239.697 ms) : 0, 239697
GlobalTracer [candidate] (240.982 ms) : 0, 240982
AppSec [baseline] (54.866 ms) : 0, 54866
AppSec [candidate] (54.586 ms) : 0, 54586
Debugger [baseline] (8.241 ms) : 0, 8241
Debugger [candidate] (7.569 ms) : 0, 7569
Remote Config [baseline] (683.586 µs) : 0, 684
Remote Config [candidate] (704.578 µs) : 0, 705
Telemetry [baseline] (9.9 ms) : 0, 9900
Telemetry [candidate] (10.524 ms) : 0, 10524
section appsec
BytebuddyAgent [baseline] (700.313 ms) : 0, 700313
BytebuddyAgent [candidate] (702.321 ms) : 0, 702321
GlobalTracer [baseline] (236.342 ms) : 0, 236342
GlobalTracer [candidate] (236.798 ms) : 0, 236798
AppSec [baseline] (175.684 ms) : 0, 175684
AppSec [candidate] (175.757 ms) : 0, 175757
Debugger [baseline] (5.964 ms) : 0, 5964
Debugger [candidate] (5.929 ms) : 0, 5929
Remote Config [baseline] (628.342 µs) : 0, 628
Remote Config [candidate] (629.742 µs) : 0, 630
Telemetry [baseline] (7.836 ms) : 0, 7836
Telemetry [candidate] (7.794 ms) : 0, 7794
IAST [baseline] (21.576 ms) : 0, 21576
IAST [candidate] (21.684 ms) : 0, 21684
section iast
BytebuddyAgent [baseline] (808.297 ms) : 0, 808297
BytebuddyAgent [candidate] (802.127 ms) : 0, 802127
GlobalTracer [baseline] (231.812 ms) : 0, 231812
GlobalTracer [candidate] (231.588 ms) : 0, 231588
AppSec [baseline] (50.737 ms) : 0, 50737
AppSec [candidate] (50.461 ms) : 0, 50461
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (606.246 µs) : 0, 606
Remote Config [candidate] (596.147 µs) : 0, 596
Telemetry [baseline] (7.999 ms) : 0, 7999
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (27.728 ms) : 0, 27728
IAST [candidate] (27.486 ms) : 0, 27486
section profiling
BytebuddyAgent [baseline] (677.626 ms) : 0, 677626
BytebuddyAgent [candidate] (671.993 ms) : 0, 671993
GlobalTracer [baseline] (376.014 ms) : 0, 376014
GlobalTracer [candidate] (374.432 ms) : 0, 374432
AppSec [baseline] (62.159 ms) : 0, 62159
AppSec [candidate] (61.678 ms) : 0, 61678
Debugger [baseline] (6.276 ms) : 0, 6276
Debugger [candidate] (6.272 ms) : 0, 6272
Remote Config [baseline] (661.593 µs) : 0, 662
Remote Config [candidate] (655.948 µs) : 0, 656
Telemetry [baseline] (8.231 ms) : 0, 8231
Telemetry [candidate] (8.058 ms) : 0, 8058
ProfilingAgent [baseline] (103.561 ms) : 0, 103561
ProfilingAgent [candidate] (102.82 ms) : 0, 102820
Profiling [baseline] (103.586 ms) : 0, 103586
Profiling [candidate] (102.844 ms) : 0, 102844
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-20T13:17:10 2025-05-20T13:24:53
git_branch master remove-jmh-if-no-benchmarks
git_commit_date 1747743756 1747746440
git_commit_sha 0ebd52b 861e629
release_version 1.50.0-SNAPSHOT~0ebd52ba72 1.50.0-SNAPSHOT~861e629d36
start_time 2025-05-20T13:16:56 2025-05-20T13:24:39
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747747890 1747747890
ci_job_id 945838329 945838329
ci_pipeline_id 65605981 65605981
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-uus1uqpw-project-304-concurrent-0-pi8jtac4 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-uus1uqpw-project-304-concurrent-0-pi8jtac4 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
.   : milestone, 1358,
appsec (1.737 ms) : 1714, 1761
.   : milestone, 1737,
appsec_no_iast (1.733 ms) : 1709, 1756
.   : milestone, 1733,
code_origins (1.664 ms) : 1636, 1691
.   : milestone, 1664,
iast (1.517 ms) : 1493, 1541
.   : milestone, 1517,
profiling (1.517 ms) : 1494, 1541
.   : milestone, 1517,
tracing (1.479 ms) : 1454, 1503
.   : milestone, 1479,
section candidate
no_agent (1.353 ms) : 1334, 1373
.   : milestone, 1353,
appsec (1.736 ms) : 1713, 1760
.   : milestone, 1736,
appsec_no_iast (1.718 ms) : 1695, 1742
.   : milestone, 1718,
code_origins (1.676 ms) : 1649, 1704
.   : milestone, 1676,
iast (1.501 ms) : 1477, 1525
.   : milestone, 1501,
profiling (1.527 ms) : 1502, 1552
.   : milestone, 1527,
tracing (1.475 ms) : 1450, 1500
.   : milestone, 1475,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.338 ms, 1.377 ms] -
appsec 1.737 ms [1.714 ms, 1.761 ms] 379.724 µs (28.0%)
appsec_no_iast 1.733 ms [1.709 ms, 1.756 ms] 375.011 µs (27.6%)
code_origins 1.664 ms [1.636 ms, 1.691 ms] 306.066 µs (22.5%)
iast 1.517 ms [1.493 ms, 1.541 ms] 159.694 µs (11.8%)
profiling 1.517 ms [1.494 ms, 1.541 ms] 159.794 µs (11.8%)
tracing 1.479 ms [1.454 ms, 1.503 ms] 121.179 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.334 ms, 1.373 ms] -
appsec 1.736 ms [1.713 ms, 1.76 ms] 382.862 µs (28.3%)
appsec_no_iast 1.718 ms [1.695 ms, 1.742 ms] 364.99 µs (27.0%)
code_origins 1.676 ms [1.649 ms, 1.704 ms] 323.113 µs (23.9%)
iast 1.501 ms [1.477 ms, 1.525 ms] 147.616 µs (10.9%)
profiling 1.527 ms [1.502 ms, 1.552 ms] 173.695 µs (12.8%)
tracing 1.475 ms [1.45 ms, 1.5 ms] 121.822 µs (9.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.767 µs) : 359, 401
.   : milestone, 380,
iast (510.384 µs) : 488, 532
.   : milestone, 510,
iast_FULL (737.262 µs) : 715, 759
.   : milestone, 737,
iast_GLOBAL (560.989 µs) : 539, 583
.   : milestone, 561,
iast_HARDCODED_SECRET_DISABLED (526.811 µs) : 503, 550
.   : milestone, 527,
iast_INACTIVE (464.827 µs) : 442, 488
.   : milestone, 465,
iast_TELEMETRY_OFF (503.12 µs) : 480, 526
.   : milestone, 503,
tracing (457.741 µs) : 435, 480
.   : milestone, 458,
section candidate
no_agent (379.731 µs) : 360, 399
.   : milestone, 380,
iast (520.045 µs) : 497, 543
.   : milestone, 520,
iast_FULL (731.046 µs) : 709, 753
.   : milestone, 731,
iast_GLOBAL (564.884 µs) : 543, 587
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (524.872 µs) : 502, 548
.   : milestone, 525,
iast_INACTIVE (458.881 µs) : 437, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (512.395 µs) : 489, 535
.   : milestone, 512,
tracing (458.501 µs) : 436, 481
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.767 µs [358.691 µs, 400.844 µs] -
iast 510.384 µs [488.477 µs, 532.29 µs] 130.616 µs (34.4%)
iast_FULL 737.262 µs [715.405 µs, 759.119 µs] 357.494 µs (94.1%)
iast_GLOBAL 560.989 µs [538.853 µs, 583.124 µs] 181.221 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED 526.811 µs [503.302 µs, 550.319 µs] 147.043 µs (38.7%)
iast_INACTIVE 464.827 µs [441.941 µs, 487.714 µs] 85.06 µs (22.4%)
iast_TELEMETRY_OFF 503.12 µs [479.859 µs, 526.381 µs] 123.352 µs (32.5%)
tracing 457.741 µs [435.267 µs, 480.214 µs] 77.973 µs (20.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.731 µs [359.982 µs, 399.48 µs] -
iast 520.045 µs [496.939 µs, 543.152 µs] 140.314 µs (37.0%)
iast_FULL 731.046 µs [709.233 µs, 752.86 µs] 351.315 µs (92.5%)
iast_GLOBAL 564.884 µs [542.533 µs, 587.234 µs] 185.153 µs (48.8%)
iast_HARDCODED_SECRET_DISABLED 524.872 µs [501.775 µs, 547.969 µs] 145.141 µs (38.2%)
iast_INACTIVE 458.881 µs [436.712 µs, 481.049 µs] 79.15 µs (20.8%)
iast_TELEMETRY_OFF 512.395 µs [489.33 µs, 535.46 µs] 132.664 µs (34.9%)
tracing 458.501 µs [436.104 µs, 480.898 µs] 78.77 µs (20.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master remove-jmh-if-no-benchmarks
git_commit_date 1747743756 1747746440
git_commit_sha 0ebd52b 861e629
release_version 1.50.0-SNAPSHOT~0ebd52ba72 1.50.0-SNAPSHOT~861e629d36
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747748393 1747748393
ci_job_id 945838331 945838331
ci_pipeline_id 65605981 65605981
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qba76gvb-project-304-concurrent-1-0w2ck24p 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qba76gvb-project-304-concurrent-1-0w2ck24p 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.422 s) : 15422000, 15422000
.   : milestone, 15422000,
appsec (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
iast (19.173 s) : 19173000, 19173000
.   : milestone, 19173000,
iast_GLOBAL (18.12 s) : 18120000, 18120000
.   : milestone, 18120000,
profiling (14.89 s) : 14890000, 14890000
.   : milestone, 14890000,
tracing (15.072 s) : 15072000, 15072000
.   : milestone, 15072000,
section candidate
no_agent (15.447 s) : 15447000, 15447000
.   : milestone, 15447000,
appsec (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
profiling (15.085 s) : 15085000, 15085000
.   : milestone, 15085000,
tracing (15.181 s) : 15181000, 15181000
.   : milestone, 15181000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.422 s [15.422 s, 15.422 s] -
appsec 14.93 s [14.93 s, 14.93 s] -492.0 ms (-3.2%)
iast 19.173 s [19.173 s, 19.173 s] 3.751 s (24.3%)
iast_GLOBAL 18.12 s [18.12 s, 18.12 s] 2.698 s (17.5%)
profiling 14.89 s [14.89 s, 14.89 s] -532.0 ms (-3.4%)
tracing 15.072 s [15.072 s, 15.072 s] -350.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.447 s [15.447 s, 15.447 s] -
appsec 15.055 s [15.055 s, 15.055 s] -392.0 ms (-2.5%)
iast 18.553 s [18.553 s, 18.553 s] 3.106 s (20.1%)
iast_GLOBAL 18.258 s [18.258 s, 18.258 s] 2.811 s (18.2%)
profiling 15.085 s [15.085 s, 15.085 s] -362.0 ms (-2.3%)
tracing 15.181 s [15.181 s, 15.181 s] -266.0 ms (-1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1486
.   : milestone, 1475,
appsec (2.403 ms) : 2354, 2452
.   : milestone, 2403,
iast (2.185 ms) : 2123, 2247
.   : milestone, 2185,
iast_GLOBAL (2.228 ms) : 2166, 2291
.   : milestone, 2228,
profiling (2.029 ms) : 1979, 2078
.   : milestone, 2029,
tracing (2.02 ms) : 1972, 2068
.   : milestone, 2020,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.405 ms) : 2356, 2454
.   : milestone, 2405,
iast (2.185 ms) : 2122, 2247
.   : milestone, 2185,
iast_GLOBAL (2.226 ms) : 2164, 2289
.   : milestone, 2226,
profiling (2.505 ms) : 2325, 2686
.   : milestone, 2505,
tracing (2.006 ms) : 1958, 2054
.   : milestone, 2006,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.486 ms] -
appsec 2.403 ms [2.354 ms, 2.452 ms] 927.986 µs (62.9%)
iast 2.185 ms [2.123 ms, 2.247 ms] 710.194 µs (48.1%)
iast_GLOBAL 2.228 ms [2.166 ms, 2.291 ms] 753.166 µs (51.1%)
profiling 2.029 ms [1.979 ms, 2.078 ms] 553.656 µs (37.5%)
tracing 2.02 ms [1.972 ms, 2.068 ms] 545.096 µs (37.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.405 ms [2.356 ms, 2.454 ms] 935.039 µs (63.6%)
iast 2.185 ms [2.122 ms, 2.247 ms] 714.914 µs (48.6%)
iast_GLOBAL 2.226 ms [2.164 ms, 2.289 ms] 756.637 µs (51.5%)
profiling 2.505 ms [2.325 ms, 2.686 ms] 1.036 ms (70.5%)
tracing 2.006 ms [1.958 ms, 2.054 ms] 536.092 µs (36.5%)

@bric3 bric3 merged commit de3871c into master May 20, 2025
544 of 589 checks passed
@bric3 bric3 deleted the remove-jmh-if-no-benchmarks branch May 20, 2025 14:47
@github-actions github-actions bot added this to the 1.50.0 milestone May 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mcculls mcculls mcculls left review comments

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@sarahchen6 sarahchen6 sarahchen6 approved these changes

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
4 participants
@bric3 @mcculls @PerfectSlayer @sarahchen6