Skip to content

Disable muzzle in gitlab #8475

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 3, 2025
Merged

Conversation

randomanderson
Copy link
Contributor

What Does This Do

Disables the muzzle jobs from running in Gitlab. Additional, the required job uses "optional" so that jobs missing because of rules are non-blocking/

Motivation

Muzzle is cause rate limits to be hit with Sonatype.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Copy link
Contributor

github-actions bot commented Feb 28, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@randomanderson randomanderson force-pushed the landerson/disable-muzzle-gitlab branch from eb1729b to 61a22a4 Compare February 28, 2025 18:05
@pr-commenter
Copy link

pr-commenter bot commented Feb 28, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/disable-muzzle-gitlab
git_commit_date 1740765357 1740765931
git_commit_sha dceca28 61a22a4
release_version 1.47.0-SNAPSHOT~dceca289e9 1.47.0-SNAPSHOT~61a22a43e8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740768455 1740768455
ci_job_id 828310414 828310414
ci_pipeline_id 57379673 57379673
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zrt-bbxu-project-304-concurrent-0-pvk9nfz7 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zrt-bbxu-project-304-concurrent-0-pvk9nfz7 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 68 metrics, 3 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.134 s) : 0, 1134104
Total [baseline] (11.478 s) : 0, 11478476
Agent [candidate] (1.134 s) : 0, 1134482
Total [candidate] (11.465 s) : 0, 11464766
section appsec
Agent [baseline] (1.272 s) : 0, 1272091
Total [baseline] (11.667 s) : 0, 11667393
Agent [candidate] (1.272 s) : 0, 1271746
Total [candidate] (11.696 s) : 0, 11696126
section iast
Agent [baseline] (1.265 s) : 0, 1265340
Total [baseline] (11.993 s) : 0, 11992914
Agent [candidate] (1.259 s) : 0, 1258528
Total [candidate] (11.915 s) : 0, 11914888
section profiling
Agent [baseline] (1.39 s) : 0, 1390095
Total [baseline] (11.917 s) : 0, 11916723
Agent [candidate] (1.382 s) : 0, 1382071
Total [candidate] (11.809 s) : 0, 11809030
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.134 s -
Agent appsec 1.272 s 137.987 ms (12.2%)
Agent iast 1.265 s 131.236 ms (11.6%)
Agent profiling 1.39 s 255.991 ms (22.6%)
Total tracing 11.478 s -
Total appsec 11.667 s 188.916 ms (1.6%)
Total iast 11.993 s 514.437 ms (4.5%)
Total profiling 11.917 s 438.246 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.134 s -
Agent appsec 1.272 s 137.264 ms (12.1%)
Agent iast 1.259 s 124.045 ms (10.9%)
Agent profiling 1.382 s 247.589 ms (21.8%)
Total tracing 11.465 s -
Total appsec 11.696 s 231.361 ms (2.0%)
Total iast 11.915 s 450.122 ms (3.9%)
Total profiling 11.809 s 344.264 ms (3.0%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.88 ms) : 0, 716880
BytebuddyAgent [candidate] (716.741 ms) : 0, 716741
GlobalTracer [baseline] (239.012 ms) : 0, 239012
GlobalTracer [candidate] (238.869 ms) : 0, 238869
AppSec [baseline] (55.785 ms) : 0, 55785
AppSec [candidate] (55.545 ms) : 0, 55545
Debugger [baseline] (94.458 ms) : 0, 94458
Debugger [candidate] (95.478 ms) : 0, 95478
Remote Config [baseline] (578.57 µs) : 0, 579
Remote Config [candidate] (585.787 µs) : 0, 586
Telemetry [baseline] (12.426 ms) : 0, 12426
Telemetry [candidate] (12.343 ms) : 0, 12343
section appsec
BytebuddyAgent [baseline] (735.21 ms) : 0, 735210
BytebuddyAgent [candidate] (734.546 ms) : 0, 734546
GlobalTracer [baseline] (236.329 ms) : 0, 236329
GlobalTracer [candidate] (236.091 ms) : 0, 236091
IAST [baseline] (21.66 ms) : 0, 21660
IAST [candidate] (21.519 ms) : 0, 21519
AppSec [baseline] (176.979 ms) : 0, 176979
AppSec [candidate] (178.049 ms) : 0, 178049
Debugger [baseline] (84.84 ms) : 0, 84840
Debugger [candidate] (84.369 ms) : 0, 84369
Remote Config [baseline] (630.69 µs) : 0, 631
Remote Config [candidate] (617.376 µs) : 0, 617
Telemetry [baseline] (12.314 ms) : 0, 12314
Telemetry [candidate] (12.313 ms) : 0, 12313
section iast
BytebuddyAgent [baseline] (842.513 ms) : 0, 842513
BytebuddyAgent [candidate] (837.115 ms) : 0, 837115
GlobalTracer [baseline] (230.887 ms) : 0, 230887
GlobalTracer [candidate] (230.059 ms) : 0, 230059
IAST [baseline] (22.93 ms) : 0, 22930
IAST [candidate] (22.836 ms) : 0, 22836
AppSec [baseline] (57.347 ms) : 0, 57347
AppSec [candidate] (57.325 ms) : 0, 57325
Debugger [baseline] (83.853 ms) : 0, 83853
Debugger [candidate] (83.378 ms) : 0, 83378
Remote Config [baseline] (520.913 µs) : 0, 521
Remote Config [candidate] (519.449 µs) : 0, 519
Telemetry [baseline] (12.184 ms) : 0, 12184
Telemetry [candidate] (12.272 ms) : 0, 12272
section profiling
BytebuddyAgent [baseline] (716.974 ms) : 0, 716974
BytebuddyAgent [candidate] (710.631 ms) : 0, 710631
GlobalTracer [baseline] (350.749 ms) : 0, 350749
GlobalTracer [candidate] (351.757 ms) : 0, 351757
AppSec [baseline] (55.612 ms) : 0, 55612
AppSec [candidate] (54.857 ms) : 0, 54857
Debugger [baseline] (88.686 ms) : 0, 88686
Debugger [candidate] (88.613 ms) : 0, 88613
Remote Config [baseline] (611.334 µs) : 0, 611
Remote Config [candidate] (619.493 µs) : 0, 619
Telemetry [baseline] (12.564 ms) : 0, 12564
Telemetry [candidate] (12.709 ms) : 0, 12709
ProfilingAgent [baseline] (124.256 ms) : 0, 124256
ProfilingAgent [candidate] (122.618 ms) : 0, 122618
Profiling [baseline] (124.277 ms) : 0, 124277
Profiling [candidate] (122.639 ms) : 0, 122639
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.133 s) : 0, 1133305
Total [baseline] (9.256 s) : 0, 9256122
Agent [candidate] (1.134 s) : 0, 1134408
Total [candidate] (9.279 s) : 0, 9279287
section iast
Agent [baseline] (1.252 s) : 0, 1251770
Total [baseline] (9.849 s) : 0, 9848599
Agent [candidate] (1.275 s) : 0, 1274688
Total [candidate] (9.945 s) : 0, 9945467
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.259 s) : 0, 1258630
Total [baseline] (9.903 s) : 0, 9903380
Agent [candidate] (1.259 s) : 0, 1259235
Total [candidate] (9.9 s) : 0, 9900051
section iast_TELEMETRY_OFF
Agent [baseline] (1.25 s) : 0, 1250487
Total [baseline] (9.878 s) : 0, 9878204
Agent [candidate] (1.254 s) : 0, 1254119
Total [candidate] (9.957 s) : 0, 9956931
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.133 s -
Agent iast 1.252 s 118.466 ms (10.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.259 s 125.325 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.25 s 117.182 ms (10.3%)
Total tracing 9.256 s -
Total iast 9.849 s 592.477 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.903 s 647.257 ms (7.0%)
Total iast_TELEMETRY_OFF 9.878 s 622.082 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.134 s -
Agent iast 1.275 s 140.279 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.259 s 124.827 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.254 s 119.71 ms (10.6%)
Total tracing 9.279 s -
Total iast 9.945 s 666.18 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.9 s 620.764 ms (6.7%)
Total iast_TELEMETRY_OFF 9.957 s 677.645 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.812 ms) : 0, 715812
BytebuddyAgent [candidate] (715.641 ms) : 0, 715641
GlobalTracer [baseline] (238.834 ms) : 0, 238834
GlobalTracer [candidate] (239.251 ms) : 0, 239251
AppSec [baseline] (55.624 ms) : 0, 55624
AppSec [candidate] (56.026 ms) : 0, 56026
Debugger [baseline] (95.144 ms) : 0, 95144
Debugger [candidate] (95.392 ms) : 0, 95392
Remote Config [baseline] (582.852 µs) : 0, 583
Remote Config [candidate] (578.515 µs) : 0, 579
Telemetry [baseline] (12.396 ms) : 0, 12396
Telemetry [candidate] (12.526 ms) : 0, 12526
section iast
BytebuddyAgent [baseline] (833.013 ms) : 0, 833013
BytebuddyAgent [candidate] (849.248 ms) : 0, 849248
GlobalTracer [baseline] (228.6 ms) : 0, 228600
GlobalTracer [candidate] (232.232 ms) : 0, 232232
IAST [baseline] (22.67 ms) : 0, 22670
IAST [candidate] (23.238 ms) : 0, 23238
AppSec [baseline] (57.074 ms) : 0, 57074
AppSec [candidate] (57.802 ms) : 0, 57802
Debugger [baseline] (82.914 ms) : 0, 82914
Debugger [candidate] (84.106 ms) : 0, 84106
Remote Config [baseline] (516.205 µs) : 0, 516
Remote Config [candidate] (526.358 µs) : 0, 526
Telemetry [baseline] (12.074 ms) : 0, 12074
Telemetry [candidate] (12.299 ms) : 0, 12299
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.01 ms) : 0, 836010
BytebuddyAgent [candidate] (835.265 ms) : 0, 835265
GlobalTracer [baseline] (230.098 ms) : 0, 230098
GlobalTracer [candidate] (231.231 ms) : 0, 231231
IAST [baseline] (22.768 ms) : 0, 22768
IAST [candidate] (23.264 ms) : 0, 23264
AppSec [baseline] (57.643 ms) : 0, 57643
AppSec [candidate] (57.641 ms) : 0, 57641
Debugger [baseline] (84.297 ms) : 0, 84297
Debugger [candidate] (84.057 ms) : 0, 84057
Remote Config [baseline] (528.601 µs) : 0, 529
Remote Config [candidate] (520.113 µs) : 0, 520
Telemetry [baseline] (12.246 ms) : 0, 12246
Telemetry [candidate] (12.279 ms) : 0, 12279
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (830.663 ms) : 0, 830663
BytebuddyAgent [candidate] (833.888 ms) : 0, 833888
GlobalTracer [baseline] (229.177 ms) : 0, 229177
GlobalTracer [candidate] (229.62 ms) : 0, 229620
IAST [baseline] (23.057 ms) : 0, 23057
IAST [candidate] (23.999 ms) : 0, 23999
AppSec [baseline] (56.323 ms) : 0, 56323
AppSec [candidate] (55.642 ms) : 0, 55642
Debugger [baseline] (83.743 ms) : 0, 83743
Debugger [candidate] (83.35 ms) : 0, 83350
Remote Config [baseline] (538.85 µs) : 0, 539
Remote Config [candidate] (517.44 µs) : 0, 517
Telemetry [baseline] (12.071 ms) : 0, 12071
Telemetry [candidate] (12.107 ms) : 0, 12107
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-28T18:13:20 2025-02-28T18:21:15
git_branch master landerson/disable-muzzle-gitlab
git_commit_date 1740765357 1740765931
git_commit_sha dceca28 61a22a4
release_version 1.47.0-SNAPSHOT~dceca289e9 1.47.0-SNAPSHOT~61a22a43e8
start_time 2025-02-28T18:13:06 2025-02-28T18:21:01
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740767282 1740767282
ci_job_id 828310415 828310415
ci_pipeline_id 57379673 57379673
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ozdivcxc-project-304-concurrent-0-cyko20zs 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ozdivcxc-project-304-concurrent-0-cyko20zs 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.42 µs) : 357, 400
.   : milestone, 378,
iast (511.946 µs) : 490, 534
.   : milestone, 512,
iast_FULL (730.128 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (564.716 µs) : 541, 588
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (511.92 µs) : 490, 534
.   : milestone, 512,
iast_INACTIVE (457.482 µs) : 436, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (501.093 µs) : 479, 523
.   : milestone, 501,
tracing (451.115 µs) : 430, 472
.   : milestone, 451,
section candidate
no_agent (387.278 µs) : 367, 407
.   : milestone, 387,
iast (508.213 µs) : 486, 530
.   : milestone, 508,
iast_FULL (724.908 µs) : 703, 747
.   : milestone, 725,
iast_GLOBAL (568.69 µs) : 546, 592
.   : milestone, 569,
iast_HARDCODED_SECRET_DISABLED (512.793 µs) : 491, 534
.   : milestone, 513,
iast_INACTIVE (459.11 µs) : 438, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (500.95 µs) : 479, 523
.   : milestone, 501,
tracing (456.982 µs) : 436, 478
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.42 µs [356.899 µs, 399.941 µs] -
iast 511.946 µs [489.649 µs, 534.243 µs] 133.526 µs (35.3%)
iast_FULL 730.128 µs [708.03 µs, 752.226 µs] 351.708 µs (92.9%)
iast_GLOBAL 564.716 µs [541.087 µs, 588.346 µs] 186.296 µs (49.2%)
iast_HARDCODED_SECRET_DISABLED 511.92 µs [490.174 µs, 533.666 µs] 133.5 µs (35.3%)
iast_INACTIVE 457.482 µs [436.057 µs, 478.907 µs] 79.062 µs (20.9%)
iast_TELEMETRY_OFF 501.093 µs [478.844 µs, 523.342 µs] 122.673 µs (32.4%)
tracing 451.115 µs [430.427 µs, 471.804 µs] 72.695 µs (19.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.278 µs [367.31 µs, 407.246 µs] -
iast 508.213 µs [486.444 µs, 529.982 µs] 120.935 µs (31.2%)
iast_FULL 724.908 µs [702.796 µs, 747.019 µs] 337.629 µs (87.2%)
iast_GLOBAL 568.69 µs [545.525 µs, 591.856 µs] 181.412 µs (46.8%)
iast_HARDCODED_SECRET_DISABLED 512.793 µs [491.146 µs, 534.439 µs] 125.515 µs (32.4%)
iast_INACTIVE 459.11 µs [437.548 µs, 480.671 µs] 71.832 µs (18.5%)
iast_TELEMETRY_OFF 500.95 µs [479.024 µs, 522.876 µs] 113.672 µs (29.4%)
tracing 456.982 µs [435.569 µs, 478.396 µs] 69.704 µs (18.0%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.38 ms) : 1361, 1400
.   : milestone, 1380,
appsec (1.725 ms) : 1701, 1749
.   : milestone, 1725,
appsec_no_iast (1.722 ms) : 1698, 1745
.   : milestone, 1722,
code_origins (1.695 ms) : 1663, 1728
.   : milestone, 1695,
iast (1.526 ms) : 1500, 1551
.   : milestone, 1526,
profiling (1.508 ms) : 1484, 1532
.   : milestone, 1508,
tracing (1.503 ms) : 1479, 1527
.   : milestone, 1503,
section candidate
no_agent (1.368 ms) : 1348, 1389
.   : milestone, 1368,
appsec (1.724 ms) : 1698, 1749
.   : milestone, 1724,
appsec_no_iast (1.738 ms) : 1715, 1762
.   : milestone, 1738,
code_origins (1.684 ms) : 1651, 1717
.   : milestone, 1684,
iast (1.498 ms) : 1473, 1523
.   : milestone, 1498,
profiling (1.565 ms) : 1539, 1590
.   : milestone, 1565,
tracing (1.486 ms) : 1463, 1509
.   : milestone, 1486,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.38 ms [1.361 ms, 1.4 ms] -
appsec 1.725 ms [1.701 ms, 1.749 ms] 344.791 µs (25.0%)
appsec_no_iast 1.722 ms [1.698 ms, 1.745 ms] 341.214 µs (24.7%)
code_origins 1.695 ms [1.663 ms, 1.728 ms] 315.064 µs (22.8%)
iast 1.526 ms [1.5 ms, 1.551 ms] 145.345 µs (10.5%)
profiling 1.508 ms [1.484 ms, 1.532 ms] 127.715 µs (9.3%)
tracing 1.503 ms [1.479 ms, 1.527 ms] 122.83 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.368 ms [1.348 ms, 1.389 ms] -
appsec 1.724 ms [1.698 ms, 1.749 ms] 355.205 µs (26.0%)
appsec_no_iast 1.738 ms [1.715 ms, 1.762 ms] 369.956 µs (27.0%)
code_origins 1.684 ms [1.651 ms, 1.717 ms] 315.471 µs (23.1%)
iast 1.498 ms [1.473 ms, 1.523 ms] 129.323 µs (9.5%)
profiling 1.565 ms [1.539 ms, 1.59 ms] 196.185 µs (14.3%)
tracing 1.486 ms [1.463 ms, 1.509 ms] 117.596 µs (8.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/disable-muzzle-gitlab
git_commit_date 1740765357 1740765931
git_commit_sha dceca28 61a22a4
release_version 1.47.0-SNAPSHOT~dceca289e9 1.47.0-SNAPSHOT~61a22a43e8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740767954 1740767954
ci_job_id 828310416 828310416
ci_pipeline_id 57379673 57379673
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-bniqe5xm-project-304-concurrent-1-q1k96kjj 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-bniqe5xm-project-304-concurrent-1-q1k96kjj 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1482
.   : milestone, 1471,
appsec (2.331 ms) : 2288, 2375
.   : milestone, 2331,
iast (2.114 ms) : 2059, 2170
.   : milestone, 2114,
iast_GLOBAL (2.154 ms) : 2099, 2210
.   : milestone, 2154,
profiling (1.993 ms) : 1948, 2039
.   : milestone, 1993,
tracing (1.962 ms) : 1920, 2004
.   : milestone, 1962,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.346 ms) : 2302, 2389
.   : milestone, 2346,
iast (2.119 ms) : 2063, 2174
.   : milestone, 2119,
iast_GLOBAL (2.164 ms) : 2108, 2219
.   : milestone, 2164,
profiling (2.439 ms) : 2220, 2658
.   : milestone, 2439,
tracing (1.941 ms) : 1899, 1983
.   : milestone, 1941,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.482 ms] -
appsec 2.331 ms [2.288 ms, 2.375 ms] 860.276 µs (58.5%)
iast 2.114 ms [2.059 ms, 2.17 ms] 643.181 µs (43.7%)
iast_GLOBAL 2.154 ms [2.099 ms, 2.21 ms] 683.374 µs (46.5%)
profiling 1.993 ms [1.948 ms, 2.039 ms] 522.277 µs (35.5%)
tracing 1.962 ms [1.92 ms, 2.004 ms] 490.918 µs (33.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.346 ms [2.302 ms, 2.389 ms] 870.084 µs (59.0%)
iast 2.119 ms [2.063 ms, 2.174 ms] 643.105 µs (43.6%)
iast_GLOBAL 2.164 ms [2.108 ms, 2.219 ms] 687.991 µs (46.6%)
profiling 2.439 ms [2.22 ms, 2.658 ms] 963.737 µs (65.3%)
tracing 1.941 ms [1.899 ms, 1.983 ms] 465.259 µs (31.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~61a22a43e8, baseline=1.47.0-SNAPSHOT~dceca289e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.0 s) : 15000000, 15000000
.   : milestone, 15000000,
appsec (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
iast (18.936 s) : 18936000, 18936000
.   : milestone, 18936000,
iast_GLOBAL (18.09 s) : 18090000, 18090000
.   : milestone, 18090000,
profiling (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
tracing (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
section candidate
no_agent (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
appsec (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
iast (18.738 s) : 18738000, 18738000
.   : milestone, 18738000,
iast_GLOBAL (17.951 s) : 17951000, 17951000
.   : milestone, 17951000,
profiling (14.935 s) : 14935000, 14935000
.   : milestone, 14935000,
tracing (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.0 s [15.0 s, 15.0 s] -
appsec 14.853 s [14.853 s, 14.853 s] -147.0 ms (-1.0%)
iast 18.936 s [18.936 s, 18.936 s] 3.936 s (26.2%)
iast_GLOBAL 18.09 s [18.09 s, 18.09 s] 3.09 s (20.6%)
profiling 14.894 s [14.894 s, 14.894 s] -106.0 ms (-0.7%)
tracing 14.885 s [14.885 s, 14.885 s] -115.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.948 s [14.948 s, 14.948 s] -
appsec 14.83 s [14.83 s, 14.83 s] -118.0 ms (-0.8%)
iast 18.738 s [18.738 s, 18.738 s] 3.79 s (25.4%)
iast_GLOBAL 17.951 s [17.951 s, 17.951 s] 3.003 s (20.1%)
profiling 14.935 s [14.935 s, 14.935 s] -13.0 ms (-0.1%)
tracing 14.807 s [14.807 s, 14.807 s] -141.0 ms (-0.9%)

Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but not sure if we should put in place a proxy before disabling muzzle

CC: @PerfectSlayer

Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, is that an issue having muzzle to fail? Should we keep it failing until we fix the infra, or does it block the migration and your tests? -- I can get the worker IP rated limited and cause issue with other builds / projects.
Let's merge it now to limit the impact and we will revisit it later.

About the optional, isn't weird having optional tasks that are always expected to run? Not sure what the good practice between commenting job requirements versus setting it optional? 🤷

Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unblocking to limit impact of Maven Central rate limiting

@PerfectSlayer PerfectSlayer added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 3, 2025
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) March 3, 2025 09:40
@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes and removed tag: no release notes Changes to exclude from release notes labels Mar 3, 2025
@PerfectSlayer PerfectSlayer merged commit 9adf759 into master Mar 3, 2025
210 of 212 checks passed
@PerfectSlayer PerfectSlayer deleted the landerson/disable-muzzle-gitlab branch March 3, 2025 13:22
@github-actions github-actions bot added this to the 1.47.0 milestone Mar 3, 2025
@randomanderson
Copy link
Contributor Author

@PerfectSlayer optional allows test/checks and the required job to have different lifecycles. optional means "If this job exists, depend on it". Without optional, jobs that run only in nightly or only on master break the pipeline.

The change didn't have to be in this PR, but it was needed generally.

@PerfectSlayer
Copy link
Contributor

I were to read the GitLab doc. But all the checks that are mark optional are always expected to run, whatever the phase / build type 🤔

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants