Skip to content

Gary/add llmobs svc functionalities traceid #8505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 14 commits into from
Closed

Gary/add llmobs svc functionalities traceid #8505

wants to merge 14 commits into from

Conversation

gary-huang
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0b4f8a8 to 738eb77 Compare March 4, 2025 16:17
@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1743434026 1743442139
git_commit_sha d08dc3a 63275f6
release_version 1.48.0-SNAPSHOT~d08dc3a3c5 1.48.0-SNAPSHOT~63275f6409
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743445419 1743445419
ci_job_id 873207679 873207679
ci_pipeline_id 60553774 60553774
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-rewukxas-project-304-concurrent-2-4ec8t86j 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-rewukxas-project-304-concurrent-2-4ec8t86j 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 67 metrics, 4 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1052848
Total [baseline] (10.474 s) : 0, 10474496
Agent [candidate] (1.053 s) : 0, 1053095
Total [candidate] (10.523 s) : 0, 10523015
section appsec
Agent [baseline] (1.19 s) : 0, 1190463
Total [baseline] (10.733 s) : 0, 10733141
Agent [candidate] (1.191 s) : 0, 1191466
Total [candidate] (10.759 s) : 0, 10759071
section iast
Agent [baseline] (1.182 s) : 0, 1181676
Total [baseline] (11.169 s) : 0, 11169217
Agent [candidate] (1.181 s) : 0, 1180877
Total [candidate] (11.178 s) : 0, 11177749
section profiling
Agent [baseline] (1.276 s) : 0, 1275622
Total [baseline] (10.867 s) : 0, 10867076
Agent [candidate] (1.274 s) : 0, 1274425
Total [candidate] (10.895 s) : 0, 10894981
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.19 s 137.615 ms (13.1%)
Agent iast 1.182 s 128.828 ms (12.2%)
Agent profiling 1.276 s 222.774 ms (21.2%)
Total tracing 10.474 s -
Total appsec 10.733 s 258.646 ms (2.5%)
Total iast 11.169 s 694.722 ms (6.6%)
Total profiling 10.867 s 392.581 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.191 s 138.37 ms (13.1%)
Agent iast 1.181 s 127.782 ms (12.1%)
Agent profiling 1.274 s 221.33 ms (21.0%)
Total tracing 10.523 s -
Total appsec 10.759 s 236.056 ms (2.2%)
Total iast 11.178 s 654.733 ms (6.2%)
Total profiling 10.895 s 371.966 ms (3.5%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.022 ms) : 0, 718022
BytebuddyAgent [candidate] (723.185 ms) : 0, 723185
GlobalTracer [baseline] (239.679 ms) : 0, 239679
GlobalTracer [candidate] (241.16 ms) : 0, 241160
AppSec [baseline] (54.556 ms) : 0, 54556
AppSec [candidate] (55.331 ms) : 0, 55331
Debugger [baseline] (4.494 ms) : 0, 4494
Debugger [candidate] (6.565 ms) : 0, 6565
Remote Config [baseline] (689.707 µs) : 0, 690
Remote Config [candidate] (726.247 µs) : 0, 726
Telemetry [baseline] (14.207 ms) : 0, 14207
Telemetry [candidate] (10.007 ms) : 0, 10007
section appsec
BytebuddyAgent [baseline] (735.091 ms) : 0, 735091
BytebuddyAgent [candidate] (738.216 ms) : 0, 738216
GlobalTracer [baseline] (235.376 ms) : 0, 235376
GlobalTracer [candidate] (236.873 ms) : 0, 236873
AppSec [baseline] (175.683 ms) : 0, 175683
AppSec [candidate] (176.438 ms) : 0, 176438
Debugger [baseline] (4.257 ms) : 0, 4257
Debugger [candidate] (4.284 ms) : 0, 4284
Remote Config [baseline] (630.967 µs) : 0, 631
Remote Config [candidate] (642.632 µs) : 0, 643
Telemetry [baseline] (8.225 ms) : 0, 8225
Telemetry [candidate] (8.175 ms) : 0, 8175
IAST [baseline] (21.54 ms) : 0, 21540
IAST [candidate] (21.509 ms) : 0, 21509
section iast
BytebuddyAgent [baseline] (838.755 ms) : 0, 838755
BytebuddyAgent [candidate] (841.104 ms) : 0, 841104
GlobalTracer [baseline] (230.1 ms) : 0, 230100
GlobalTracer [candidate] (231.308 ms) : 0, 231308
AppSec [baseline] (55.26 ms) : 0, 55260
AppSec [candidate] (56.065 ms) : 0, 56065
Debugger [baseline] (4.182 ms) : 0, 4182
Debugger [candidate] (4.181 ms) : 0, 4181
Remote Config [baseline] (594.681 µs) : 0, 595
Remote Config [candidate] (603.614 µs) : 0, 604
Telemetry [baseline] (8.757 ms) : 0, 8757
Telemetry [candidate] (8.775 ms) : 0, 8775
IAST [baseline] (23.596 ms) : 0, 23596
IAST [candidate] (22.85 ms) : 0, 22850
section profiling
ProfilingAgent [baseline] (102.606 ms) : 0, 102606
ProfilingAgent [candidate] (102.167 ms) : 0, 102167
BytebuddyAgent [baseline] (709.938 ms) : 0, 709938
BytebuddyAgent [candidate] (711.003 ms) : 0, 711003
GlobalTracer [baseline] (349.285 ms) : 0, 349285
GlobalTracer [candidate] (351.873 ms) : 0, 351873
AppSec [baseline] (54.17 ms) : 0, 54170
AppSec [candidate] (53.61 ms) : 0, 53610
Debugger [baseline] (4.302 ms) : 0, 4302
Debugger [candidate] (4.296 ms) : 0, 4296
Remote Config [baseline] (688.676 µs) : 0, 689
Remote Config [candidate] (702.879 µs) : 0, 703
Telemetry [baseline] (8.991 ms) : 0, 8991
Telemetry [candidate] (8.936 ms) : 0, 8936
Profiling [baseline] (102.631 ms) : 0, 102631
Profiling [candidate] (102.194 ms) : 0, 102194
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062222
Total [baseline] (8.707 s) : 0, 8706946
Agent [candidate] (1.053 s) : 0, 1052884
Total [candidate] (8.67 s) : 0, 8669770
section iast
Agent [baseline] (1.181 s) : 0, 1181477
Total [baseline] (9.25 s) : 0, 9249661
Agent [candidate] (1.191 s) : 0, 1190798
Total [candidate] (9.385 s) : 0, 9385013
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1181899
Total [baseline] (9.215 s) : 0, 9215254
Agent [candidate] (1.195 s) : 0, 1194922
Total [candidate] (9.28 s) : 0, 9280260
section iast_TELEMETRY_OFF
Agent [baseline] (1.177 s) : 0, 1177072
Total [baseline] (9.236 s) : 0, 9236347
Agent [candidate] (1.173 s) : 0, 1173454
Total [candidate] (9.253 s) : 0, 9253497
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.181 s 119.255 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 119.677 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.177 s 114.85 ms (10.8%)
Total tracing 8.707 s -
Total iast 9.25 s 542.715 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.215 s 508.307 ms (5.8%)
Total iast_TELEMETRY_OFF 9.236 s 529.4 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.191 s 137.914 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 142.038 ms (13.5%)
Agent iast_TELEMETRY_OFF 1.173 s 120.57 ms (11.5%)
Total tracing 8.67 s -
Total iast 9.385 s 715.242 ms (8.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.28 s 610.49 ms (7.0%)
Total iast_TELEMETRY_OFF 9.253 s 583.727 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (724.738 ms) : 0, 724738
BytebuddyAgent [candidate] (720.976 ms) : 0, 720976
GlobalTracer [baseline] (242.005 ms) : 0, 242005
GlobalTracer [candidate] (240.755 ms) : 0, 240755
AppSec [baseline] (55.252 ms) : 0, 55252
AppSec [candidate] (54.854 ms) : 0, 54854
Debugger [baseline] (4.472 ms) : 0, 4472
Debugger [candidate] (4.428 ms) : 0, 4428
Remote Config [baseline] (688.232 µs) : 0, 688
Remote Config [candidate] (720.371 µs) : 0, 720
Telemetry [baseline] (14.428 ms) : 0, 14428
Telemetry [candidate] (15.029 ms) : 0, 15029
section iast
BytebuddyAgent [baseline] (839.166 ms) : 0, 839166
BytebuddyAgent [candidate] (848.58 ms) : 0, 848580
GlobalTracer [baseline] (229.799 ms) : 0, 229799
GlobalTracer [candidate] (232.738 ms) : 0, 232738
AppSec [baseline] (55.657 ms) : 0, 55657
AppSec [candidate] (56.451 ms) : 0, 56451
Debugger [baseline] (4.185 ms) : 0, 4185
Debugger [candidate] (4.21 ms) : 0, 4210
Remote Config [baseline] (598.487 µs) : 0, 598
Remote Config [candidate] (609.32 µs) : 0, 609
Telemetry [baseline] (8.753 ms) : 0, 8753
Telemetry [candidate] (8.869 ms) : 0, 8869
IAST [baseline] (22.819 ms) : 0, 22819
IAST [candidate] (23.227 ms) : 0, 23227
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (838.552 ms) : 0, 838552
BytebuddyAgent [candidate] (851.684 ms) : 0, 851684
GlobalTracer [baseline] (230.392 ms) : 0, 230392
GlobalTracer [candidate] (233.023 ms) : 0, 233023
AppSec [baseline] (55.818 ms) : 0, 55818
AppSec [candidate] (56.759 ms) : 0, 56759
Debugger [baseline] (4.228 ms) : 0, 4228
Debugger [candidate] (4.242 ms) : 0, 4242
Remote Config [baseline] (603.791 µs) : 0, 604
Remote Config [candidate] (605.419 µs) : 0, 605
Telemetry [baseline] (8.815 ms) : 0, 8815
Telemetry [candidate] (8.927 ms) : 0, 8927
IAST [baseline] (22.956 ms) : 0, 22956
IAST [candidate] (23.506 ms) : 0, 23506
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.696 ms) : 0, 834696
BytebuddyAgent [candidate] (835.545 ms) : 0, 835545
GlobalTracer [baseline] (229.83 ms) : 0, 229830
GlobalTracer [candidate] (230.519 ms) : 0, 230519
AppSec [baseline] (56.227 ms) : 0, 56227
AppSec [candidate] (55.817 ms) : 0, 55817
Debugger [baseline] (4.187 ms) : 0, 4187
Debugger [candidate] (4.118 ms) : 0, 4118
Remote Config [baseline] (620.629 µs) : 0, 621
Remote Config [candidate] (595.034 µs) : 0, 595
Telemetry [baseline] (8.766 ms) : 0, 8766
Telemetry [candidate] (8.588 ms) : 0, 8588
IAST [baseline] (22.294 ms) : 0, 22294
IAST [candidate] (22.256 ms) : 0, 22256
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-31T17:51:49 2025-03-31T17:59:35
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1743434026 1743442139
git_commit_sha d08dc3a 63275f6
release_version 1.48.0-SNAPSHOT~d08dc3a3c5 1.48.0-SNAPSHOT~63275f6409
start_time 2025-03-31T17:51:34 2025-03-31T17:59:20
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743444375 1743444375
ci_job_id 873207680 873207680
ci_pipeline_id 60553774 60553774
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-rewukxas-project-304-concurrent-3-bvclois0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-rewukxas-project-304-concurrent-3-bvclois0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5
    dateFormat X
    axisFormat %s
section baseline
no_agent (395.055 µs) : 373, 417
.   : milestone, 395,
iast (514.371 µs) : 493, 536
.   : milestone, 514,
iast_FULL (735.93 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (562.88 µs) : 541, 585
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (520.198 µs) : 498, 542
.   : milestone, 520,
iast_INACTIVE (474.116 µs) : 451, 497
.   : milestone, 474,
iast_TELEMETRY_OFF (507.674 µs) : 486, 530
.   : milestone, 508,
tracing (461.038 µs) : 440, 482
.   : milestone, 461,
section candidate
no_agent (385.208 µs) : 365, 405
.   : milestone, 385,
iast (519.238 µs) : 497, 542
.   : milestone, 519,
iast_FULL (734.683 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (565.409 µs) : 544, 587
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (522.996 µs) : 501, 545
.   : milestone, 523,
iast_INACTIVE (471.256 µs) : 450, 493
.   : milestone, 471,
iast_TELEMETRY_OFF (512.722 µs) : 490, 535
.   : milestone, 513,
tracing (461.696 µs) : 441, 483
.   : milestone, 462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 395.055 µs [373.299 µs, 416.811 µs] -
iast 514.371 µs [492.654 µs, 536.087 µs] 119.315 µs (30.2%)
iast_FULL 735.93 µs [713.961 µs, 757.899 µs] 340.874 µs (86.3%)
iast_GLOBAL 562.88 µs [540.776 µs, 584.984 µs] 167.825 µs (42.5%)
iast_HARDCODED_SECRET_DISABLED 520.198 µs [498.435 µs, 541.961 µs] 125.143 µs (31.7%)
iast_INACTIVE 474.116 µs [451.311 µs, 496.921 µs] 79.061 µs (20.0%)
iast_TELEMETRY_OFF 507.674 µs [485.548 µs, 529.8 µs] 112.619 µs (28.5%)
tracing 461.038 µs [439.891 µs, 482.186 µs] 65.983 µs (16.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.208 µs [365.383 µs, 405.033 µs] -
iast 519.238 µs [496.838 µs, 541.638 µs] 134.03 µs (34.8%)
iast_FULL 734.683 µs [712.724 µs, 756.642 µs] 349.474 µs (90.7%)
iast_GLOBAL 565.409 µs [543.639 µs, 587.179 µs] 180.201 µs (46.8%)
iast_HARDCODED_SECRET_DISABLED 522.996 µs [500.838 µs, 545.154 µs] 137.787 µs (35.8%)
iast_INACTIVE 471.256 µs [449.807 µs, 492.705 µs] 86.048 µs (22.3%)
iast_TELEMETRY_OFF 512.722 µs [489.955 µs, 535.488 µs] 127.513 µs (33.1%)
tracing 461.696 µs [440.754 µs, 482.638 µs] 76.488 µs (19.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.366 ms) : 1346, 1387
.   : milestone, 1366,
appsec (1.744 ms) : 1720, 1768
.   : milestone, 1744,
appsec_no_iast (1.734 ms) : 1710, 1759
.   : milestone, 1734,
code_origins (1.688 ms) : 1662, 1714
.   : milestone, 1688,
iast (1.519 ms) : 1496, 1543
.   : milestone, 1519,
profiling (1.524 ms) : 1500, 1548
.   : milestone, 1524,
tracing (1.508 ms) : 1483, 1534
.   : milestone, 1508,
section candidate
no_agent (1.367 ms) : 1347, 1387
.   : milestone, 1367,
appsec (1.736 ms) : 1713, 1759
.   : milestone, 1736,
appsec_no_iast (1.772 ms) : 1749, 1795
.   : milestone, 1772,
code_origins (1.666 ms) : 1638, 1694
.   : milestone, 1666,
iast (1.516 ms) : 1491, 1540
.   : milestone, 1516,
profiling (1.544 ms) : 1519, 1569
.   : milestone, 1544,
tracing (1.498 ms) : 1473, 1523
.   : milestone, 1498,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.346 ms, 1.387 ms] -
appsec 1.744 ms [1.72 ms, 1.768 ms] 377.708 µs (27.6%)
appsec_no_iast 1.734 ms [1.71 ms, 1.759 ms] 368.253 µs (27.0%)
code_origins 1.688 ms [1.662 ms, 1.714 ms] 321.948 µs (23.6%)
iast 1.519 ms [1.496 ms, 1.543 ms] 153.179 µs (11.2%)
profiling 1.524 ms [1.5 ms, 1.548 ms] 157.997 µs (11.6%)
tracing 1.508 ms [1.483 ms, 1.534 ms] 142.064 µs (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.347 ms, 1.387 ms] -
appsec 1.736 ms [1.713 ms, 1.759 ms] 368.475 µs (26.9%)
appsec_no_iast 1.772 ms [1.749 ms, 1.795 ms] 404.405 µs (29.6%)
code_origins 1.666 ms [1.638 ms, 1.694 ms] 298.618 µs (21.8%)
iast 1.516 ms [1.491 ms, 1.54 ms] 148.37 µs (10.9%)
profiling 1.544 ms [1.519 ms, 1.569 ms] 176.526 µs (12.9%)
tracing 1.498 ms [1.473 ms, 1.523 ms] 130.629 µs (9.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1743434026 1743442139
git_commit_sha d08dc3a 63275f6
release_version 1.48.0-SNAPSHOT~d08dc3a3c5 1.48.0-SNAPSHOT~63275f6409
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743444815 1743444815
ci_job_id 873207681 873207681
ci_pipeline_id 60553774 60553774
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xjcpkyqs-project-304-concurrent-1-1blid325 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xjcpkyqs-project-304-concurrent-1-1blid325 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.382 s) : 15382000, 15382000
.   : milestone, 15382000,
appsec (14.788 s) : 14788000, 14788000
.   : milestone, 14788000,
iast (18.324 s) : 18324000, 18324000
.   : milestone, 18324000,
iast_GLOBAL (17.99 s) : 17990000, 17990000
.   : milestone, 17990000,
profiling (15.523 s) : 15523000, 15523000
.   : milestone, 15523000,
tracing (15.203 s) : 15203000, 15203000
.   : milestone, 15203000,
section candidate
no_agent (15.442 s) : 15442000, 15442000
.   : milestone, 15442000,
appsec (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
iast (19.052 s) : 19052000, 19052000
.   : milestone, 19052000,
iast_GLOBAL (18.217 s) : 18217000, 18217000
.   : milestone, 18217000,
profiling (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
tracing (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.382 s [15.382 s, 15.382 s] -
appsec 14.788 s [14.788 s, 14.788 s] -594.0 ms (-3.9%)
iast 18.324 s [18.324 s, 18.324 s] 2.942 s (19.1%)
iast_GLOBAL 17.99 s [17.99 s, 17.99 s] 2.608 s (17.0%)
profiling 15.523 s [15.523 s, 15.523 s] 141.0 ms (0.9%)
tracing 15.203 s [15.203 s, 15.203 s] -179.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.442 s [15.442 s, 15.442 s] -
appsec 14.956 s [14.956 s, 14.956 s] -486.0 ms (-3.1%)
iast 19.052 s [19.052 s, 19.052 s] 3.61 s (23.4%)
iast_GLOBAL 18.217 s [18.217 s, 18.217 s] 2.775 s (18.0%)
profiling 15.147 s [15.147 s, 15.147 s] -295.0 ms (-1.9%)
tracing 14.995 s [14.995 s, 14.995 s] -447.0 ms (-2.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~63275f6409, baseline=1.48.0-SNAPSHOT~d08dc3a3c5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.353 ms) : 2306, 2400
.   : milestone, 2353,
iast (2.147 ms) : 2088, 2206
.   : milestone, 2147,
iast_GLOBAL (2.188 ms) : 2129, 2248
.   : milestone, 2188,
profiling (2.001 ms) : 1954, 2047
.   : milestone, 2001,
tracing (1.969 ms) : 1923, 2014
.   : milestone, 1969,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.367 ms) : 2320, 2414
.   : milestone, 2367,
iast (2.15 ms) : 2091, 2209
.   : milestone, 2150,
iast_GLOBAL (2.195 ms) : 2135, 2255
.   : milestone, 2195,
profiling (2.015 ms) : 1966, 2064
.   : milestone, 2015,
tracing (1.97 ms) : 1925, 2016
.   : milestone, 1970,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.353 ms [2.306 ms, 2.4 ms] 882.741 µs (60.0%)
iast 2.147 ms [2.088 ms, 2.206 ms] 676.775 µs (46.0%)
iast_GLOBAL 2.188 ms [2.129 ms, 2.248 ms] 717.792 µs (48.8%)
profiling 2.001 ms [1.954 ms, 2.047 ms] 529.972 µs (36.0%)
tracing 1.969 ms [1.923 ms, 2.014 ms] 498.093 µs (33.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.367 ms [2.32 ms, 2.414 ms] 896.848 µs (61.0%)
iast 2.15 ms [2.091 ms, 2.209 ms] 679.394 µs (46.2%)
iast_GLOBAL 2.195 ms [2.135 ms, 2.255 ms] 724.847 µs (49.3%)
profiling 2.015 ms [1.966 ms, 2.064 ms] 544.65 µs (37.0%)
tracing 1.97 ms [1.925 ms, 2.016 ms] 500.159 µs (34.0%)

@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch 3 times, most recently from 707295a to ebec127 Compare March 5, 2025 19:54
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from f9a3902 to b5d1199 Compare March 5, 2025 20:14
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from ebec127 to f0215ef Compare March 5, 2025 20:35
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from 2080275 to 43a996f Compare March 5, 2025 20:40
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from f0215ef to edeca5c Compare March 5, 2025 21:32
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 3 times, most recently from 592dbc5 to d37b718 Compare March 5, 2025 21:38
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch 2 times, most recently from 0e7c1e5 to 0b04221 Compare March 7, 2025 00:02
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from d3dac5f to 1f81260 Compare March 7, 2025 00:05
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0b04221 to 0bf8eb0 Compare March 7, 2025 03:33
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 4 times, most recently from 2a053a8 to 6f995a0 Compare March 7, 2025 12:31
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0bf8eb0 to 1d5dcc0 Compare March 7, 2025 13:50
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch from 6f995a0 to 2a57453 Compare March 7, 2025 13:54
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 1d5dcc0 to dad55c7 Compare March 7, 2025 14:07
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch from 2a57453 to c390963 Compare March 7, 2025 14:08
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from dad55c7 to d2b3270 Compare March 26, 2025 14:57
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from d2b3270 to f858e30 Compare March 26, 2025 15:28
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch from c390963 to 63275f6 Compare March 31, 2025 17:29
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from f858e30 to fb0af52 Compare April 11, 2025 01:54
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from fb0af52 to e0b4510 Compare April 21, 2025 14:04
@gary-huang gary-huang closed this Apr 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gary-huang