Skip to content

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Add a test-only TEST_INSTANCE to the CorrelationAccess class. Now instead of mutating a final field in CapturedSnapshotTest to introduce a spy, we can set the spy to be a non-final TEST_INSTANCE.

Motivation

Mutating final fields will introduce warnings starting in Java 26 and be disallowed in a later release (JEP 500).

Additional Notes

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/APMLP-594

@sarahchen6 sarahchen6 force-pushed the sarahchen6/refactor-final-field-mutations branch from d65bf18 to d88e1b4 Compare January 23, 2026 20:15
@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2026

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1769458299 1769458644
end_time 2026-01-26T20:12:59 2026-01-26T20:18:43
git_branch master sarahchen6/refactor-final-field-mutations
git_commit_sha a34cb64 b5ee6b5
start_time 2026-01-26T20:11:39 2026-01-26T20:17:25
See matching parameters
Baseline Candidate
ci_job_id 1378116412 1378116412
ci_pipeline_id 92909152 92909152
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1769457558 1769457558

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-67.396µs; +21.166µs] or [-23.006%; +7.225%]
unstable
[-74.876µs; +29.083µs] or [-22.452%; +8.721%]
unstable
[-91.435µs; +37.109µs] or [-26.032%; +10.565%]
unstable
[-572.725µs; +201.599µs] or [-50.806%; +17.884%]
same
scenario:basic same same same unstable
[-93.176µs; +129.871µs] or [-12.216%; +17.026%]
unstable
[-86.814op/s; +229.062op/s] or [-3.299%; +8.704%]
scenario:loop same same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (333.489 µs) : 269, 398
.   : milestone, 333,
basic (278.035 µs) : 272, 284
.   : milestone, 278,
loop (8.959 ms) : 8954, 8963
.   : milestone, 8959,
section candidate
noprobe (310.592 µs) : 283, 338
.   : milestone, 311,
basic (279.672 µs) : 271, 289
.   : milestone, 280,
loop (8.962 ms) : 8958, 8966
.   : milestone, 8962,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 333.489 µs [269.063 µs, 397.916 µs]
basic 278.035 µs [272.469 µs, 283.601 µs]
loop 8.959 ms [8.954 ms, 8.963 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 310.592 µs [283.256 µs, 337.929 µs]
basic 279.672 µs [270.733 µs, 288.612 µs]
loop 8.962 ms [8.958 ms, 8.966 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/refactor-final-field-mutations
git_commit_date 1769453707 1769457558
git_commit_sha a34cb64 b5ee6b5
release_version 1.59.0-SNAPSHOT~a34cb643aa 1.54.0-SNAPSHOT~b5ee6b5b66
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769459478 1769459478
ci_job_id 1378116400 1378116400
ci_pipeline_id 92909152 92909152
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1cy5qq5q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1cy5qq5q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 8 performance regressions! Performance is the same for 51 metrics, 6 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+10.077ms; +12.757ms] or [+4.066%; +5.147%]
259.265ms 247.848ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+27.731ms; +29.856ms] or [+10.754%; +11.578%]
286.663ms 257.869ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+9.179ms; +16.350ms] or [+3.654%; +6.508%]
263.997ms 251.232ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+9.291ms; +11.633ms] or [+3.743%; +4.686%]
258.707ms 248.245ms
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+4.255ms; +9.094ms] or [+4.634%; +9.906%]
98.475ms 91.801ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+8.649ms; +17.078ms] or [+4.008%; +7.913%]
228.678ms 215.814ms
scenario:startup:petclinic:profiling:Profiling worse
[+4.238ms; +9.089ms] or [+4.587%; +9.837%]
99.059ms 92.396ms
scenario:startup:petclinic:tracing:GlobalTracer worse
[+22.642ms; +28.759ms] or [+8.718%; +11.073%]
285.427ms 259.726ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1101053
Total [baseline] (10.704 s) : 0, 10703535
Agent [candidate] (1.086 s) : 0, 1085515
Total [candidate] (10.797 s) : 0, 10797342
section appsec
Agent [baseline] (1.272 s) : 0, 1272044
Total [baseline] (11.164 s) : 0, 11163573
Agent [candidate] (1.278 s) : 0, 1278164
Total [candidate] (11.034 s) : 0, 11034498
section iast
Agent [baseline] (1.232 s) : 0, 1232442
Total [baseline] (11.136 s) : 0, 11136077
Agent [candidate] (1.226 s) : 0, 1226342
Total [candidate] (11.045 s) : 0, 11045457
section profiling
Agent [baseline] (1.211 s) : 0, 1210549
Total [baseline] (10.959 s) : 0, 10959191
Agent [candidate] (1.231 s) : 0, 1231074
Total [candidate] (11.003 s) : 0, 11002993
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.272 s 170.991 ms (15.5%)
Agent iast 1.232 s 131.389 ms (11.9%)
Agent profiling 1.211 s 109.496 ms (9.9%)
Total tracing 10.704 s -
Total appsec 11.164 s 460.038 ms (4.3%)
Total iast 11.136 s 432.542 ms (4.0%)
Total profiling 10.959 s 255.656 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.278 s 192.649 ms (17.7%)
Agent iast 1.226 s 140.827 ms (13.0%)
Agent profiling 1.231 s 145.56 ms (13.4%)
Total tracing 10.797 s -
Total appsec 11.034 s 237.156 ms (2.2%)
Total iast 11.045 s 248.116 ms (2.3%)
Total profiling 11.003 s 205.651 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (659.772 ms) : 0, 659772
BytebuddyAgent [candidate] (649.621 ms) : 0, 649621
GlobalTracer [baseline] (259.726 ms) : 0, 259726
GlobalTracer [candidate] (285.427 ms) : 0, 285427
AppSec [baseline] (33.279 ms) : 0, 33279
AppSec [candidate] (32.624 ms) : 0, 32624
Debugger [baseline] (68.533 ms) : 0, 68533
Debugger [candidate] (66.416 ms) : 0, 66416
Remote Config [baseline] (626.11 µs) : 0, 626
Remote Config [candidate] (610.953 µs) : 0, 611
Telemetry [baseline] (9.159 ms) : 0, 9159
Telemetry [candidate] (8.913 ms) : 0, 8913
Flare Poller [baseline] (3.693 ms) : 0, 3693
Flare Poller [candidate] (5.26 ms) : 0, 5260
AgentMeter [baseline] (29.315 ms) : 0, 29315
section appsec
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (692.864 ms) : 0, 692864
BytebuddyAgent [candidate] (696.744 ms) : 0, 696744
GlobalTracer [baseline] (251.232 ms) : 0, 251232
GlobalTracer [candidate] (263.997 ms) : 0, 263997
AppSec [baseline] (173.788 ms) : 0, 173788
AppSec [candidate] (174.338 ms) : 0, 174338
Debugger [baseline] (67.374 ms) : 0, 67374
Debugger [candidate] (67.604 ms) : 0, 67604
Remote Config [baseline] (690.591 µs) : 0, 691
Remote Config [candidate] (696.679 µs) : 0, 697
Telemetry [baseline] (9.472 ms) : 0, 9472
Telemetry [candidate] (9.297 ms) : 0, 9297
Flare Poller [baseline] (3.598 ms) : 0, 3598
Flare Poller [candidate] (3.617 ms) : 0, 3617
AgentMeter [baseline] (11.945 ms) : 0, 11945
IAST [baseline] (24.392 ms) : 0, 24392
IAST [candidate] (24.988 ms) : 0, 24988
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (795.56 ms) : 0, 795560
BytebuddyAgent [candidate] (791.569 ms) : 0, 791569
GlobalTracer [baseline] (248.245 ms) : 0, 248245
GlobalTracer [candidate] (258.707 ms) : 0, 258707
AppSec [baseline] (32.593 ms) : 0, 32593
AppSec [candidate] (32.532 ms) : 0, 32532
Debugger [baseline] (68.632 ms) : 0, 68632
Debugger [candidate] (67.543 ms) : 0, 67543
Remote Config [baseline] (536.936 µs) : 0, 537
Remote Config [candidate] (533.107 µs) : 0, 533
Telemetry [baseline] (8.586 ms) : 0, 8586
Telemetry [candidate] (8.453 ms) : 0, 8453
Flare Poller [baseline] (3.468 ms) : 0, 3468
Flare Poller [candidate] (3.443 ms) : 0, 3443
AgentMeter [baseline] (11.276 ms) : 0, 11276
IAST [baseline] (26.956 ms) : 0, 26956
IAST [candidate] (26.985 ms) : 0, 26985
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.251 ms) : 0, 1251
BytebuddyAgent [baseline] (704.234 ms) : 0, 704234
BytebuddyAgent [candidate] (716.257 ms) : 0, 716257
GlobalTracer [baseline] (215.814 ms) : 0, 215814
GlobalTracer [candidate] (228.678 ms) : 0, 228678
AppSec [baseline] (32.471 ms) : 0, 32471
AppSec [candidate] (33.241 ms) : 0, 33241
Debugger [baseline] (67.451 ms) : 0, 67451
Debugger [candidate] (68.599 ms) : 0, 68599
Remote Config [baseline] (601.091 µs) : 0, 601
Remote Config [candidate] (615.606 µs) : 0, 616
Telemetry [baseline] (8.87 ms) : 0, 8870
Telemetry [candidate] (8.996 ms) : 0, 8996
Flare Poller [baseline] (9.288 ms) : 0, 9288
Flare Poller [candidate] (3.782 ms) : 0, 3782
AgentMeter [baseline] (8.842 ms) : 0, 8842
ProfilingAgent [baseline] (91.801 ms) : 0, 91801
ProfilingAgent [candidate] (98.475 ms) : 0, 98475
Profiling [baseline] (92.396 ms) : 0, 92396
Profiling [candidate] (99.059 ms) : 0, 99059
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1091999
Total [baseline] (8.76 s) : 0, 8759732
Agent [candidate] (1.09 s) : 0, 1090115
Total [candidate] (8.756 s) : 0, 8756054
section iast
Agent [baseline] (1.23 s) : 0, 1229834
Total [baseline] (9.303 s) : 0, 9303096
Agent [candidate] (1.227 s) : 0, 1227403
Total [candidate] (9.315 s) : 0, 9314992
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent iast 1.23 s 137.835 ms (12.6%)
Total tracing 8.76 s -
Total iast 9.303 s 543.365 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.227 s 137.288 ms (12.6%)
Total tracing 8.756 s -
Total iast 9.315 s 558.938 ms (6.4%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (654.501 ms) : 0, 654501
BytebuddyAgent [candidate] (653.153 ms) : 0, 653153
GlobalTracer [baseline] (257.869 ms) : 0, 257869
GlobalTracer [candidate] (286.663 ms) : 0, 286663
AppSec [baseline] (33.154 ms) : 0, 33154
AppSec [candidate] (32.94 ms) : 0, 32940
Debugger [baseline] (67.342 ms) : 0, 67342
Debugger [candidate] (64.95 ms) : 0, 64950
Remote Config [baseline] (631.608 µs) : 0, 632
Remote Config [candidate] (616.498 µs) : 0, 616
Telemetry [baseline] (9.033 ms) : 0, 9033
Telemetry [candidate] (8.971 ms) : 0, 8971
Flare Poller [baseline] (3.624 ms) : 0, 3624
Flare Poller [candidate] (6.075 ms) : 0, 6075
AgentMeter [baseline] (29.144 ms) : 0, 29144
section iast
crashtracking [baseline] (1.174 ms) : 0, 1174
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (794.106 ms) : 0, 794106
BytebuddyAgent [candidate] (793.114 ms) : 0, 793114
GlobalTracer [baseline] (247.848 ms) : 0, 247848
GlobalTracer [candidate] (259.265 ms) : 0, 259265
AppSec [baseline] (33.75 ms) : 0, 33750
AppSec [candidate] (35.111 ms) : 0, 35111
Debugger [baseline] (67.044 ms) : 0, 67044
Debugger [candidate] (63.834 ms) : 0, 63834
Remote Config [baseline] (548.358 µs) : 0, 548
Remote Config [candidate] (538.044 µs) : 0, 538
Telemetry [baseline] (8.479 ms) : 0, 8479
Telemetry [candidate] (8.494 ms) : 0, 8494
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.431 ms) : 0, 3431
AgentMeter [baseline] (11.257 ms) : 0, 11257
IAST [baseline] (26.8 ms) : 0, 26800
IAST [candidate] (27.133 ms) : 0, 27133
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/refactor-final-field-mutations
git_commit_date 1769453707 1769457558
git_commit_sha a34cb64 b5ee6b5
release_version 1.59.0-SNAPSHOT~a34cb643aa 1.54.0-SNAPSHOT~b5ee6b5b66
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769459976 1769459976
ci_job_id 1378116401 1378116401
ci_pipeline_id 92909152 92909152
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7ngpe3yu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7ngpe3yu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+0.509ms; +1.714ms] or [+2.741%; +9.218%]
unsure
[+0.527ms; +1.942ms] or [+1.746%; +6.435%]
unstable
[-36.142op/s; +14.767op/s] or [-14.677%; +5.997%]
19.701ms 31.417ms 235.562op/s 18.589ms 30.183ms 246.250op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.348 ms) : 18157, 18539
.   : milestone, 18348,
appsec (18.727 ms) : 18535, 18919
.   : milestone, 18727,
code_origins (17.793 ms) : 17615, 17971
.   : milestone, 17793,
iast (17.825 ms) : 17648, 18002
.   : milestone, 17825,
profiling (18.956 ms) : 18768, 19144
.   : milestone, 18956,
tracing (17.797 ms) : 17622, 17972
.   : milestone, 17797,
section candidate
no_agent (19.151 ms) : 18956, 19346
.   : milestone, 19151,
appsec (18.374 ms) : 18187, 18561
.   : milestone, 18374,
code_origins (17.726 ms) : 17551, 17902
.   : milestone, 17726,
iast (17.721 ms) : 17544, 17897
.   : milestone, 17721,
profiling (19.819 ms) : 19618, 20021
.   : milestone, 19819,
tracing (18.155 ms) : 17976, 18335
.   : milestone, 18155,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.348 ms [18.157 ms, 18.539 ms] -
appsec 18.727 ms [18.535 ms, 18.919 ms] 378.924 µs (2.1%)
code_origins 17.793 ms [17.615 ms, 17.971 ms] -554.444 µs (-3.0%)
iast 17.825 ms [17.648 ms, 18.002 ms] -522.854 µs (-2.8%)
profiling 18.956 ms [18.768 ms, 19.144 ms] 608.193 µs (3.3%)
tracing 17.797 ms [17.622 ms, 17.972 ms] -550.837 µs (-3.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.151 ms [18.956 ms, 19.346 ms] -
appsec 18.374 ms [18.187 ms, 18.561 ms] -777.276 µs (-4.1%)
code_origins 17.726 ms [17.551 ms, 17.902 ms] -1.425 ms (-7.4%)
iast 17.721 ms [17.544 ms, 17.897 ms] -1.43 ms (-7.5%)
profiling 19.819 ms [19.618 ms, 20.021 ms] 668.431 µs (3.5%)
tracing 18.155 ms [17.976 ms, 18.335 ms] -995.5 µs (-5.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.171 ms) : 1159, 1182
.   : milestone, 1171,
iast (3.269 ms) : 3224, 3314
.   : milestone, 3269,
iast_FULL (5.748 ms) : 5690, 5806
.   : milestone, 5748,
iast_GLOBAL (3.593 ms) : 3534, 3653
.   : milestone, 3593,
profiling (2.039 ms) : 2021, 2057
.   : milestone, 2039,
tracing (1.815 ms) : 1799, 1830
.   : milestone, 1815,
section candidate
no_agent (1.181 ms) : 1170, 1193
.   : milestone, 1181,
iast (3.304 ms) : 3256, 3353
.   : milestone, 3304,
iast_FULL (5.646 ms) : 5591, 5701
.   : milestone, 5646,
iast_GLOBAL (3.606 ms) : 3548, 3664
.   : milestone, 3606,
profiling (2.067 ms) : 2046, 2088
.   : milestone, 2067,
tracing (1.766 ms) : 1751, 1781
.   : milestone, 1766,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.171 ms [1.159 ms, 1.182 ms] -
iast 3.269 ms [3.224 ms, 3.314 ms] 2.099 ms (179.3%)
iast_FULL 5.748 ms [5.69 ms, 5.806 ms] 4.578 ms (391.1%)
iast_GLOBAL 3.593 ms [3.534 ms, 3.653 ms] 2.423 ms (207.0%)
profiling 2.039 ms [2.021 ms, 2.057 ms] 868.811 µs (74.2%)
tracing 1.815 ms [1.799 ms, 1.83 ms] 644.078 µs (55.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.17 ms, 1.193 ms] -
iast 3.304 ms [3.256 ms, 3.353 ms] 2.123 ms (179.7%)
iast_FULL 5.646 ms [5.591 ms, 5.701 ms] 4.465 ms (378.0%)
iast_GLOBAL 3.606 ms [3.548 ms, 3.664 ms] 2.425 ms (205.3%)
profiling 2.067 ms [2.046 ms, 2.088 ms] 885.627 µs (75.0%)
tracing 1.766 ms [1.751 ms, 1.781 ms] 584.711 µs (49.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/refactor-final-field-mutations
git_commit_date 1769453707 1769457558
git_commit_sha a34cb64 b5ee6b5
release_version 1.59.0-SNAPSHOT~a34cb643aa 1.54.0-SNAPSHOT~b5ee6b5b66
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769459736 1769459736
ci_job_id 1378116403 1378116403
ci_pipeline_id 92909152 92909152
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-rvum51iw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-rvum51iw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.411ms; -1.072ms] or [-38.202%; -29.017%]
2.452ms 3.693ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.38 s) : 15380000, 15380000
.   : milestone, 15380000,
appsec (14.639 s) : 14639000, 14639000
.   : milestone, 14639000,
iast (17.732 s) : 17732000, 17732000
.   : milestone, 17732000,
iast_GLOBAL (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
profiling (15.429 s) : 15429000, 15429000
.   : milestone, 15429000,
tracing (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
section candidate
no_agent (15.552 s) : 15552000, 15552000
.   : milestone, 15552000,
appsec (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
iast (17.736 s) : 17736000, 17736000
.   : milestone, 17736000,
iast_GLOBAL (17.76 s) : 17760000, 17760000
.   : milestone, 17760000,
profiling (15.273 s) : 15273000, 15273000
.   : milestone, 15273000,
tracing (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.38 s [15.38 s, 15.38 s] -
appsec 14.639 s [14.639 s, 14.639 s] -741.0 ms (-4.8%)
iast 17.732 s [17.732 s, 17.732 s] 2.352 s (15.3%)
iast_GLOBAL 18.113 s [18.113 s, 18.113 s] 2.733 s (17.8%)
profiling 15.429 s [15.429 s, 15.429 s] 49.0 ms (0.3%)
tracing 14.807 s [14.807 s, 14.807 s] -573.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.552 s [15.552 s, 15.552 s] -
appsec 14.811 s [14.811 s, 14.811 s] -741.0 ms (-4.8%)
iast 17.736 s [17.736 s, 17.736 s] 2.184 s (14.0%)
iast_GLOBAL 17.76 s [17.76 s, 17.76 s] 2.208 s (14.2%)
profiling 15.273 s [15.273 s, 15.273 s] -279.0 ms (-1.8%)
tracing 14.976 s [14.976 s, 14.976 s] -576.0 ms (-3.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~b5ee6b5b66, baseline=1.59.0-SNAPSHOT~a34cb643aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (3.693 ms) : 3476, 3909
.   : milestone, 3693,
iast (2.244 ms) : 2175, 2313
.   : milestone, 2244,
iast_GLOBAL (2.287 ms) : 2218, 2356
.   : milestone, 2287,
profiling (2.079 ms) : 2023, 2134
.   : milestone, 2079,
tracing (2.062 ms) : 2007, 2116
.   : milestone, 2062,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.452 ms) : 2399, 2504
.   : milestone, 2452,
iast (2.199 ms) : 2134, 2264
.   : milestone, 2199,
iast_GLOBAL (2.242 ms) : 2177, 2307
.   : milestone, 2242,
profiling (2.074 ms) : 2020, 2128
.   : milestone, 2074,
tracing (2.031 ms) : 1980, 2083
.   : milestone, 2031,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 3.693 ms [3.476 ms, 3.909 ms] 2.215 ms (149.8%)
iast 2.244 ms [2.175 ms, 2.313 ms] 766.272 µs (51.8%)
iast_GLOBAL 2.287 ms [2.218 ms, 2.356 ms] 808.875 µs (54.7%)
profiling 2.079 ms [2.023 ms, 2.134 ms] 600.641 µs (40.6%)
tracing 2.062 ms [2.007 ms, 2.116 ms] 583.589 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 2.452 ms [2.399 ms, 2.504 ms] 983.431 µs (67.0%)
iast 2.199 ms [2.134 ms, 2.264 ms] 730.659 µs (49.8%)
iast_GLOBAL 2.242 ms [2.177 ms, 2.307 ms] 773.843 µs (52.7%)
profiling 2.074 ms [2.02 ms, 2.128 ms] 606.104 µs (41.3%)
tracing 2.031 ms [1.98 ms, 2.083 ms] 563.171 µs (38.4%)

@sarahchen6 sarahchen6 force-pushed the sarahchen6/refactor-final-field-mutations branch from 46d6ef3 to b5ee6b5 Compare January 26, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants