Add springboot smoke tests for the open feature SDK #9906

manuel-alvarez-alvarez · 2025-11-06T14:00:39Z

What Does This Do

Adds smoke tests for the OpenFeature Java provider (PR)

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-11-06T14:30:56Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk-smoke
git_commit_date	1763047590	1763050271
git_commit_sha	`640a4bd`	`6e37bfb`
release_version	1.56.0-SNAPSHOT~640a4bd02b	1.56.0-SNAPSHOT~6e37bfb5f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763052180	1763052180
ci_job_id	1233098914	1233098914
ci_pipeline_id	82279811	82279811
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8bev0xqc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8bev0xqc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1098826
Total [baseline] (8.876 s) : 0, 8876081
Agent [candidate] (1.097 s) : 0, 1097491
Total [candidate] (8.844 s) : 0, 8844113
section iast
Agent [baseline] (1.238 s) : 0, 1237823
Total [baseline] (9.535 s) : 0, 9534701
Agent [candidate] (1.24 s) : 0, 1239896
Total [candidate] (9.59 s) : 0, 9590285

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.099 s	-
Agent	iast	1.238 s	138.997 ms (12.6%)
Total	tracing	8.876 s	-
Total	iast	9.535 s	658.62 ms (7.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.097 s	-
Agent	iast	1.24 s	142.404 ms (13.0%)
Total	tracing	8.844 s	-
Total	iast	9.59 s	746.172 ms (8.4%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (706.56 ms) : 0, 706560
BytebuddyAgent [candidate] (705.434 ms) : 0, 705434
GlobalTracer [baseline] (248.345 ms) : 0, 248345
GlobalTracer [candidate] (248.232 ms) : 0, 248232
AppSec [baseline] (32.358 ms) : 0, 32358
AppSec [candidate] (32.242 ms) : 0, 32242
Debugger [baseline] (63.072 ms) : 0, 63072
Debugger [candidate] (63.029 ms) : 0, 63029
Remote Config [baseline] (627.033 µs) : 0, 627
Remote Config [candidate] (624.755 µs) : 0, 625
Telemetry [baseline] (8.069 ms) : 0, 8069
Telemetry [candidate] (8.095 ms) : 0, 8095
Flare Poller [baseline] (3.647 ms) : 0, 3647
Flare Poller [candidate] (3.646 ms) : 0, 3646
section iast
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (830.642 ms) : 0, 830642
BytebuddyAgent [candidate] (832.57 ms) : 0, 832570
GlobalTracer [baseline] (238.275 ms) : 0, 238275
GlobalTracer [candidate] (238.013 ms) : 0, 238013
IAST [baseline] (30.05 ms) : 0, 30050
IAST [candidate] (30.615 ms) : 0, 30615
AppSec [baseline] (31.357 ms) : 0, 31357
AppSec [candidate] (30.511 ms) : 0, 30511
Debugger [baseline] (59.85 ms) : 0, 59850
Debugger [candidate] (59.975 ms) : 0, 59975
Remote Config [baseline] (543.9 µs) : 0, 544
Remote Config [candidate] (558.885 µs) : 0, 559
Telemetry [baseline] (7.583 ms) : 0, 7583
Telemetry [candidate] (7.658 ms) : 0, 7658
Flare Poller [baseline] (3.404 ms) : 0, 3404
Flare Poller [candidate] (3.478 ms) : 0, 3478

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1098333
Total [baseline] (10.742 s) : 0, 10742110
Agent [candidate] (1.1 s) : 0, 1100002
Total [candidate] (10.787 s) : 0, 10786601
section appsec
Agent [baseline] (1.283 s) : 0, 1283174
Total [baseline] (11.217 s) : 0, 11217036
Agent [candidate] (1.281 s) : 0, 1281100
Total [candidate] (11.222 s) : 0, 11221785
section iast
Agent [baseline] (1.248 s) : 0, 1248205
Total [baseline] (11.304 s) : 0, 11303542
Agent [candidate] (1.252 s) : 0, 1252416
Total [candidate] (11.188 s) : 0, 11187777
section profiling
Agent [baseline] (1.239 s) : 0, 1238633
Total [baseline] (11.053 s) : 0, 11052950
Agent [candidate] (1.228 s) : 0, 1228117
Total [candidate] (11.012 s) : 0, 11011937

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.098 s	-
Agent	appsec	1.283 s	184.841 ms (16.8%)
Agent	iast	1.248 s	149.873 ms (13.6%)
Agent	profiling	1.239 s	140.3 ms (12.8%)
Total	tracing	10.742 s	-
Total	appsec	11.217 s	474.926 ms (4.4%)
Total	iast	11.304 s	561.432 ms (5.2%)
Total	profiling	11.053 s	310.84 ms (2.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	appsec	1.281 s	181.098 ms (16.5%)
Agent	iast	1.252 s	152.414 ms (13.9%)
Agent	profiling	1.228 s	128.115 ms (11.6%)
Total	tracing	10.787 s	-
Total	appsec	11.222 s	435.185 ms (4.0%)
Total	iast	11.188 s	401.176 ms (3.7%)
Total	profiling	11.012 s	225.337 ms (2.1%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (704.899 ms) : 0, 704899
BytebuddyAgent [candidate] (705.825 ms) : 0, 705825
GlobalTracer [baseline] (248.414 ms) : 0, 248414
GlobalTracer [candidate] (248.611 ms) : 0, 248611
AppSec [baseline] (32.34 ms) : 0, 32340
AppSec [candidate] (32.285 ms) : 0, 32285
Debugger [baseline] (64.154 ms) : 0, 64154
Debugger [candidate] (64.428 ms) : 0, 64428
Remote Config [baseline] (627.236 µs) : 0, 627
Remote Config [candidate] (642.631 µs) : 0, 643
Telemetry [baseline] (8.153 ms) : 0, 8153
Telemetry [candidate] (8.348 ms) : 0, 8348
Flare Poller [baseline] (3.655 ms) : 0, 3655
Flare Poller [candidate] (3.702 ms) : 0, 3702
section appsec
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (731.855 ms) : 0, 731855
BytebuddyAgent [candidate] (730.516 ms) : 0, 730516
GlobalTracer [baseline] (241.966 ms) : 0, 241966
GlobalTracer [candidate] (241.46 ms) : 0, 241460
AppSec [baseline] (174.17 ms) : 0, 174170
AppSec [candidate] (174.039 ms) : 0, 174039
Debugger [baseline] (60.828 ms) : 0, 60828
Debugger [candidate] (60.843 ms) : 0, 60843
Remote Config [baseline] (686.444 µs) : 0, 686
Remote Config [candidate] (666.016 µs) : 0, 666
Telemetry [baseline] (8.488 ms) : 0, 8488
Telemetry [candidate] (8.561 ms) : 0, 8561
Flare Poller [baseline] (3.946 ms) : 0, 3946
Flare Poller [candidate] (3.908 ms) : 0, 3908
IAST [baseline] (24.896 ms) : 0, 24896
IAST [candidate] (24.86 ms) : 0, 24860
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (836.792 ms) : 0, 836792
BytebuddyAgent [candidate] (842.01 ms) : 0, 842010
GlobalTracer [baseline] (239.621 ms) : 0, 239621
GlobalTracer [candidate] (238.799 ms) : 0, 238799
AppSec [baseline] (33.384 ms) : 0, 33384
AppSec [candidate] (32.783 ms) : 0, 32783
Debugger [baseline] (61.625 ms) : 0, 61625
Debugger [candidate] (61.203 ms) : 0, 61203
Remote Config [baseline] (553.195 µs) : 0, 553
Remote Config [candidate] (541.955 µs) : 0, 542
Telemetry [baseline] (7.706 ms) : 0, 7706
Telemetry [candidate] (7.628 ms) : 0, 7628
Flare Poller [baseline] (3.513 ms) : 0, 3513
Flare Poller [candidate] (3.432 ms) : 0, 3432
IAST [baseline] (28.663 ms) : 0, 28663
IAST [candidate] (29.605 ms) : 0, 29605
section profiling
ProfilingAgent [baseline] (97.821 ms) : 0, 97821
ProfilingAgent [candidate] (97.12 ms) : 0, 97120
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.425 ms) : 0, 1425
BytebuddyAgent [baseline] (736.581 ms) : 0, 736581
BytebuddyAgent [candidate] (730.275 ms) : 0, 730275
GlobalTracer [baseline] (223.347 ms) : 0, 223347
GlobalTracer [candidate] (221.8 ms) : 0, 221800
AppSec [baseline] (32.767 ms) : 0, 32767
AppSec [candidate] (32.386 ms) : 0, 32386
Debugger [baseline] (63.757 ms) : 0, 63757
Debugger [candidate] (63.011 ms) : 0, 63011
Remote Config [baseline] (658.706 µs) : 0, 659
Remote Config [candidate] (653.606 µs) : 0, 654
Telemetry [baseline] (8.356 ms) : 0, 8356
Telemetry [candidate] (7.991 ms) : 0, 7991
Flare Poller [baseline] (3.816 ms) : 0, 3816
Flare Poller [candidate] (3.747 ms) : 0, 3747
Profiling [baseline] (98.42 ms) : 0, 98420
Profiling [candidate] (97.696 ms) : 0, 97696

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk-smoke
git_commit_date	1763047590	1763050271
git_commit_sha	`640a4bd`	`6e37bfb`
release_version	1.56.0-SNAPSHOT~640a4bd02b	1.56.0-SNAPSHOT~6e37bfb5f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763052589	1763052589
ci_job_id	1233098918	1233098918
ci_pipeline_id	82279811	82279811
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mkyuwpdh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mkyuwpdh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-66.876µs; -22.702µs] or [-6.632%; -2.251%]	unstable [-493.399µs; +207.455µs] or [-17.179%; +7.223%]	unstable [-253.697op/s; +578.822op/s] or [-7.062%; +16.113%]	0.964ms	2.729ms	3754.781op/s	1.008ms	2.872ms	3592.219op/s
scenario:load:petclinic:tracing:high_load	worse [+509.552µs; +1338.524µs] or [+2.979%; +7.825%]	unsure [+0.511ms; +1.912ms] or [+1.801%; +6.735%]	unstable [-39.173op/s; +13.798op/s] or [-14.706%; +5.180%]	18.029ms	29.602ms	253.688op/s	17.105ms	28.390ms	266.375op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.229 ms) : 1217, 1241
.   : milestone, 1229,
iast (3.196 ms) : 3160, 3232
.   : milestone, 3196,
iast_FULL (5.681 ms) : 5610, 5753
.   : milestone, 5681,
iast_GLOBAL (3.607 ms) : 3562, 3653
.   : milestone, 3607,
profiling (1.921 ms) : 1904, 1939
.   : milestone, 1921,
tracing (1.862 ms) : 1845, 1878
.   : milestone, 1862,
section candidate
no_agent (1.173 ms) : 1161, 1184
.   : milestone, 1173,
iast (3.2 ms) : 3158, 3243
.   : milestone, 3200,
iast_FULL (5.849 ms) : 5740, 5957
.   : milestone, 5849,
iast_GLOBAL (3.596 ms) : 3535, 3657
.   : milestone, 3596,
profiling (2.05 ms) : 2031, 2068
.   : milestone, 2050,
tracing (1.831 ms) : 1816, 1847
.   : milestone, 1831,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.229 ms [1.217 ms, 1.241 ms]	-
iast	3.196 ms [3.16 ms, 3.232 ms]	1.967 ms (160.1%)
iast_FULL	5.681 ms [5.61 ms, 5.753 ms]	4.453 ms (362.3%)
iast_GLOBAL	3.607 ms [3.562 ms, 3.653 ms]	2.378 ms (193.6%)
profiling	1.921 ms [1.904 ms, 1.939 ms]	692.514 µs (56.4%)
tracing	1.862 ms [1.845 ms, 1.878 ms]	633.069 µs (51.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.173 ms [1.161 ms, 1.184 ms]	-
iast	3.2 ms [3.158 ms, 3.243 ms]	2.027 ms (172.9%)
iast_FULL	5.849 ms [5.74 ms, 5.957 ms]	4.676 ms (398.7%)
iast_GLOBAL	3.596 ms [3.535 ms, 3.657 ms]	2.423 ms (206.6%)
profiling	2.05 ms [2.031 ms, 2.068 ms]	876.816 µs (74.8%)
tracing	1.831 ms [1.816 ms, 1.847 ms]	658.611 µs (56.2%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.332 ms) : 18142, 18522
.   : milestone, 18332,
appsec (19.378 ms) : 19178, 19578
.   : milestone, 19378,
code_origins (17.581 ms) : 17405, 17757
.   : milestone, 17581,
iast (17.758 ms) : 17579, 17937
.   : milestone, 17758,
profiling (19.658 ms) : 19454, 19861
.   : milestone, 19658,
tracing (17.514 ms) : 17338, 17690
.   : milestone, 17514,
section candidate
no_agent (17.824 ms) : 17646, 18003
.   : milestone, 17824,
appsec (19.333 ms) : 19136, 19530
.   : milestone, 19333,
code_origins (17.878 ms) : 17698, 18059
.   : milestone, 17878,
iast (17.721 ms) : 17542, 17901
.   : milestone, 17721,
profiling (19.063 ms) : 18878, 19247
.   : milestone, 19063,
tracing (18.395 ms) : 18208, 18582
.   : milestone, 18395,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.332 ms [18.142 ms, 18.522 ms]	-
appsec	19.378 ms [19.178 ms, 19.578 ms]	1.046 ms (5.7%)
code_origins	17.581 ms [17.405 ms, 17.757 ms]	-751.058 µs (-4.1%)
iast	17.758 ms [17.579 ms, 17.937 ms]	-574.031 µs (-3.1%)
profiling	19.658 ms [19.454 ms, 19.861 ms]	1.326 ms (7.2%)
tracing	17.514 ms [17.338 ms, 17.69 ms]	-817.528 µs (-4.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.824 ms [17.646 ms, 18.003 ms]	-
appsec	19.333 ms [19.136 ms, 19.53 ms]	1.508 ms (8.5%)
code_origins	17.878 ms [17.698 ms, 18.059 ms]	53.881 µs (0.3%)
iast	17.721 ms [17.542 ms, 17.901 ms]	-103.379 µs (-0.6%)
profiling	19.063 ms [18.878 ms, 19.247 ms]	1.238 ms (6.9%)
tracing	18.395 ms [18.208 ms, 18.582 ms]	570.46 µs (3.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk-smoke
git_commit_date	1763047590	1763050271
git_commit_sha	`640a4bd`	`6e37bfb`
release_version	1.56.0-SNAPSHOT~640a4bd02b	1.56.0-SNAPSHOT~6e37bfb5f8

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763052368	1763052368
ci_job_id	1233098920	1233098920
ci_pipeline_id	82279811	82279811
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-46pw2i2h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-46pw2i2h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.522 s) : 15522000, 15522000
.   : milestone, 15522000,
appsec (14.587 s) : 14587000, 14587000
.   : milestone, 14587000,
iast (18.323 s) : 18323000, 18323000
.   : milestone, 18323000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
.   : milestone, 17764000,
profiling (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
section candidate
no_agent (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
appsec (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
iast (18.218 s) : 18218000, 18218000
.   : milestone, 18218000,
iast_GLOBAL (17.823 s) : 17823000, 17823000
.   : milestone, 17823000,
profiling (15.102 s) : 15102000, 15102000
.   : milestone, 15102000,
tracing (14.752 s) : 14752000, 14752000
.   : milestone, 14752000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.522 s [15.522 s, 15.522 s]	-
appsec	14.587 s [14.587 s, 14.587 s]	-935.0 ms (-6.0%)
iast	18.323 s [18.323 s, 18.323 s]	2.801 s (18.0%)
iast_GLOBAL	17.764 s [17.764 s, 17.764 s]	2.242 s (14.4%)
profiling	14.988 s [14.988 s, 14.988 s]	-534.0 ms (-3.4%)
tracing	14.75 s [14.75 s, 14.75 s]	-772.0 ms (-5.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.057 s [15.057 s, 15.057 s]	-
appsec	14.922 s [14.922 s, 14.922 s]	-135.0 ms (-0.9%)
iast	18.218 s [18.218 s, 18.218 s]	3.161 s (21.0%)
iast_GLOBAL	17.823 s [17.823 s, 17.823 s]	2.766 s (18.4%)
profiling	15.102 s [15.102 s, 15.102 s]	45.0 ms (0.3%)
tracing	14.752 s [14.752 s, 14.752 s]	-305.0 ms (-2.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~6e37bfb5f8, baseline=1.56.0-SNAPSHOT~640a4bd02b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.674 ms) : 3460, 3889
.   : milestone, 3674,
iast (2.225 ms) : 2162, 2289
.   : milestone, 2225,
iast_GLOBAL (2.26 ms) : 2196, 2323
.   : milestone, 2260,
profiling (2.092 ms) : 2039, 2146
.   : milestone, 2092,
tracing (2.037 ms) : 1987, 2086
.   : milestone, 2037,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (3.659 ms) : 3445, 3874
.   : milestone, 3659,
iast (2.222 ms) : 2158, 2286
.   : milestone, 2222,
iast_GLOBAL (2.262 ms) : 2198, 2326
.   : milestone, 2262,
profiling (2.489 ms) : 2331, 2647
.   : milestone, 2489,
tracing (2.044 ms) : 1994, 2094
.   : milestone, 2044,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	3.674 ms [3.46 ms, 3.889 ms]	2.193 ms (148.1%)
iast	2.225 ms [2.162 ms, 2.289 ms]	744.367 µs (50.3%)
iast_GLOBAL	2.26 ms [2.196 ms, 2.323 ms]	778.621 µs (52.6%)
profiling	2.092 ms [2.039 ms, 2.146 ms]	611.326 µs (41.3%)
tracing	2.037 ms [1.987 ms, 2.086 ms]	555.608 µs (37.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.467 ms, 1.49 ms]	-
appsec	3.659 ms [3.445 ms, 3.874 ms]	2.181 ms (147.6%)
iast	2.222 ms [2.158 ms, 2.286 ms]	743.568 µs (50.3%)
iast_GLOBAL	2.262 ms [2.198 ms, 2.326 ms]	784.314 µs (53.1%)
profiling	2.489 ms [2.331 ms, 2.647 ms]	1.011 ms (68.4%)
tracing	2.044 ms [1.994 ms, 2.094 ms]	566.124 µs (38.3%)

datadog-datadog-prod-us1 · 2025-11-06T17:23:10Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.76% (-0.01%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 6e37bfb | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

...eatureflag/src/main/java/datadog/smoketest/springboot/openfeature/OpenFeatureController.java

...featureflag/src/test/groovy/datadog/smoketest/springboot/OpenFeatureProviderSmokeTest.groovy

settings.gradle.kts

manuel-alvarez-alvarez · 2025-11-14T04:43:38Z

Let's continue in #9961 (github closed the PR and I cannot reopen it 😢)

manuel-alvarez-alvarez added the type: enhancement Enhancements and improvements label Nov 6, 2025

manuel-alvarez-alvarez requested a review from a team as a code owner November 6, 2025 14:00

manuel-alvarez-alvarez added the comp: testing Testing label Nov 6, 2025

manuel-alvarez-alvarez requested a review from mhlidd November 6, 2025 14:00

manuel-alvarez-alvarez added the tag: no release notes Changes to exclude from release notes label Nov 6, 2025

manuel-alvarez-alvarez requested a review from a team November 6, 2025 14:01

manuel-alvarez-alvarez mentioned this pull request Nov 6, 2025

Implementation of the open feature SDK in the java tracer #9885

Open

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch from ca7c192 to cdb4966 Compare November 6, 2025 17:00

manuel-alvarez-alvarez requested a review from a team as a code owner November 6, 2025 17:00

manuel-alvarez-alvarez requested review from AlexeyKuznetsov-DD and removed request for a team November 6, 2025 17:00

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from be9fe20 to 9d8918e Compare November 6, 2025 17:05

AlexeyKuznetsov-DD reviewed Nov 6, 2025

View reviewed changes

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch from cdb4966 to ea47cc8 Compare November 7, 2025 14:33

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 9d8918e to 43064a6 Compare November 7, 2025 15:59

manuel-alvarez-alvarez requested a review from AlexeyKuznetsov-DD November 7, 2025 16:00

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch from a3c9e25 to bbf46e4 Compare November 13, 2025 15:43

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from f22b5f4 to 6e37bfb Compare November 13, 2025 16:11

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 3 times, most recently from 9cd5aeb to fe88e77 Compare November 14, 2025 02:54

manuel-alvarez-alvarez closed this Nov 14, 2025

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 6e37bfb to fe88e77 Compare November 14, 2025 03:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add springboot smoke tests for the open feature SDK #9906

Add springboot smoke tests for the open feature SDK #9906

Uh oh!

manuel-alvarez-alvarez commented Nov 6, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Nov 6, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 6, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

manuel-alvarez-alvarez commented Nov 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Add springboot smoke tests for the open feature SDK #9906

Add springboot smoke tests for the open feature SDK #9906

Uh oh!

Conversation

manuel-alvarez-alvarez commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

manuel-alvarez-alvarez commented Nov 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

manuel-alvarez-alvarez commented Nov 6, 2025 •

edited

Loading

pr-commenter bot commented Nov 6, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Nov 6, 2025 •

edited

Loading