Set test framework and test framework version tags atomically #8252

nikita-tkachenko-datadog · 2025-01-20T12:51:14Z

What Does This Do

Updates the logic that sets test.framework and test.framework_version tags to do it atomically.

Motivation

When test framework name and version are propagated from test to test suite span, some merging is done.
It is possible for multiple tests from the same suite to be executed in parallel, which is why the two tags need to be set atomically.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-01-20T13:30:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-framework-tags-sync
git_commit_date	1737561779	1737561967
git_commit_sha	`ad44687`	`a83cee4`
release_version	1.46.0-SNAPSHOT~ad44687e99	1.46.0-SNAPSHOT~a83cee4eb4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737564566	1737564566
ci_job_id	776159942	776159942
ci_pipeline_id	53702414	53702414
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055978
Total [baseline] (8.615 s) : 0, 8614617
Agent [candidate] (1.062 s) : 0, 1061777
Total [candidate] (8.632 s) : 0, 8631652
section iast
Agent [baseline] (1.184 s) : 0, 1184465
Total [baseline] (9.162 s) : 0, 9162487
Agent [candidate] (1.185 s) : 0, 1184983
Total [candidate] (9.219 s) : 0, 9218862
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1182340
Total [baseline] (9.163 s) : 0, 9162918
Agent [candidate] (1.181 s) : 0, 1181259
Total [candidate] (9.142 s) : 0, 9142162
section iast_TELEMETRY_OFF
Agent [baseline] (1.179 s) : 0, 1179112
Total [baseline] (9.171 s) : 0, 9171151
Agent [candidate] (1.18 s) : 0, 1179620
Total [candidate] (9.201 s) : 0, 9200735

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	iast	1.184 s	128.487 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.182 s	126.362 ms (12.0%)
Agent	iast_TELEMETRY_OFF	1.179 s	123.134 ms (11.7%)
Total	tracing	8.615 s	-
Total	iast	9.162 s	547.87 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.163 s	548.301 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.171 s	556.535 ms (6.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	iast	1.185 s	123.206 ms (11.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.181 s	119.482 ms (11.3%)
Agent	iast_TELEMETRY_OFF	1.18 s	117.843 ms (11.1%)
Total	tracing	8.632 s	-
Total	iast	9.219 s	587.21 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.142 s	510.511 ms (5.9%)
Total	iast_TELEMETRY_OFF	9.201 s	569.083 ms (6.6%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.965 ms) : 0, 715965
BytebuddyAgent [candidate] (718.326 ms) : 0, 718326
GlobalTracer [baseline] (255.821 ms) : 0, 255821
GlobalTracer [candidate] (257.224 ms) : 0, 257224
AppSec [baseline] (56.329 ms) : 0, 56329
AppSec [candidate] (56.019 ms) : 0, 56019
Remote Config [baseline] (735.696 µs) : 0, 736
Remote Config [candidate] (746.89 µs) : 0, 747
Telemetry [baseline] (12.129 ms) : 0, 12129
Telemetry [candidate] (14.408 ms) : 0, 14408
section iast
BytebuddyAgent [baseline] (833.283 ms) : 0, 833283
BytebuddyAgent [candidate] (832.971 ms) : 0, 832971
GlobalTracer [baseline] (246.809 ms) : 0, 246809
GlobalTracer [candidate] (247.046 ms) : 0, 247046
AppSec [baseline] (58.129 ms) : 0, 58129
AppSec [candidate] (58.583 ms) : 0, 58583
IAST [baseline] (21.786 ms) : 0, 21786
IAST [candidate] (21.802 ms) : 0, 21802
Remote Config [baseline] (679.525 µs) : 0, 680
Remote Config [candidate] (703.174 µs) : 0, 703
Telemetry [baseline] (8.759 ms) : 0, 8759
Telemetry [candidate] (8.794 ms) : 0, 8794
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.23 ms) : 0, 832230
BytebuddyAgent [candidate] (830.734 ms) : 0, 830734
GlobalTracer [baseline] (246.048 ms) : 0, 246048
GlobalTracer [candidate] (246.47 ms) : 0, 246470
AppSec [baseline] (57.939 ms) : 0, 57939
AppSec [candidate] (58.118 ms) : 0, 58118
IAST [baseline] (21.645 ms) : 0, 21645
IAST [candidate] (21.494 ms) : 0, 21494
Remote Config [baseline] (662.495 µs) : 0, 662
Remote Config [candidate] (685.548 µs) : 0, 686
Telemetry [baseline] (8.768 ms) : 0, 8768
Telemetry [candidate] (8.803 ms) : 0, 8803
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.923 ms) : 0, 828923
BytebuddyAgent [candidate] (829.679 ms) : 0, 829679
GlobalTracer [baseline] (246.704 ms) : 0, 246704
GlobalTracer [candidate] (246.91 ms) : 0, 246910
AppSec [baseline] (58.101 ms) : 0, 58101
AppSec [candidate] (57.827 ms) : 0, 57827
IAST [baseline] (20.972 ms) : 0, 20972
IAST [candidate] (20.808 ms) : 0, 20808
Remote Config [baseline] (677.869 µs) : 0, 678
Remote Config [candidate] (652.369 µs) : 0, 652
Telemetry [baseline] (8.725 ms) : 0, 8725
Telemetry [candidate] (8.666 ms) : 0, 8666

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051753
Total [baseline] (10.398 s) : 0, 10397828
Agent [candidate] (1.055 s) : 0, 1054776
Total [candidate] (10.455 s) : 0, 10454727
section appsec
Agent [baseline] (1.189 s) : 0, 1189105
Total [baseline] (10.732 s) : 0, 10731692
Agent [candidate] (1.194 s) : 0, 1193877
Total [candidate] (10.733 s) : 0, 10732777
section iast
Agent [baseline] (1.196 s) : 0, 1195583
Total [baseline] (11.011 s) : 0, 11011234
Agent [candidate] (1.193 s) : 0, 1192809
Total [candidate] (11.003 s) : 0, 11003199
section profiling
Agent [baseline] (1.259 s) : 0, 1258907
Total [baseline] (10.759 s) : 0, 10758712
Agent [candidate] (1.256 s) : 0, 1255609
Total [candidate] (10.8 s) : 0, 10800345

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.189 s	137.352 ms (13.1%)
Agent	iast	1.196 s	143.831 ms (13.7%)
Agent	profiling	1.259 s	207.154 ms (19.7%)
Total	tracing	10.398 s	-
Total	appsec	10.732 s	333.865 ms (3.2%)
Total	iast	11.011 s	613.407 ms (5.9%)
Total	profiling	10.759 s	360.884 ms (3.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.194 s	139.101 ms (13.2%)
Agent	iast	1.193 s	138.033 ms (13.1%)
Agent	profiling	1.256 s	200.833 ms (19.0%)
Total	tracing	10.455 s	-
Total	appsec	10.733 s	278.051 ms (2.7%)
Total	iast	11.003 s	548.472 ms (5.2%)
Total	profiling	10.8 s	345.618 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (712.698 ms) : 0, 712698
BytebuddyAgent [candidate] (714.503 ms) : 0, 714503
GlobalTracer [baseline] (254.568 ms) : 0, 254568
GlobalTracer [candidate] (255.807 ms) : 0, 255807
AppSec [baseline] (55.469 ms) : 0, 55469
AppSec [candidate] (56.374 ms) : 0, 56374
Remote Config [baseline] (737.882 µs) : 0, 738
Remote Config [candidate] (744.743 µs) : 0, 745
Telemetry [baseline] (13.308 ms) : 0, 13308
Telemetry [candidate] (12.321 ms) : 0, 12321
section appsec
BytebuddyAgent [baseline] (732.337 ms) : 0, 732337
BytebuddyAgent [candidate] (734.663 ms) : 0, 734663
GlobalTracer [baseline] (252.32 ms) : 0, 252320
GlobalTracer [candidate] (253.809 ms) : 0, 253809
AppSec [baseline] (171.051 ms) : 0, 171051
AppSec [candidate] (171.318 ms) : 0, 171318
IAST [baseline] (19.205 ms) : 0, 19205
IAST [candidate] (19.477 ms) : 0, 19477
Remote Config [baseline] (670.817 µs) : 0, 671
Remote Config [candidate] (681.737 µs) : 0, 682
Telemetry [baseline] (8.107 ms) : 0, 8107
Telemetry [candidate] (8.575 ms) : 0, 8575
section iast
BytebuddyAgent [baseline] (841.356 ms) : 0, 841356
BytebuddyAgent [candidate] (839.091 ms) : 0, 839091
GlobalTracer [baseline] (249.208 ms) : 0, 249208
GlobalTracer [candidate] (248.389 ms) : 0, 248389
AppSec [baseline] (58.485 ms) : 0, 58485
AppSec [candidate] (58.643 ms) : 0, 58643
IAST [baseline] (21.823 ms) : 0, 21823
IAST [candidate] (21.894 ms) : 0, 21894
Remote Config [baseline] (673.979 µs) : 0, 674
Remote Config [candidate] (675.129 µs) : 0, 675
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (8.9 ms) : 0, 8900
section profiling
BytebuddyAgent [baseline] (706.311 ms) : 0, 706311
BytebuddyAgent [candidate] (704.207 ms) : 0, 704207
GlobalTracer [baseline] (349.51 ms) : 0, 349510
GlobalTracer [candidate] (350.443 ms) : 0, 350443
AppSec [baseline] (55.148 ms) : 0, 55148
AppSec [candidate] (54.203 ms) : 0, 54203
Remote Config [baseline] (729.138 µs) : 0, 729
Remote Config [candidate] (720.195 µs) : 0, 720
Telemetry [baseline] (8.809 ms) : 0, 8809
Telemetry [candidate] (8.77 ms) : 0, 8770
ProfilingAgent [baseline] (96.152 ms) : 0, 96152
ProfilingAgent [candidate] (95.311 ms) : 0, 95311
Profiling [baseline] (96.176 ms) : 0, 96176
Profiling [candidate] (95.334 ms) : 0, 95334

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-22T16:17:41	2025-01-22T16:24:45
git_branch	master	nikita-tkachenko/test-framework-tags-sync
git_commit_date	1737561779	1737561967
git_commit_sha	`ad44687`	`a83cee4`
release_version	1.46.0-SNAPSHOT~ad44687e99	1.46.0-SNAPSHOT~a83cee4eb4
start_time	2025-01-22T16:17:27	2025-01-22T16:24:31

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737563441	1737563441
ci_job_id	776159943	776159943
ci_pipeline_id	53702414	53702414
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.117 µs) : 357, 397
.   : milestone, 377,
iast (507.219 µs) : 486, 529
.   : milestone, 507,
iast_FULL (735.696 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (551.106 µs) : 530, 573
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (505.971 µs) : 484, 528
.   : milestone, 506,
iast_INACTIVE (455.812 µs) : 435, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (494.541 µs) : 473, 516
.   : milestone, 495,
tracing (457.006 µs) : 433, 481
.   : milestone, 457,
section candidate
no_agent (378.312 µs) : 359, 398
.   : milestone, 378,
iast (508.835 µs) : 487, 531
.   : milestone, 509,
iast_FULL (742.228 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (560.358 µs) : 538, 583
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (503.525 µs) : 482, 525
.   : milestone, 504,
iast_INACTIVE (456.725 µs) : 435, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (495.274 µs) : 473, 518
.   : milestone, 495,
tracing (450.753 µs) : 430, 472
.   : milestone, 451,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	377.117 µs [357.209 µs, 397.026 µs]	-
iast	507.219 µs [485.696 µs, 528.742 µs]	130.102 µs (34.5%)
iast_FULL	735.696 µs [713.841 µs, 757.551 µs]	358.579 µs (95.1%)
iast_GLOBAL	551.106 µs [529.554 µs, 572.658 µs]	173.988 µs (46.1%)
iast_HARDCODED_SECRET_DISABLED	505.971 µs [484.238 µs, 527.704 µs]	128.853 µs (34.2%)
iast_INACTIVE	455.812 µs [434.718 µs, 476.907 µs]	78.695 µs (20.9%)
iast_TELEMETRY_OFF	494.541 µs [472.953 µs, 516.129 µs]	117.424 µs (31.1%)
tracing	457.006 µs [433.421 µs, 480.591 µs]	79.888 µs (21.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.312 µs [358.786 µs, 397.838 µs]	-
iast	508.835 µs [486.936 µs, 530.733 µs]	130.522 µs (34.5%)
iast_FULL	742.228 µs [720.311 µs, 764.145 µs]	363.916 µs (96.2%)
iast_GLOBAL	560.358 µs [537.576 µs, 583.14 µs]	182.046 µs (48.1%)
iast_HARDCODED_SECRET_DISABLED	503.525 µs [481.857 µs, 525.193 µs]	125.213 µs (33.1%)
iast_INACTIVE	456.725 µs [434.587 µs, 478.864 µs]	78.413 µs (20.7%)
iast_TELEMETRY_OFF	495.274 µs [472.978 µs, 517.569 µs]	116.962 µs (30.9%)
tracing	450.753 µs [429.95 µs, 471.556 µs]	72.44 µs (19.1%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1372
.   : milestone, 1352,
appsec (1.757 ms) : 1733, 1780
.   : milestone, 1757,
appsec_no_iast (1.752 ms) : 1729, 1774
.   : milestone, 1752,
iast (1.517 ms) : 1493, 1542
.   : milestone, 1517,
profiling (1.502 ms) : 1479, 1525
.   : milestone, 1502,
tracing (1.482 ms) : 1458, 1506
.   : milestone, 1482,
section candidate
no_agent (1.35 ms) : 1330, 1370
.   : milestone, 1350,
appsec (1.76 ms) : 1736, 1783
.   : milestone, 1760,
appsec_no_iast (1.756 ms) : 1731, 1780
.   : milestone, 1756,
iast (1.497 ms) : 1473, 1522
.   : milestone, 1497,
profiling (1.509 ms) : 1486, 1533
.   : milestone, 1509,
tracing (1.46 ms) : 1435, 1485
.   : milestone, 1460,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.352 ms [1.333 ms, 1.372 ms]	-
appsec	1.757 ms [1.733 ms, 1.78 ms]	404.326 µs (29.9%)
appsec_no_iast	1.752 ms [1.729 ms, 1.774 ms]	399.355 µs (29.5%)
iast	1.517 ms [1.493 ms, 1.542 ms]	164.65 µs (12.2%)
profiling	1.502 ms [1.479 ms, 1.525 ms]	149.361 µs (11.0%)
tracing	1.482 ms [1.458 ms, 1.506 ms]	129.479 µs (9.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.35 ms [1.33 ms, 1.37 ms]	-
appsec	1.76 ms [1.736 ms, 1.783 ms]	409.822 µs (30.4%)
appsec_no_iast	1.756 ms [1.731 ms, 1.78 ms]	405.65 µs (30.1%)
iast	1.497 ms [1.473 ms, 1.522 ms]	147.626 µs (10.9%)
profiling	1.509 ms [1.486 ms, 1.533 ms]	159.576 µs (11.8%)
tracing	1.46 ms [1.435 ms, 1.485 ms]	110.192 µs (8.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-framework-tags-sync
git_commit_date	1737561779	1737561967
git_commit_sha	`ad44687`	`a83cee4`
release_version	1.46.0-SNAPSHOT~ad44687e99	1.46.0-SNAPSHOT~a83cee4eb4

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1737564091	1737564091
ci_job_id	776159944	776159944
ci_pipeline_id	53702414	53702414
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.36 ms) : 2317, 2403
.   : milestone, 2360,
iast (2.109 ms) : 2054, 2164
.   : milestone, 2109,
iast_GLOBAL (2.15 ms) : 2095, 2204
.   : milestone, 2150,
profiling (1.97 ms) : 1926, 2015
.   : milestone, 1970,
tracing (1.94 ms) : 1898, 1981
.   : milestone, 1940,
section candidate
no_agent (1.466 ms) : 1454, 1477
.   : milestone, 1466,
appsec (2.361 ms) : 2317, 2404
.   : milestone, 2361,
iast (2.111 ms) : 2056, 2166
.   : milestone, 2111,
iast_GLOBAL (2.153 ms) : 2099, 2208
.   : milestone, 2153,
profiling (1.957 ms) : 1914, 2001
.   : milestone, 1957,
tracing (1.945 ms) : 1902, 1987
.   : milestone, 1945,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.468 ms [1.456 ms, 1.479 ms]	-
appsec	2.36 ms [2.317 ms, 2.403 ms]	892.431 µs (60.8%)
iast	2.109 ms [2.054 ms, 2.164 ms]	641.341 µs (43.7%)
iast_GLOBAL	2.15 ms [2.095 ms, 2.204 ms]	681.998 µs (46.5%)
profiling	1.97 ms [1.926 ms, 2.015 ms]	502.683 µs (34.3%)
tracing	1.94 ms [1.898 ms, 1.981 ms]	472.012 µs (32.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.466 ms [1.454 ms, 1.477 ms]	-
appsec	2.361 ms [2.317 ms, 2.404 ms]	894.999 µs (61.1%)
iast	2.111 ms [2.056 ms, 2.166 ms]	645.238 µs (44.0%)
iast_GLOBAL	2.153 ms [2.099 ms, 2.208 ms]	687.81 µs (46.9%)
profiling	1.957 ms [1.914 ms, 2.001 ms]	491.731 µs (33.6%)
tracing	1.945 ms [1.902 ms, 1.987 ms]	478.888 µs (32.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~a83cee4eb4, baseline=1.46.0-SNAPSHOT~ad44687e99
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.491 s) : 15491000, 15491000
.   : milestone, 15491000,
appsec (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
iast (18.379 s) : 18379000, 18379000
.   : milestone, 18379000,
iast_GLOBAL (18.003 s) : 18003000, 18003000
.   : milestone, 18003000,
profiling (15.292 s) : 15292000, 15292000
.   : milestone, 15292000,
tracing (14.642 s) : 14642000, 14642000
.   : milestone, 14642000,
section candidate
no_agent (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
appsec (14.71 s) : 14710000, 14710000
.   : milestone, 14710000,
iast (19.162 s) : 19162000, 19162000
.   : milestone, 19162000,
iast_GLOBAL (18.035 s) : 18035000, 18035000
.   : milestone, 18035000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (14.654 s) : 14654000, 14654000
.   : milestone, 14654000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.491 s [15.491 s, 15.491 s]	-
appsec	15.094 s [15.094 s, 15.094 s]	-397.0 ms (-2.6%)
iast	18.379 s [18.379 s, 18.379 s]	2.888 s (18.6%)
iast_GLOBAL	18.003 s [18.003 s, 18.003 s]	2.512 s (16.2%)
profiling	15.292 s [15.292 s, 15.292 s]	-199.0 ms (-1.3%)
tracing	14.642 s [14.642 s, 14.642 s]	-849.0 ms (-5.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.921 s [14.921 s, 14.921 s]	-
appsec	14.71 s [14.71 s, 14.71 s]	-211.0 ms (-1.4%)
iast	19.162 s [19.162 s, 19.162 s]	4.241 s (28.4%)
iast_GLOBAL	18.035 s [18.035 s, 18.035 s]	3.114 s (20.9%)
profiling	14.957 s [14.957 s, 14.957 s]	36.0 ms (0.2%)
tracing	14.654 s [14.654 s, 14.654 s]	-267.0 ms (-1.8%)

nikita-tkachenko-datadog added type: bug comp: ci visibility Continuous Integration Visibility labels Jan 20, 2025

nikita-tkachenko-datadog marked this pull request as ready for review January 20, 2025 13:38

nikita-tkachenko-datadog requested review from a team as code owners January 20, 2025 13:38

nikita-tkachenko-datadog requested review from anmarchenko and ygree January 20, 2025 13:38

juan-fernandez approved these changes Jan 20, 2025

View reviewed changes

Set test framework and test framework version tags atomically

a83cee4

nikita-tkachenko-datadog force-pushed the nikita-tkachenko/test-framework-tags-sync branch from 20a5542 to a83cee4 Compare January 22, 2025 16:06

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Set test framework and test framework version tags atomically #8252

Set test framework and test framework version tags atomically #8252

nikita-tkachenko-datadog commented Jan 20, 2025

pr-commenter bot commented Jan 20, 2025 •

edited

Loading

Set test framework and test framework version tags atomically #8252

Are you sure you want to change the base?

Set test framework and test framework version tags atomically #8252

Conversation

nikita-tkachenko-datadog commented Jan 20, 2025

What Does This Do

Motivation

Contributor Checklist

pr-commenter bot commented Jan 20, 2025 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

pr-commenter bot commented Jan 20, 2025 •

edited

Loading