Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures by aboitreaud · Pull Request #11033 · DataDog/dd-trace-java

aboitreaud · 2026-04-01T21:05:38Z

What Does This Do

Adds instrumentation on QueryExecution.assertAnalyzed() to catch Catalyst analysis failures from any entry point — SparkSession.sql(), Dataset.select(), Dataset.filter(), etc. Previously, only SparkSession.sql() failures were caught (PR #10981), but customer failures through DataFrame API operations (df.select()) were invisible to the tracer.

Also reverts the lastSqlFailed reset removal from the original branch — a successful Spark job now resets both lastJobFailed and lastSqlFailed, matching existing behavior and avoiding false positives for apps that catch and recover from SQL errors.

Debug logging is intentionally included — this build is for customer validation, not merge.

Motivation

Customer BRE stderr logs showed spark.application span marked SUCCESS when the EMR step failed. The AnalysisException (UNRESOLVED_COLUMN) was thrown from Dataset.select() → QueryExecution.assertAnalyzed(), a path not covered by the existing SparkSqlFailureAdvice on SparkSession.sql().

Additional Notes

QueryExecution.assertAnalyzed() is stable (public void assertAnalyzed()) across Spark 3.5.x, 4.0.x, 4.1.x
Existing SparkSqlFailureAdvice on SparkSession.sql() is kept (redundant but harmless, cleanup later)
New integration test exercises the DataFrame API path specifically (sparkSession.range(1).toDF("id").select("nonexistent_column"))

Jira ticket: [PROJ-IDENT]

…s failures

pr-commenter · 2026-04-21T17:43:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1777042718
git_commit_sha	`6880c80`	`8d1a7c9`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~8d1a7c9059

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777044603	1777044603
ci_job_id	1628861797	1628861797
ci_pipeline_id	109579320	109579320
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-dlgip2c9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-dlgip2c9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058001
Total [baseline] (8.819 s) : 0, 8818753
Agent [candidate] (1.063 s) : 0, 1063470
Total [candidate] (8.794 s) : 0, 8794423
section iast
Agent [baseline] (1.236 s) : 0, 1236030
Total [baseline] (9.587 s) : 0, 9586701
Agent [candidate] (1.242 s) : 0, 1241808
Total [candidate] (9.547 s) : 0, 9546830

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.236 s	178.03 ms (16.8%)
Total	tracing	8.819 s	-
Total	iast	9.587 s	767.948 ms (8.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	iast	1.242 s	178.337 ms (16.8%)
Total	tracing	8.794 s	-
Total	iast	9.547 s	752.407 ms (8.6%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.247 ms) : 0, 1247
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (633.307 ms) : 0, 633307
BytebuddyAgent [candidate] (637.401 ms) : 0, 637401
AgentMeter [baseline] (29.582 ms) : 0, 29582
AgentMeter [candidate] (29.762 ms) : 0, 29762
GlobalTracer [baseline] (248.503 ms) : 0, 248503
GlobalTracer [candidate] (249.869 ms) : 0, 249869
AppSec [baseline] (32.383 ms) : 0, 32383
AppSec [candidate] (32.621 ms) : 0, 32621
Debugger [baseline] (59.125 ms) : 0, 59125
Debugger [candidate] (59.447 ms) : 0, 59447
Remote Config [baseline] (606.349 µs) : 0, 606
Remote Config [candidate] (597.163 µs) : 0, 597
Telemetry [baseline] (8.027 ms) : 0, 8027
Telemetry [candidate] (8.084 ms) : 0, 8084
Flare Poller [baseline] (8.98 ms) : 0, 8980
Flare Poller [candidate] (8.242 ms) : 0, 8242
section iast
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (812.456 ms) : 0, 812456
BytebuddyAgent [candidate] (816.889 ms) : 0, 816889
AgentMeter [baseline] (11.662 ms) : 0, 11662
AgentMeter [candidate] (11.553 ms) : 0, 11553
GlobalTracer [baseline] (239.942 ms) : 0, 239942
GlobalTracer [candidate] (240.724 ms) : 0, 240724
AppSec [baseline] (28.668 ms) : 0, 28668
AppSec [candidate] (27.236 ms) : 0, 27236
Debugger [baseline] (63.952 ms) : 0, 63952
Debugger [candidate] (65.966 ms) : 0, 65966
Remote Config [baseline] (535.615 µs) : 0, 536
Remote Config [candidate] (531.063 µs) : 0, 531
Telemetry [baseline] (7.802 ms) : 0, 7802
Telemetry [candidate] (7.784 ms) : 0, 7784
Flare Poller [baseline] (3.49 ms) : 0, 3490
Flare Poller [candidate] (3.46 ms) : 0, 3460
IAST [baseline] (30.338 ms) : 0, 30338
IAST [candidate] (30.324 ms) : 0, 30324

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058308
Total [baseline] (11.11 s) : 0, 11110186
Agent [candidate] (1.057 s) : 0, 1056676
Total [candidate] (11.109 s) : 0, 11109021
section appsec
Agent [baseline] (1.256 s) : 0, 1255974
Total [baseline] (11.004 s) : 0, 11004284
Agent [candidate] (1.26 s) : 0, 1259977
Total [candidate] (11.063 s) : 0, 11062709
section iast
Agent [baseline] (1.24 s) : 0, 1239668
Total [baseline] (11.214 s) : 0, 11213848
Agent [candidate] (1.23 s) : 0, 1230175
Total [candidate] (11.341 s) : 0, 11340539
section profiling
Agent [baseline] (1.182 s) : 0, 1181544
Total [baseline] (10.891 s) : 0, 10891063
Agent [candidate] (1.183 s) : 0, 1182549
Total [candidate] (11.031 s) : 0, 11030650

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.256 s	197.666 ms (18.7%)
Agent	iast	1.24 s	181.36 ms (17.1%)
Agent	profiling	1.182 s	123.236 ms (11.6%)
Total	tracing	11.11 s	-
Total	appsec	11.004 s	-105.903 ms (-1.0%)
Total	iast	11.214 s	103.662 ms (0.9%)
Total	profiling	10.891 s	-219.124 ms (-2.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.26 s	203.301 ms (19.2%)
Agent	iast	1.23 s	173.499 ms (16.4%)
Agent	profiling	1.183 s	125.872 ms (11.9%)
Total	tracing	11.109 s	-
Total	appsec	11.063 s	-46.311 ms (-0.4%)
Total	iast	11.341 s	231.518 ms (2.1%)
Total	profiling	11.031 s	-78.371 ms (-0.7%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.247 ms) : 0, 1247
BytebuddyAgent [baseline] (631.078 ms) : 0, 631078
BytebuddyAgent [candidate] (631.896 ms) : 0, 631896
AgentMeter [baseline] (29.496 ms) : 0, 29496
AgentMeter [candidate] (29.534 ms) : 0, 29534
GlobalTracer [baseline] (248.643 ms) : 0, 248643
GlobalTracer [candidate] (248.826 ms) : 0, 248826
AppSec [baseline] (32.612 ms) : 0, 32612
AppSec [candidate] (32.396 ms) : 0, 32396
Debugger [baseline] (60.398 ms) : 0, 60398
Debugger [candidate] (59.698 ms) : 0, 59698
Remote Config [baseline] (605.077 µs) : 0, 605
Remote Config [candidate] (591.564 µs) : 0, 592
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (8.047 ms) : 0, 8047
Flare Poller [baseline] (9.136 ms) : 0, 9136
Flare Poller [candidate] (8.322 ms) : 0, 8322
section appsec
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (671.071 ms) : 0, 671071
BytebuddyAgent [candidate] (673.536 ms) : 0, 673536
AgentMeter [baseline] (12.136 ms) : 0, 12136
AgentMeter [candidate] (12.121 ms) : 0, 12121
GlobalTracer [baseline] (247.9 ms) : 0, 247900
GlobalTracer [candidate] (248.738 ms) : 0, 248738
IAST [baseline] (24.222 ms) : 0, 24222
IAST [candidate] (24.278 ms) : 0, 24278
AppSec [baseline] (185.765 ms) : 0, 185765
AppSec [candidate] (186.233 ms) : 0, 186233
Debugger [baseline] (65.511 ms) : 0, 65511
Debugger [candidate] (65.634 ms) : 0, 65634
Remote Config [baseline] (568.615 µs) : 0, 569
Remote Config [candidate] (575.062 µs) : 0, 575
Telemetry [baseline] (7.856 ms) : 0, 7856
Telemetry [candidate] (7.911 ms) : 0, 7911
Flare Poller [baseline] (3.452 ms) : 0, 3452
Flare Poller [candidate] (3.462 ms) : 0, 3462
section iast
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (817.279 ms) : 0, 817279
BytebuddyAgent [candidate] (807.929 ms) : 0, 807929
AgentMeter [baseline] (11.483 ms) : 0, 11483
AgentMeter [candidate] (11.403 ms) : 0, 11403
GlobalTracer [baseline] (238.461 ms) : 0, 238461
GlobalTracer [candidate] (238.79 ms) : 0, 238790
IAST [baseline] (28.917 ms) : 0, 28917
IAST [candidate] (29.892 ms) : 0, 29892
AppSec [baseline] (27.641 ms) : 0, 27641
AppSec [candidate] (28.424 ms) : 0, 28424
Debugger [baseline] (66.682 ms) : 0, 66682
Debugger [candidate] (64.819 ms) : 0, 64819
Remote Config [baseline] (534.618 µs) : 0, 535
Remote Config [candidate] (528.482 µs) : 0, 528
Telemetry [baseline] (7.77 ms) : 0, 7770
Telemetry [candidate] (7.782 ms) : 0, 7782
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.417 ms) : 0, 3417
section profiling
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.171 ms) : 0, 1171
BytebuddyAgent [baseline] (689.481 ms) : 0, 689481
BytebuddyAgent [candidate] (689.949 ms) : 0, 689949
AgentMeter [baseline] (9.2 ms) : 0, 9200
AgentMeter [candidate] (9.197 ms) : 0, 9197
GlobalTracer [baseline] (206.789 ms) : 0, 206789
GlobalTracer [candidate] (206.666 ms) : 0, 206666
AppSec [baseline] (32.664 ms) : 0, 32664
AppSec [candidate] (32.854 ms) : 0, 32854
Debugger [baseline] (65.583 ms) : 0, 65583
Debugger [candidate] (65.751 ms) : 0, 65751
Remote Config [baseline] (582.802 µs) : 0, 583
Remote Config [candidate] (582.294 µs) : 0, 582
Telemetry [baseline] (7.784 ms) : 0, 7784
Telemetry [candidate] (7.85 ms) : 0, 7850
Flare Poller [baseline] (3.573 ms) : 0, 3573
Flare Poller [candidate] (3.555 ms) : 0, 3555
ProfilingAgent [baseline] (93.644 ms) : 0, 93644
ProfilingAgent [candidate] (93.913 ms) : 0, 93913
Profiling [baseline] (94.205 ms) : 0, 94205
Profiling [candidate] (94.474 ms) : 0, 94474

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1777042718
git_commit_sha	`6880c80`	`8d1a7c9`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~8d1a7c9059

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777045182	1777045182
ci_job_id	1628861799	1628861799
ci_pipeline_id	109579320	109579320
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-4gvuaxy7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-4gvuaxy7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 20 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:iast:high_load	better [-2.260ms; -1.017ms] or [-11.691%; -5.260%]	unsure [-2.351ms; -0.558ms] or [-7.722%; -1.833%]	unstable [-9.667op/s; +44.729op/s] or [-4.027%; +18.632%]	17.689ms	28.998ms	257.594op/s	19.327ms	30.453ms	240.062op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.462 ms) : 18273, 18650
.   : milestone, 18462,
appsec (19.521 ms) : 19322, 19721
.   : milestone, 19521,
code_origins (17.751 ms) : 17576, 17925
.   : milestone, 17751,
iast (19.445 ms) : 19247, 19643
.   : milestone, 19445,
profiling (17.975 ms) : 17797, 18153
.   : milestone, 17975,
tracing (17.731 ms) : 17557, 17906
.   : milestone, 17731,
section candidate
no_agent (19.369 ms) : 19171, 19567
.   : milestone, 19369,
appsec (19.001 ms) : 18807, 19195
.   : milestone, 19001,
code_origins (18.117 ms) : 17939, 18296
.   : milestone, 18117,
iast (18.111 ms) : 17933, 18290
.   : milestone, 18111,
profiling (18.04 ms) : 17861, 18219
.   : milestone, 18040,
tracing (18.032 ms) : 17855, 18209
.   : milestone, 18032,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.462 ms [18.273 ms, 18.65 ms]	-
appsec	19.521 ms [19.322 ms, 19.721 ms]	1.06 ms (5.7%)
code_origins	17.751 ms [17.576 ms, 17.925 ms]	-710.753 µs (-3.8%)
iast	19.445 ms [19.247 ms, 19.643 ms]	983.311 µs (5.3%)
profiling	17.975 ms [17.797 ms, 18.153 ms]	-486.892 µs (-2.6%)
tracing	17.731 ms [17.557 ms, 17.906 ms]	-730.612 µs (-4.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.369 ms [19.171 ms, 19.567 ms]	-
appsec	19.001 ms [18.807 ms, 19.195 ms]	-367.739 µs (-1.9%)
code_origins	18.117 ms [17.939 ms, 18.296 ms]	-1.252 ms (-6.5%)
iast	18.111 ms [17.933 ms, 18.29 ms]	-1.258 ms (-6.5%)
profiling	18.04 ms [17.861 ms, 18.219 ms]	-1.329 ms (-6.9%)
tracing	18.032 ms [17.855 ms, 18.209 ms]	-1.337 ms (-6.9%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.263 ms) : 1250, 1276
.   : milestone, 1263,
iast (3.35 ms) : 3301, 3398
.   : milestone, 3350,
iast_FULL (6.066 ms) : 6004, 6127
.   : milestone, 6066,
iast_GLOBAL (3.86 ms) : 3781, 3939
.   : milestone, 3860,
profiling (2.21 ms) : 2190, 2230
.   : milestone, 2210,
tracing (1.867 ms) : 1851, 1882
.   : milestone, 1867,
section candidate
no_agent (1.245 ms) : 1232, 1257
.   : milestone, 1245,
iast (3.299 ms) : 3253, 3345
.   : milestone, 3299,
iast_FULL (5.904 ms) : 5845, 5963
.   : milestone, 5904,
iast_GLOBAL (3.787 ms) : 3723, 3851
.   : milestone, 3787,
profiling (2.215 ms) : 2194, 2235
.   : milestone, 2215,
tracing (1.923 ms) : 1907, 1938
.   : milestone, 1923,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.263 ms [1.25 ms, 1.276 ms]	-
iast	3.35 ms [3.301 ms, 3.398 ms]	2.086 ms (165.2%)
iast_FULL	6.066 ms [6.004 ms, 6.127 ms]	4.803 ms (380.2%)
iast_GLOBAL	3.86 ms [3.781 ms, 3.939 ms]	2.597 ms (205.6%)
profiling	2.21 ms [2.19 ms, 2.23 ms]	946.785 µs (75.0%)
tracing	1.867 ms [1.851 ms, 1.882 ms]	603.558 µs (47.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.245 ms [1.232 ms, 1.257 ms]	-
iast	3.299 ms [3.253 ms, 3.345 ms]	2.055 ms (165.1%)
iast_FULL	5.904 ms [5.845 ms, 5.963 ms]	4.66 ms (374.4%)
iast_GLOBAL	3.787 ms [3.723 ms, 3.851 ms]	2.542 ms (204.3%)
profiling	2.215 ms [2.194 ms, 2.235 ms]	970.294 µs (78.0%)
tracing	1.923 ms [1.907 ms, 1.938 ms]	678.303 µs (54.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1777042718
git_commit_sha	`6880c80`	`8d1a7c9`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~8d1a7c9059

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1777044931	1777044931
ci_job_id	1628861802	1628861802
ci_pipeline_id	109579320	109579320
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-yzi1tn0i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-yzi1tn0i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1476, 1499
.   : milestone, 1487,
appsec (3.749 ms) : 3532, 3965
.   : milestone, 3749,
iast (2.281 ms) : 2211, 2351
.   : milestone, 2281,
iast_GLOBAL (2.325 ms) : 2255, 2395
.   : milestone, 2325,
profiling (2.095 ms) : 2040, 2149
.   : milestone, 2095,
tracing (2.077 ms) : 2023, 2130
.   : milestone, 2077,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.826 ms) : 3604, 4049
.   : milestone, 3826,
iast (2.279 ms) : 2209, 2348
.   : milestone, 2279,
iast_GLOBAL (2.315 ms) : 2245, 2385
.   : milestone, 2315,
profiling (2.096 ms) : 2041, 2151
.   : milestone, 2096,
tracing (2.082 ms) : 2028, 2135
.   : milestone, 2082,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.476 ms, 1.499 ms]	-
appsec	3.749 ms [3.532 ms, 3.965 ms]	2.261 ms (152.0%)
iast	2.281 ms [2.211 ms, 2.351 ms]	793.243 µs (53.3%)
iast_GLOBAL	2.325 ms [2.255 ms, 2.395 ms]	837.322 µs (56.3%)
profiling	2.095 ms [2.04 ms, 2.149 ms]	607.27 µs (40.8%)
tracing	2.077 ms [2.023 ms, 2.13 ms]	589.262 µs (39.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.498 ms]	-
appsec	3.826 ms [3.604 ms, 4.049 ms]	2.34 ms (157.4%)
iast	2.279 ms [2.209 ms, 2.348 ms]	791.8 µs (53.3%)
iast_GLOBAL	2.315 ms [2.245 ms, 2.385 ms]	828.202 µs (55.7%)
profiling	2.096 ms [2.041 ms, 2.151 ms]	609.241 µs (41.0%)
tracing	2.082 ms [2.028 ms, 2.135 ms]	594.779 µs (40.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d1a7c9059, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.528 s) : 15528000, 15528000
.   : milestone, 15528000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.81 s) : 18810000, 18810000
.   : milestone, 18810000,
iast_GLOBAL (18.118 s) : 18118000, 18118000
.   : milestone, 18118000,
profiling (15.645 s) : 15645000, 15645000
.   : milestone, 15645000,
tracing (14.696 s) : 14696000, 14696000
.   : milestone, 14696000,
section candidate
no_agent (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
appsec (14.924 s) : 14924000, 14924000
.   : milestone, 14924000,
iast (18.822 s) : 18822000, 18822000
.   : milestone, 18822000,
iast_GLOBAL (18.064 s) : 18064000, 18064000
.   : milestone, 18064000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (14.651 s) : 14651000, 14651000
.   : milestone, 14651000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.528 s [15.528 s, 15.528 s]	-
appsec	14.934 s [14.934 s, 14.934 s]	-594.0 ms (-3.8%)
iast	18.81 s [18.81 s, 18.81 s]	3.282 s (21.1%)
iast_GLOBAL	18.118 s [18.118 s, 18.118 s]	2.59 s (16.7%)
profiling	15.645 s [15.645 s, 15.645 s]	117.0 ms (0.8%)
tracing	14.696 s [14.696 s, 14.696 s]	-832.0 ms (-5.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.992 s [14.992 s, 14.992 s]	-
appsec	14.924 s [14.924 s, 14.924 s]	-68.0 ms (-0.5%)
iast	18.822 s [18.822 s, 18.822 s]	3.83 s (25.5%)
iast_GLOBAL	18.064 s [18.064 s, 18.064 s]	3.072 s (20.5%)
profiling	14.957 s [14.957 s, 14.957 s]	-35.0 ms (-0.2%)
tracing	14.651 s [14.651 s, 14.651 s]	-341.0 ms (-2.3%)

github-actions · 2026-04-24T15:28:07Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

aboitreaud changed the title ~~Don't reset sql failed after a success~~ Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures Apr 21, 2026

aboitreaud force-pushed the adrien.boitreaud/no-sql-failed-reset branch from ef61c95 to 4e5f33e Compare April 21, 2026 16:52

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysi…

66cec29

…s failures

aboitreaud force-pushed the adrien.boitreaud/no-sql-failed-reset branch from 4e5f33e to 68ebce2 Compare April 21, 2026 16:57

Remove debug logging from Spark instrumentation

8d1a7c9

aboitreaud force-pushed the adrien.boitreaud/no-sql-failed-reset branch from 68ebce2 to 8d1a7c9 Compare April 24, 2026 14:58

aboitreaud marked this pull request as ready for review April 24, 2026 15:27

aboitreaud requested a review from a team as a code owner April 24, 2026 15:27

aboitreaud added type: enhancement Enhancements and improvements inst: apache spark Apache Spark instrumentation labels Apr 24, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures#11033

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures#11033
aboitreaud wants to merge 2 commits intomasterfrom
adrien.boitreaud/no-sql-failed-reset

aboitreaud commented Apr 1, 2026 •

edited

Loading

Uh oh!

pr-commenter Bot commented Apr 21, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

aboitreaud commented Apr 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter Bot commented Apr 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

aboitreaud commented Apr 1, 2026 •

edited

Loading

pr-commenter Bot commented Apr 21, 2026 •

edited

Loading