›Get Started Free

Benchmarks

SignalPilot holds the highest score ever on dbt Labs' ADE-Bench — resolving 62 of 64 tasks on the analytics-engineering benchmark.

Full task-by-task evaluation results below.

Read the full ADE-Bench report

96.9% pass rate·62 passed·2 failed·64 total·claude-sonnet-4-6

Task	Status	Turns
airbnb001	Pass	111
airbnb002	Pass	117
airbnb003	Pass	104
airbnb004	Pass	120
airbnb005	Pass	116
airbnb006	Pass	104
airbnb007	Pass	106
airbnb008	Pass	130
airbnb009	Pass	113
airbnb010	Pass	151
airbnb011	Pass	123
airbnb012	Pass	124
airbnb013	Pass	109
analytics_engineering001	Pass	10
analytics_engineering002	Pass	74
analytics_engineering003	Pass	90
analytics_engineering004	Pass	94
analytics_engineering005	Pass	93
analytics_engineering006	Pass	148
analytics_engineering007	Pass	149
analytics_engineering008	Pass	84
asana001	Pass	209
asana002	Pass	318
asana003	Pass	264
asana004	Pass	137
asana005	Pass	151
f1001	Pass	185
f1002	Pass	140
f1003	Pass	64
f1004	Pass	83
f1005	Pass	86
f1006	Pass	93
f1007	Pass	94
f1009	Pass	100
f1010	Pass	104
f1011	Pass	86
helixops_saas001	Pass	88
helixops_saas002	Pass	97
helixops_saas003	Pass	134
helixops_saas004	Pass	76
helixops_saas005	Pass	104
helixops_saas006	Pass	87
helixops_saas007	Pass	118
helixops_saas008	Pass	117
helixops_saas009	Pass	145
helixops_saas010	Pass	110
helixops_saas011	Pass	136
helixops_saas012	Pass	112
helixops_saas013	Pass	117
helixops_saas015	Pass	144
helixops_saas016	Pass	94
helixops_saas017	Pass	145
helixops_saas018	Pass	102
intercom001	Pass	146
intercom002	Pass	149
intercom003	Pass	144
quickbooks001	Pass	177
quickbooks002	Pass	199
quickbooks003	Pass	228
quickbooks004	Pass	289
simple001	Pass	81
simple002	Pass	73
f1008	Fail	—
workday001	Fail	—

Run ID: ade-full-v2 · Suite: ade-bench · ADE-Bench GitHub