SignalPilot is
#1
on both public data-agent benchmarks
See the results →
SIGNALPILOT
Benchmark
Comparison
Platform
More
Blog
Engineering notes, benchmark reports, and product updates.
Compare
Compare a hand-built harness with maintained blocks.
ADE-Bench
62 of 64 analytics-engineering tasks resolved.
Quickstart
Install SignalPilot in four steps.
About
Why we are building production-ready agents.
Docs
Read the workflows and reference guides.
Support
Get help or contact the SignalPilot team.
For teams
Use cases for data, ML, analytics, and SaaS teams.
SaaS teams
Verified revenue, retention, and product answers.
ML engineers
Agent workflows, evals, and governed data access.
Analytics engineers
Build, verify, and audit every data change.
Data scientists
Reproducible analysis with an evidence receipt.
Community
Join SignalPilot builders and follow product updates.
GitHub
Inspect the open-source building blocks.
Slack
Ask questions and meet other builders.
X
Follow product and benchmark updates.
LinkedIn
Follow SignalPilot on LinkedIn.
Get Started Free
Menu
SignalPilot
/
ADE-Bench
/
analytics_engineering007
←
analytics_engineering006
20 / 62
analytics_engineering008
→
analytics_engineering007
Pass
elapsed
9m 4s
turns
149
model
claude-sonnet-4-6
Prompt:
The id field in the "products" table is now a string. This has broken several models. Update them so that they work with product ids that are strings.
← Back to all tasks
Trace
Models
27