dbt Integration
SignalPilot integrates with dbt to bring your transformation layer context into data investigations. Access model lineage, documentation, test results, and column-level metadata without leaving your notebook.What dbt Integration Provides
| Context Type | What You Get | Example Use |
|---|---|---|
| Model Lineage | Upstream/downstream dependencies | ”What feeds into this metric?” |
| Documentation | Model and column descriptions | ”What does this column mean?” |
| Test Results | Data quality test status | ”Are there any failing tests?” |
| Column Lineage | Field-level transformations | ”Where does this field come from?” |
| Freshness | Source freshness status | ”When was this data last updated?” |
Supported dbt Versions
| dbt Type | Version | Features |
|---|---|---|
| dbt Cloud | All tiers | Full API access, real-time sync |
| dbt Core | 1.0+ | Manifest/catalog file parsing |
Setup: dbt Cloud
Get Your dbt Cloud API Token
- Log in to dbt Cloud
- Go to Account Settings → API Access
- Generate a new Service Token with these permissions:
Metadata API(required)Job triggers(optional, for freshness checks)
- Copy the token
Find Your Account and Project IDs
From your dbt Cloud URL:
https://cloud.getdbt.com/deploy/{account_id}/projects/{project_id}Setup: dbt Core
For dbt Core, SignalPilot reads your manifest and catalog files directly.Using dbt Context
Model Lineage
Ask about dependencies to understand data flow:Test Results
Check data quality before investigating:Column Lineage
Trace where data comes from:dbt Commands
| Command | Description |
|---|---|
@dbt show models | List all models |
@dbt lineage <model> | Show upstream/downstream |
@dbt describe <model> | Show model documentation |
@dbt tests | Show test results |
@dbt freshness | Check source freshness |
Best Practices
Document Your Models
Well-documented dbt models make SignalPilot investigations faster. Include column descriptions, especially for business logic.
Run Tests Before Investigating
Check
@dbt tests before deep investigations. Failing tests might explain data anomalies.