Rationale
dbt is Fluid Attacks' tool for data transformation, documentation, and integrated testing.
The main reasons why we chose it over other alternatives are:
- It does not tie us to any BI provider.
- It works seamlessly across multiple database providers.
- It works with SQL.
- It allows multiple data stages.
- It handles pipeline execution on its own.
- It offers a diverse suite of tests and the ability to create personalized ones.
Alternatives
The following alternatives were considered but not chosen for the following reasons:
LookML
- It is tied to Looker as a BI provider.
- It does not have testing capabilities.
- It is not as flexible as plain SQL.
Usage
We use dbt to
- create reusable data models;
- clean and transform data;
- test for data quality;
- document our data products.