source: https://github.com/dbt-labs/dbt

Shift from ETL to ELT

What is dbt?

Need of Transformation

Where does DBT fit?

DBT Core Vs DBT Cloud

DBT core

DBT cloud

Core Concepts

Everything is a Select statements

Model

Materialisation

DBT Generates the DDL at run time

Ref

select *from public.raw_dataselect *from {{ref('model_a')}}

DBT Lineage Graph

Easily build and test

version: 2models:- name: orderscolumns:- name: order_idtests:- unique- not_null- name: statustests:- accepted_values:values: ['placed', 'shipped', 'completed', 'returned']- name: customer_idtests:- relationships:to: ref('customers')field: id

Documentation

Reusability

DEMO TIME

python3 -m venv dbt-env             # create the environmentsource dbt-env/bin/activate         # activate the environmentpip install dbt

Bigdata Engineer — Love for BigData, Analytics, Cloud and Infrastructure. Want to talk more? Ping me in Linked In: https://www.linkedin.com/in/ajshetty28/