datavault4dbt Demo on Snowflake!

This is a demo dbt project that uses the TPCH dataset to build a Data Vault with datavault4dbt on Snowflake.

The Data

The TPCH dataset includes a total of 8 source objects. These are:

• Customer
• Lineitem
• Nation
• Order
• Part
• Partsupp
• Region
• Supplier

The Data Vault Model

This embedded screenshot is based on a publicly available dbdocs Documentation and has been created with the open source tool dbt dbml erd.

Check out explanations of the Data Vault model in the wiki!

Usage

1. Clone this repository to your local machine.
2. Create and activate a new Python Virtual Environment.
3. Install dbt for Snowflake with pip install dbt-snowflake.
4. If not there already, create a new file called profiles.yml within your local user account folder, e.g. C:\Users\username\.dbt\profiles.yml
5. Add a new profile by adding this block of code to your profiles.yml:

   datavault4dbt_snowflake_demo:
   outputs:
       dev:
           <insert_authentication_config_here> 
   target: dev
   

   To fill out the placeholder, check the official dbt documentation to find the right authentication method to connect to your Snowflake instance.
6. Execute dbt debug and ensure that all checks are passed to verify that the connection is established correctly.
7. Execute dbt build and watch the entire Data Vault model coming to life within your own database!

Sidenote: On execution dbt will attempt to create multiple schemas in your target database, as defined in the dbt_project.yml. If this is not desired you can safely remove the models:-block, found at the end of the dbt_project.yml.