Posts

work

Image
   dbt uses ur keys from delta n definition n then identify what chged and adds processing col 23/24-scd2 config( materialized='delta', --table loading mechanism unique_key='id',  --PK of table stratergy='check', --mechanism how to handle new incoming data,always check  .data need to be checked in existing table with new incoming data and compared. properties={"partitioned_by":"ARRAY['dbt_valid_from']"},  --any specific properties that the table shd have  target_schema='pcc',  --schema where table will deploy check_cols="all",  --which col need to tested against for scd2 compare invalid_hard_deletes=True,  --mechanism to tell type 23 ,24, by default value is false and will type 24. if made true it is 23. updated_at=var('BUSINESS_DATE')  --this config set 'dbt_valid_from' date (=start date) when no value is set default to 'CURRENT_DATE' this can be passed via dt config or while falling dt run o...
Post a Comment
Read more

Teradata

Image
  https://drive.google.com/file/d/1vevk2HJLngFs0PFqvefq4h_pbt1dB73t/view Teradata is the most popular Relational Database Management System (RDBMS). The Teradata is suitable for large data warehousing applications. Features of Teradata Advantages of the Teradata Relational Database : advantages of Relational Databases (RDBMS) Data Warehouse? A data warehouse is a central repository that stores integrated, historical data extracted from operational systems , enabling enterprise-wide analytics and decision-making. 📘 What is a Data Mart ? A Data Mart is a subject-specific subset of a data warehouse that focuses on a specific department, function, or business area (e.g., marketing, sales, HR). ============================================================== Components of Teradata Teradata is a very efficient, less expensive, and high-quality Relational Database management System. Teradata is based on Massively Parallel Processing (MPP) architecture. It is made of Parsing Engine (...
Post a Comment
Read more