New posts in Etl

Adding logs to Airflow Logs

COPY column order

How to set dependencies between DAGs in Airflow?

How to test(unit test) on ETL process?

What is a staging table?

Dynamically assign filename to excel connection string

Error 0xc0202049: Data Flow Task 1: Failure inserting into the read-only column

ErrorColumn value does not exist as Lineage ID

What does 'killed' mean when a processing of a huge CSV with Python, which suddenly stops?

DataFlow task in SSIS is very slow as compared to writing the sql query in Execute SQL task