Deep Dive on Data Engineering and Devops concepts
Apache is the opensource hub for various datatools. Let's explore them and understand which tool fits your usecase · Apache software foundation entering...
ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) are both data integration processes used to move and transform data from one system...
Spinning up Airflow environment following a online tutorial? Ensure you are incorporating the best practices · Apache Airflow - The famous Opensource...
Apache airflow has Celery, Kubernetes, CeleryKubernetes and Dask Executors. This post explores what those are and how to use them. · Celery...
Get started with Apache Airflow · tl;dr get the bash script Have Python installed in your system, 3.8+ Create a folder mkdir -p...
