DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
You Didn't Escape Airflow's Complexity — You Just Distributed It
andrew_tan_layline profile

You Didn't Escape Airflow's Complexity — You Just Distributed It

#architecture #automation #dataengineering #systemdesign
Comments
5 min read
# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines
pranith_m_05c4bc7561a6ffd profile

# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

#dataengineering #mysql #dba #python
Comments
15 min read
ETL Pipeline for Data Engineering: A Beginner's Guide to Extract, Transform, and Load
gowthampotureddi profile

ETL Pipeline for Data Engineering: A Beginner's Guide to Extract, Transform, and Load

#python #sql #interview #dataengineering
Comments
50 min read
Vectorizing Real-Time Kafka Events
pedrop3 profile

Vectorizing Real-Time Kafka Events

#dataengineering #java #postgres #rag
Comments
4 min read
Dive Into Containerization, Docker & Docker Compose
edmund_eryuba profile

Dive Into Containerization, Docker & Docker Compose

#dataengineering #containers #docker #containerapps
1
Comments
7 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON
arunkatherashala profile

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

#kore #dataengineering #rust #performance
Comments
5 min read
Mastering Modern Data Workflows with Docker
damaac profile

Mastering Modern Data Workflows with Docker

#dataengineering #devops #docker #tutorial
Comments
3 min read
Docker for Data Professionals: From Zero to Containerizing Your First Project
lawrence_murithi profile

Docker for Data Professionals: From Zero to Containerizing Your First Project

#docker #dataengineering #luxdev
Comments
11 min read
The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog
spkibe profile

The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog

#databricks #datamasking #dataengineering #unitycatalog
Comments
6 min read
Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap
lee_yao_cfeb14fb9b141b8c5 profile

Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap

#dataengineering #devops #docker #networking
Comments
7 min read
The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?
lawrence_murithi profile

The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?

#kimball #dataengineering #architecture
Comments
6 min read
Data Lake Architecture for Data Engineering Interviews
gowthampotureddi profile

Data Lake Architecture for Data Engineering Interviews

#python #sql #interview #dataengineering
Comments
44 min read
Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow
karen_langat_299784e2c330 profile

Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

#cryptocurrency #dataengineering #docker #postgres
1
Comments
4 min read
Building Your First Data Warehouse in Databricks — End to End 🎉
qvfagundes profile

Building Your First Data Warehouse in Databricks — End to End 🎉

#databricks #ai #dataengineering #datascience
Comments
7 min read
Python 101
renee_mumbi_w profile

Python 101

#ai #python #datascience #dataengineering
Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.