DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
AWS Lambda and AWS Glue Python Shell in the Context of Lightweight ETL
datapenguin profile

AWS Lambda and AWS Glue Python Shell in the Context of Lightweight ETL

#aws #dataengineering #etl
3
Comments
7 min read
SQL: Doing GROUP BY in CsvPath
david_kershaw_b6916404da6 profile

SQL: Doing GROUP BY in CsvPath

#sql #dataengineering #csv #csvpath
Comments
5 min read
🔥 Day 3: RDDs - The Foundation of Spark
sandeepk27 profile

🔥 Day 3: RDDs - The Foundation of Spark

#distributedsystems #interview #dataengineering #tutorial
Comments
2 min read
🔥 Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified
sandeepk27 profile

🔥 Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified

#spark #dataengineering #bigdata #python
Comments
2 min read
The Developer's Guide to Normalizing Historical Airline Flight Data for Machine Learning
rameshchauhan profile

The Developer's Guide to Normalizing Historical Airline Flight Data for Machine Learning

#dataengineering #datascience #machinelearning
Comments
6 min read
Overview of Real-Time Data Synchronization from MySQL to VeloDB
apachedoris profile

Overview of Real-Time Data Synchronization from MySQL to VeloDB

#database #aws #dataengineering #mysql
5
Comments
5 min read
Stop Writing df.describe(): Automate EDA with D-Tale (The Lazy Engineer's Way)
theaidataengineer1010 profile

Stop Writing df.describe(): Automate EDA with D-Tale (The Lazy Engineer's Way)

#python #dataengineering #productivity #beginners
Comments
3 min read
Build a Local Lead Gen Machine: Scraping Google Maps with n8n (Reliably)
wanjiang profile

Build a Local Lead Gen Machine: Scraping Google Maps with n8n (Reliably)

#n8n #automation #api #dataengineering
Comments
3 min read
CHW Monthly Activity Aggregation: Turning Visit Logs into Insight
oliver_samuel_028c6f65ad6 profile

CHW Monthly Activity Aggregation: Turning Visit Logs into Insight

#analytics #sql #dataengineering #tooling
Comments
5 min read
🔥 Day 2: Understanding Spark Architecture - How Spark Executes Your Code Internally
sandeepk27 profile

🔥 Day 2: Understanding Spark Architecture - How Spark Executes Your Code Internally

#spark #python #dataengineering #bigdata
Comments
2 min read
RAG Isn’t a Modeling Problem. It’s a Data Engineering Problem.
alexmercedcoder profile

RAG Isn’t a Modeling Problem. It’s a Data Engineering Problem.

#architecture #dataengineering #llm #rag
1
Comments
6 min read
Apache Data Lakehouse Weekly: December 30, 2025 – January 5, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: December 30, 2025 – January 5, 2026

#news #database #dataengineering #opensource
1
Comments
4 min read
Marmot: Data catalog without the complex infrastructure
charliehaley profile

Marmot: Data catalog without the complex infrastructure

#showdev #dataengineering #opensource #go
1
Comments
3 min read
TDD for dbt: unit testing the way it should be
niclasolofsson profile

TDD for dbt: unit testing the way it should be

#codequality #dataengineering #softwareengineering #testing
2
Comments
12 min read
Building a Medical-Grade Knowledge Graph: Mapping Drug Interactions with Neo4j and LlamaIndex 🩺💻
beck_moulton profile

Building a Medical-Grade Knowledge Graph: Mapping Drug Interactions with Neo4j and LlamaIndex 🩺💻

#ai #python #dataengineering #neo4j
Comments 1
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.