Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Part 5 - Ingestion DAG and Raw Storage 📥
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 5 - Ingestion DAG and Raw Storage 📥
#
automation
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 12 - Superset Seeding and Dashboards 🎛️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 12 - Superset Seeding and Dashboards 🎛️
#
automation
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 4 - Airflow Runtime and Shared Config ⚙️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 4 - Airflow Runtime and Shared Config ⚙️
#
architecture
#
automation
#
dataengineering
#
python
Comments
Add Comment
2 min read
Part 9 - dbt Project Setup and Contracts 🧱
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 9 - dbt Project Setup and Contracts 🧱
#
database
#
dataengineering
#
postgres
#
tutorial
Comments
Add Comment
1 min read
Part 1 - Introduction and End-to-End Architecture
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 1 - Introduction and End-to-End Architecture
#
architecture
#
data
#
dataengineering
#
tutorial
Comments
Add Comment
2 min read
Part 14 - Cloud Deployment and Lessons Learned ☁️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 14 - Cloud Deployment and Lessons Learned ☁️
#
aws
#
dataengineering
#
devops
#
terraform
Comments
Add Comment
2 min read
Part 2 - Data Sources and Domain Model 📡
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 2 - Data Sources and Domain Model 📡
#
api
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
Part 11 - Dimensions and Fact Table 📊
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 11 - Dimensions and Fact Table 📊
#
database
#
dataengineering
#
sql
#
tutorial
Comments
Add Comment
2 min read
Part 7 - Spark Transform Local vs Cloud ⚡
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 7 - Spark Transform Local vs Cloud ⚡
#
aws
#
cloud
#
dataengineering
#
tutorial
Comments
Add Comment
2 min read
Part 8 - Staging Load into Postgres 🗃️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 8 - Staging Load into Postgres 🗃️
#
database
#
dataengineering
#
postgres
#
tutorial
Comments
Add Comment
2 min read
Part 6 - API Client Design and Reliability 🔁
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 6 - API Client Design and Reliability 🔁
#
api
#
architecture
#
dataengineering
#
python
Comments
Add Comment
2 min read
Part 3 - Station Sampling and Cache Building 🗂️
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 3 - Station Sampling and Cache Building 🗂️
#
api
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
2 min read
What Is Data Downtime and How Do You Measure It?
Blaine Elliott
Blaine Elliott
Blaine Elliott
Follow
Apr 20
What Is Data Downtime and How Do You Measure It?
#
dataengineering
#
dataquality
Comments
Add Comment
15 min read
Kafka Consumer Patterns: What You Actually Need in Production
Sneha Wasankar
Sneha Wasankar
Sneha Wasankar
Follow
Apr 20
Kafka Consumer Patterns: What You Actually Need in Production
#
architecture
#
dataengineering
#
distributedsystems
#
systemdesign
1
reaction
Comments
Add Comment
3 min read
Part 10 - Base Model and Data Quality ✅
Abdelrahman Adnan
Abdelrahman Adnan
Abdelrahman Adnan
Follow
Apr 21
Part 10 - Base Model and Data Quality ✅
#
data
#
dataengineering
#
sql
#
tutorial
Comments
Add Comment
1 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account