Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
The real problem with ingesting MongoDB into Delta Lake (and how I built a library to fix it)
Luiz Oliveira
Luiz Oliveira
Luiz Oliveira
Follow
May 5
The real problem with ingesting MongoDB into Delta Lake (and how I built a library to fix it)
#
dataengineering
#
python
#
opensource
#
mongodb
2
 reactions
Comments
4
 comments
5 min read
How We Accidentally Built a Customer Data Platform
Higgie
Higgie
Higgie
Follow
May 6
How We Accidentally Built a Customer Data Platform
#
dataengineering
#
architecture
#
webdev
#
saas
2
 reactions
Comments
Add Comment
8 min read
Beyond the Model: Why Document Intelligence Is the Next AI Infrastructure Layer
TI
TI
TI
Follow
for
Kreuzberg
Apr 22
Beyond the Model: Why Document Intelligence Is the Next AI Infrastructure Layer
#
ai
#
architecture
#
data
#
dataengineering
Comments
Add Comment
4 min read
Types of Data Analytics: The Complete Guide With Examples, Use Cases & Career Path
nandana
nandana
nandana
Follow
Apr 22
Types of Data Analytics: The Complete Guide With Examples, Use Cases & Career Path
#
datascience
#
data
#
dataengineering
1
 reaction
Comments
Add Comment
4 min read
Parsing Bank Statement PDFs: 5 Tools Compared for Developers (2026)
Jorge
Jorge
Jorge
Follow
Apr 21
Parsing Bank Statement PDFs: 5 Tools Compared for Developers (2026)
#
pdf
#
python
#
fintech
#
dataengineering
1
 reaction
Comments
Add Comment
6 min read
Rethinking Data Engineering: Why ETL Pipelines Still Take Too Long — and a New Way Forward
Ceena Jose
Ceena Jose
Ceena Jose
Follow
Apr 22
Rethinking Data Engineering: Why ETL Pipelines Still Take Too Long — and a New Way Forward
#
etlpipelines
#
schemamapping
#
vibecodingide
#
dataengineering
1
 reaction
Comments
1
 comment
3 min read
Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻
wellallyTech
wellallyTech
wellallyTech
Follow
Apr 23
Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻
#
ai
#
python
#
rag
#
dataengineering
Comments
Add Comment
3 min read
Building Your First Airflow DAG: Extracting Stock Data with Massive
Ng'ang'a Njongo
Ng'ang'a Njongo
Ng'ang'a Njongo
Follow
May 5
Building Your First Airflow DAG: Extracting Stock Data with Massive
#
airflow
#
dataengineering
#
python
#
api
2
 reactions
Comments
Add Comment
4 min read
How I scrape and de-dupe Meta ads for 1000 brands
Souymodeep Banerjee
Souymodeep Banerjee
Souymodeep Banerjee
Follow
Apr 21
How I scrape and de-dupe Meta ads for 1000 brands
#
python
#
playwright
#
dataengineering
5
 reactions
Comments
Add Comment
6 min read
I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP
Todd Fearn
Todd Fearn
Todd Fearn
Follow
Apr 21
I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP
#
ai
#
agents
#
mcp
#
dataengineering
1
 reaction
Comments
Add Comment
2 min read
Building a simple data pipeline with GCS and Databricks Autoloader
Yasmim
Yasmim
Yasmim
Follow
Apr 21
Building a simple data pipeline with GCS and Databricks Autoloader
#
cloud
#
dataengineering
#
python
#
tutorial
Comments
Add Comment
1 min read
Implementing a Centralized Metrics Layer with dbt and a Semantic Layer
beefed.ai
beefed.ai
beefed.ai
Follow
Apr 21
Implementing a Centralized Metrics Layer with dbt and a Semantic Layer
#
dataengineering
Comments
Add Comment
9 min read
Rebuilding the national narrative with AI and Docker
Brenda ..
Brenda ..
Brenda ..
Follow
Apr 21
Rebuilding the national narrative with AI and Docker
#
dataengineering
#
python
#
opensource
#
docker
1
 reaction
Comments
Add Comment
3 min read
Columnar Databases (ClickHouse/Snowflake)
Aviral Srivastava
Aviral Srivastava
Aviral Srivastava
Follow
Apr 21
Columnar Databases (ClickHouse/Snowflake)
#
architecture
#
database
#
dataengineering
#
performance
1
 reaction
Comments
Add Comment
8 min read
ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis
Manveer Chawla
Manveer Chawla
Manveer Chawla
Follow
Apr 20
ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis
#
data
#
dataengineering
#
clickhouse
#
json
6
 reactions
Comments
1
 comment
24 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account