DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases
manishpodiyal profile

The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

#bigdata #spark #pyspark #dataengineering
Comments
2 min read
Data Warehousing & Modeling: From Foundation to AWS Cloud Implementation
damaac profile

Data Warehousing & Modeling: From Foundation to AWS Cloud Implementation

#aws #cloud #dataengineering
Comments
3 min read
Scaling data systems: How we process millions of records with Python
emotta profile

Scaling data systems: How we process millions of records with Python

#architecture #python #data #dataengineering
Comments
3 min read
Data Management Systems: Transactional to Analytical Architectures
edmund_eryuba profile

Data Management Systems: Transactional to Analytical Architectures

#database #dataengineering #datastructures #data
Comments
7 min read
OLAP vs OLTP: A Deep Dive into Database Processing Systems
karen_langat_299784e2c330 profile

OLAP vs OLTP: A Deep Dive into Database Processing Systems

#data #database #dataengineering #systemdesign
Comments
3 min read
Medallion Architecture: Designing Bronze, Silver, and Gold Layers
qvfagundes profile

Medallion Architecture: Designing Bronze, Silver, and Gold Layers

#databricks #dataengineering #ai #datascience
Comments
6 min read
OLAP vs OLTP: Understanding the Backbone of Modern Data Systems
petermuriya profile

OLAP vs OLTP: Understanding the Backbone of Modern Data Systems

#data #database #dataengineering #systemdesign
1
Comments
2 min read
How Databricks Genie Turns Plain English Into SQL Code
lucy1 profile
Lucy

How Databricks Genie Turns Plain English Into SQL Code

#databricks #dataengineering #sql #ai
5
Comments
11 min read
I built a DuckDB extension to handle chemistry data without pandas or RDKit
nk_maker profile

I built a DuckDB extension to handle chemistry data without pandas or RDKit

#rust #duckdb #chemistry #dataengineering
Comments
5 min read
I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)
dattasable profile

I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)

#sql #python #dataengineering #tutorial
2
Comments 1
3 min read
Performance and Apache Iceberg's Metadata
alexmercedcoder profile

Performance and Apache Iceberg's Metadata

#architecture #database #dataengineering #performance
Comments
7 min read
Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database
dattasable profile

Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database

#sql #database #dataengineering #programming
Comments 1
3 min read
Meet SDI: The No-Code ETL Tool Every Data Engineer Needs in Their Toolbox
fishoncloud profile

Meet SDI: The No-Code ETL Tool Every Data Engineer Needs in Their Toolbox

#dataengineering #cloud #etl
Comments
2 min read
Transactional Power Vs Analytical Precision: The Essential Guide to OLTP and OLAP
lawrence_murithi profile

Transactional Power Vs Analytical Precision: The Essential Guide to OLTP and OLAP

#luxdev #dataengineering #olap
Comments
12 min read
HCC Risk Adjustment Data Model: Building Accurate Risk Score Pipelines in SQL
season_mudbhary_7856e4083 profile

HCC Risk Adjustment Data Model: Building Accurate Risk Score Pipelines in SQL

#healthcare #sql #dataengineering #database
Comments 1
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.