DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
MySQL to Snowflake: Binlog CDC Without Kafka or Debezium, Step by Step

MySQL to Snowflake: Binlog CDC Without Kafka or Debezium, Step by Step

Comments
11 min read
Building a Medallion Data Warehouse with Airflow, dbt, and PostgreSQL — and the 3 Bugs That Taught Me the Most

Building a Medallion Data Warehouse with Airflow, dbt, and PostgreSQL — and the 3 Bugs That Taught Me the Most

Comments
3 min read
How to scrape Twitter (x.com) without authentication using Gaffa

How to scrape Twitter (x.com) without authentication using Gaffa

Comments
8 min read
I built a free Data Engineering pipeline with dbt, DuckDB and GitHub Actions (no AWS)

I built a free Data Engineering pipeline with dbt, DuckDB and GitHub Actions (no AWS)

5
Comments 1
7 min read
Building a Smart Supply Chain Intelligence Platform on AWS

Building a Smart Supply Chain Intelligence Platform on AWS

Comments
11 min read
Inspecting Apache Parquet Footers & Debugging MCP (mcp.json) Configs Entirely In-Browser

Inspecting Apache Parquet Footers & Debugging MCP (mcp.json) Configs Entirely In-Browser

Comments 2
3 min read
An Aggregate Is a Function, Not a Sum

An Aggregate Is a Function, Not a Sum

Comments
18 min read
ClickHouse Cloud Executable UDFs GA: Native Code, Network Access, and Query-Level Metrics

ClickHouse Cloud Executable UDFs GA: Native Code, Network Access, and Query-Level Metrics

Comments
3 min read
Snowflake's AI Agents Fix Pipelines: Data Engineer Impact

Snowflake's AI Agents Fix Pipelines: Data Engineer Impact

Comments
9 min read
Building a subcontractor shortlist for a federal machining bid from SBA Small Business Search with Python

Building a subcontractor shortlist for a federal machining bid from SBA Small Business Search with Python

Comments
5 min read
DAX in eMondrian is out of beta: what works in Power BI, and what doesn't

DAX in eMondrian is out of beta: what works in Power BI, and what doesn't

Comments
5 min read
Parquet vs Avro vs ORC for Data Engineering

Parquet vs Avro vs ORC for Data Engineering

Comments
8 min read
Beyond Sentiment: Customer Intelligence with Snowflake Cortex AI and Streamlit

Beyond Sentiment: Customer Intelligence with Snowflake Cortex AI and Streamlit

Comments
8 min read
Free company data API: four endpoints with no key — and the four traps that corrupt your dataset

Free company data API: four endpoints with no key — and the four traps that corrupt your dataset

Comments
10 min read
10 SQL Interview Questions for Data Engineers (2027), with Answers

10 SQL Interview Questions for Data Engineers (2027), with Answers

Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址