DEV Community

#etl

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Restarting a Failed Data Pipeline Safely: A Fail-Closed Recovery Planner in Python
rupak_kulkarni_08b45c5846 profile

Restarting a Failed Data Pipeline Safely: A Fail-Closed Recovery Planner in Python

#python #dataengineering #etl #testing
Comments
5 min read
Load an on-prem database into a cloud warehouse: 1 million rows, measured
adan_potyondy profile

Load an on-prem database into a cloud warehouse: 1 million rows, measured

#dataengineering #postgres #database #etl
Comments
13 min read
Same guarantees, without programming them: Hydra ETL vs Airflow + dlt + dbt vs Airflow + Airbyte + dbt
bejaouibechir profile

Same guarantees, without programming them: Hydra ETL vs Airflow + dlt + dbt vs Airflow + Airbyte + dbt

#dataengineering #python #etl #airflow
Comments
6 min read
An AI agent only checks what it thought of: the stage order that found 9 blocking issues before the first line of code
bitpage profile

An AI agent only checks what it thought of: the stage order that found 9 blocking issues before the first line of code

#aiagents #claudecode #codereview #etl
1
Comments 2
14 min read
What Is ETL Testing?
keploy profile
keploy

What Is ETL Testing?

#etl #webdev #productivity #software
Comments
14 min read
Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs
costfabric profile

Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs

#microsoftfabric #dataengineering #powerbi #etl
Comments
3 min read
From Google- and Meta-Like CSVs to a Trusted Schema: Building Fail-Closed Python Adapters
rupak_kulkarni_08b45c5846 profile

From Google- and Meta-Like CSVs to a Trusted Schema: Building Fail-Closed Python Adapters

#python #dataengineering #etl #testing
Comments
6 min read
What is CDC in data engineering? Change data capture explained
kateryna_kozachenko_e23f1 profile

What is CDC in data engineering? Change data capture explained

#dataengineering #database #postgres #etl
1
Comments
15 min read
Load CSV and JSON from Azure Blob into Postgres with pg_duckdb
franckpachot profile

Load CSV and JSON from Azure Blob into Postgres with pg_duckdb

#postgres #duckdb #azure #etl
Comments
6 min read
Snowflake Openflow Limitations: 6 Production Trade-offs
techsourabh profile

Snowflake Openflow Limitations: 6 Production Trade-offs

#dataengineering #database #snowflake #etl
4
Comments
15 min read
From YAML validator to event-driven projects: 14 releases of Hydra ETL in six weeks
bejaouibechir profile

From YAML validator to event-driven projects: 14 releases of Hydra ETL in six weeks

#dataengineering #python #etl #opensource
1
Comments
4 min read
Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines
ayush_pangaonkar profile

Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines

#dataengineering #aws #etl #airflow
Comments
1 min read
Airbyte Pricing vs Estuary Pricing for High-Volume CDC
jaume_bogu_c05b19569765 profile

Airbyte Pricing vs Estuary Pricing for High-Volume CDC

#dataengineering #etl #cloud #database
10
Comments 1
8 min read
Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns
kaviwrites profile

Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns

#palantir #dataengineering #etl #datamigration
Comments
10 min read
Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine
saurabhr2 profile

Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine

#etl #dataengineering #sql #python
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址