· software
Migração de dados entre serviços: estratégias, riscos e trade-offs
Contexto Recentemente precisei migrar dezenas de milhares de registros de auditoria entre dois serviços durante uma task! Era minha primeira vez fazendo uma mig...
-
- · software
Stop Re-running Everything: A Local Incremental Pipeline in DuckDB
Incremental Models + Cached DAG Runs DuckDB‑only I love local‑first data work… until I catch myself doing the same thing for the 12ᵗʰ time: > “I changed one mo...
- · software
Building a Government Tender Intelligence System with Python: Lessons from the Real World
Government Tender Data: A Developer’s Guide Government tendershttps://bidsathi.com/ are one of the largest structured data sources available in India. Every da...
- · software
From 3+ Days to 3.8 Hours: Scaling a .NET CSV Importer for SQL Server
markdown !Татьяна Кузнецоваhttps://media2.dev.to/dynamic/image/width=50,height=50,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.c...
- · software
When Codegen Suggests Deprecated Pandas APIs — a Cautionary Tale
How the deprecated API slipped into production I was using a code‑generation model to scaffold a small ETL that normalized CSV files into a canonical DataFrame...
- · software
How to Extract Data from Excel using Power BI
What is data? Data is a collection of raw, unorganized facts, figures, or symbols. Think of data as the raw ingredients in a kitchen flour, eggs, sugar. On the...
- · software
Data-Architect-Master-Professional-Workbook
Overview I built a modular, audit‑ready data engineering project and wanted to share it with the community. Features - Clean, production‑style Python - SQL pat...
- · software
Choosing an ETL Tool for Salesforce: The Practical Options
The article was initially published on the Skyvia bloghttps://blog.skyvia.com/best-etl-tools-for-salesforce/. Salesforce is one of the most widely used CRMs out...
- · software
Text Columns to CSV Converter: Simplifying Data Transformation for Modern Workflows
In today’s data‑driven world, information often comes from multiple sources—documents, emails, logs, or plain text files. While this data is valuable, it’s rare...
- · software
Building a Reliable Environmental Data Accumulation Pipeline with Python
!Cover image for Building a Reliable Environmental Data Accumulation Pipeline with Pythonhttps://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gra...
- · software
Day 16: Delta Lake Explained - How Spark Finally Became Reliable for Production ETL
Welcome to Day 16 of the Spark Mastery Series If you remember only one thing today, remember this: Delta Lake = ACID transactions for your Data Lake Why Tradit...
- · software
Starting Dusty — A Tiny DSL for ETL & Research Data Cleaning
!Cover image for Starting Dusty — A Tiny DSL for ETL & Research Data Cleaninghttps://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,fo...