All projects
Data Engineer (Solo) · 2025
Source-availableETL & Data Warehousing Pipeline
Python scripts that generate, extract and transform data for a warehouse, with a test suite covering each stage.
PythonJupyter NotebookETL
Source-available
ETL & Data Warehousing Pipeline
PythonJupyter NotebookETL
Problem
A warehouse is only as good as the pipeline that loads it, and a pipeline without tests breaks quietly.
Approach
Wrote separate generate, extract and transform stages, with tests for extraction and transformation and a single script that runs the whole suite.
Results
Source on GitHub.
More like this