Lead Data Engineer Now
Sep 2025 — Present- Migrated legacy mainframe/SAS insurance portfolio processing onto a modern Azure Databricks lakehouse.
- Designed a multi-layer architecture with full traceability from source system to business-ready tables.
- Built a data quality framework with automated validation, anomaly detection and quarantine handling.
- Orchestrated end-to-end pipelines with PySpark notebooks, DLT and Databricks Lakeflow.
- Set up automated testing, continuous integration and infrastructure-as-code deployment across dev and prod.
- Governed lineage and access through Unity Catalog; monitored runs, investigated incidents, added alerting.
- Led data engineers on pipeline design, development standards and the platform roadmap.