Lead Data Engineer - contract/remote

Our client is a global leader in technology consutling.  They are seeking a visionary Lead Data Engineer to spearhead the Data Quality Strategy & Data QA for a SQL to AWS migration that is not going well. You will leverage your Data Engineering and QA Background to do strong root cause analysis to diagnose and fix pipeline failures. 

---

Responsibilities

• Develop the Data Quality Strategy and Data QA for the SQL to AWS migration
• Scalabilty & High Volume Data - strong permant coding that can handle millions of records without latency
• Database Optimization - optimize data retrieval.  Reduce search complexity from linear scans to logarithmic lookups.  
• Physcially structure data to ensure the system remains managemable as it grows. 
   

---

 Requirements

• Demonstrated strength in Data Quality Strategy 
• Exceptional communication skills 
• Demonstrated strenght in Python, Pytest, SQL, Airlfow, dbt, AWS, Redshift & S3 
• Strong root cause analysis to diagnose and fix data pipeline failures