Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is seeking a Data Engineer to lead large-scale cloud modernization and Redshift-to-Databricks migration initiatives. The role focuses on target-state architecture, data pipeline implementation, platform governance, technical leadership, and end-to-end migration execution.

Responsibilities

• 10+ years of Data Engineering experience with 7+ years of hands-on Databricks expertise delivering large-scale cloud modernization programs
• Strong expertise in Databricks, PySpark, Python, SQL, AWS, Delta Lake, Unity Catalog, and Lakehouse Architecture
• Lead Redshift-to-Databricks migration strategy, including discovery, assessment, dependency analysis, and migration planning
• Design and govern target-state architecture, including Medallion layers, data modeling, security, observability, and DevSecOps standards
• Drive implementation of ETL/ELT pipelines, Lakeflow Jobs, DLT pipelines, Auto Loader, CDC, and Data Quality frameworks
• Lead onshore/offshore teams, provide technical guidance, conduct design reviews, and ensure delivery excellence across all workstreams
• Collaborate with business, architecture, security, infrastructure, governance, and application teams to manage dependencies, risks, and solution decisions
• Own migration execution through testing, validation, cutover, hypercare, governance, and stakeholder communication, ensuring a secure and compliant Databricks platform

Skills

• 10+ years of Data Engineering experience with 7+ years of hands-on Databricks expertise delivering large-scale cloud modernization programs
• Strong expertise in Databricks, PySpark, Python, SQL, AWS, Delta Lake, Unity Catalog, and Lakehouse Architecture

Company Overview

Company H1B Sponsorship