Note: The job is a remote job and is open to candidates in USA. ECS is hiring a Senior Databricks Consultant to help customers design, optimize, and fine-tune Databricks environments for data analytics, machine learning, and AI-driven insights. The role focuses on scalable data pipelines, model training, advanced analytics, and delivering improvements across ECS professional services and managed cybersecurity programs.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks
• Optimize workflows and clusters for performance and cost efficiency
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP)
• Implement data governance, security, and compliance standards
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights
• Troubleshoot issues and drive continuous improvement in data infrastructure

Skills

• Proven experience working with Databricks in production environments
• Strong proficiency in Python and/or SQL for data engineering
• Experience with Apache Spark for distributed data processing
• Knowledge of data lakehouse architecture and best practices
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage)
• Hands-on experience building and managing ETL/ELT pipelines
• Strong understanding of data modeling, data quality, and performance tuning
• Familiarity with CI/CD pipelines and version control (Git)
• Must be a US Citizen per contract
• Will consider experience in lieu of a degree
• Preferably in Computer Science, Information Security, or a related field

Company Overview