Note: The job is a remote job and is open to candidates in USA. SoTalent is seeking an experienced Data Engineer to join a technology team focused on modern data platforms. The role designs, develops, and optimizes scalable data pipelines, data lakes, warehouses, and cloud-based infrastructure supporting analytics, artificial intelligence, and business intelligence initiatives.

Responsibilities

• Design, develop, and maintain scalable, high-performance data pipelines and architectures to support analytics and reporting needs
• Build and optimize ETL/ELT processes for ingesting, transforming, and integrating data from multiple sources
• Develop and manage data lake and data warehouse solutions to ensure reliable and efficient data access
• Implement data processing workflows using modern big data technologies and distributed computing frameworks
• Collaborate with business, analytics, and engineering teams to understand requirements and deliver robust data solutions
• Create and optimize data models that support reporting, analytics, and machine learning use cases
• Write complex SQL queries and develop scalable data transformation logic to ensure data accuracy and performance
• Manage cloud-based data environments, processing clusters, and automated workflow executions
• Support the development and deployment of machine learning and AI-driven solutions through reliable data infrastructure
• Ensure compliance with data governance, security, and quality standards across all data assets
• Troubleshoot production issues, enhance existing systems, and drive continuous improvements in data platform performance
• Participate in code reviews, technical discussions, and knowledge-sharing initiatives while supporting and mentoring team members

Skills

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field
• Strong experience in data engineering, cloud-based data platforms, and large-scale data processing environments
• Proficiency in programming languages such as Python, Scala, or similar technologies
• Hands-on experience with Apache Spark, distributed data processing, and big data frameworks
• Strong knowledge of SQL, data modeling, and database design principles
• Experience designing and implementing scalable ETL/ELT pipelines
• Familiarity with data lakes, cloud data warehouses, and modern data architecture concepts
• Understanding of data governance, data quality frameworks, and security best practices
• Experience with version control systems, CI/CD pipelines, and software development best practices
• Proven ability to work effectively in agile and cross-functional environments
• Strong analytical, problem-solving, and communication skills
• Experience working with cloud platforms and modern data engineering ecosystems
• Knowledge of workflow orchestration, automation tools, and DevOps practices
• Exposure to machine learning, artificial intelligence, or advanced analytics initiatives
• Experience building reusable, modular, and maintainable data engineering components
• Familiarity with data validation frameworks and monitoring solutions
• Experience optimizing large-scale data processing and streaming workloads

Benefits

• Opportunity to work on innovative data and analytics initiatives with modern technologies.
• Exposure to large-scale cloud and big data environments.
• Collaborative culture that encourages learning, innovation, and technical growth.
• Comprehensive benefits package.
• Flexible work arrangements that support work-life balance.

Company Overview