We are sharing a full-time opportunity for an experienced Data Engineer with strong expertise in Python, SQL, ETL pipelines, data modelling, exploratory data analysis, and scalable data-processing workflows to support research, analytics, and AI/ML initiatives. The role focuses on transforming structured and unstructured information into reliable, production-quality datasets. The successful candidate will build scalable data pipelines, improve data quality and validation, optimise SQL and processing workflows, and collaborate with researchers, data scientists, and engineers.

Key Responsibilities

Data Pipelines & Processing

• Design, build, and maintain scalable ETL pipelines
• Collect, clean, normalise, and transform structured and unstructured data
• Automate recurring processing workflows
• Monitor pipeline performance and troubleshoot failures
• Improve efficiency, scalability, and maintainability

SQL, Databases & Data Modelling

• Write and optimise SQL queries for extraction and transformation
• Work with relational databases such as PostgreSQL and MySQL
• Design and maintain schemas and data models
• Improve query performance and data-access patterns
• Support scalable and reliable data-storage architectures

Data Quality & Analysis

• Conduct exploratory data analysis to identify patterns, anomalies, and quality issues
• Build automated validation and quality-control workflows
• Monitor accuracy, completeness, integrity, and consistency
• Investigate data issues and implement corrective actions
• Produce clear analytical summaries for technical stakeholders

Python & AI/ML Data Support

• Build processing workflows using Python, Pandas, and NumPy
• Develop reusable components for transformation and analysis
• Prepare datasets for AI and machine-learning initiatives
• Collaborate with researchers and data scientists on data requirements
• Support reliable training, evaluation, and experimentation workflows

Ideal Profile

• Strong proficiency in Python and SQL
• Hands-on experience designing and maintaining ETL pipelines
• Experience with exploratory data analysis
• Proficiency with Pandas and NumPy
• Experience with PostgreSQL, MySQL, or comparable relational databases
• Strong understanding of data modelling and database schemas
• Experience with structured and unstructured datasets
• Strong focus on data quality, integrity, and reliability
• Strong analytical and problem-solving skills
• Experience collaborating with researchers, data scientists, or engineering teams
• Familiarity with Jupyter Notebook, VS Code, PyCharm, or similar tools
• Exposure to AI/ML workflows is advantageous
• Familiarity with scikit-learn, Hugging Face Transformers, or AI APIs is beneficial

Engagement Details

• Full-time engagement
• Fully remote
• Compensation: $140,000–$180,000/year
• Work will involve Python, SQL, ETL, exploratory data analysis, database design, data modelling, validation, automation, and AI/ML dataset preparation
• Responsibilities may involve both structured and unstructured data
• Regular collaboration with researchers, data scientists, and engineering teams is expected
• Project scope, data sources, and technical requirements may evolve based on business and research needs
• Work must be completed without using confidential, proprietary, regulated, client-identifiable, restricted-access, or otherwise protected information belonging to any employer, client, research institution, data provider, or other third party

About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy Remote Skills: Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Automation, Corrective Action, Data Analysis, Data Management, Data Modeling, Data Quality, Data Science, Data Sets, Data Storage, Database Design, Database Extract Transform and Load (ETL), Database Technology, Identify Issues, Information/Data Security (InfoSec), Machine Learning, Model Validation, MySQL, Performance Analysis, Performance Management, PostgreSQL, Problem Solving Skills, Project Evaluation, Python Programming/Scripting Language, Quality Control, Quality Management, Query Optimization, Relational Databases (RDBMS), SQL (Structured Query Language), Scalable System Development, Scientific Research, Software Engineering, Storage Architecture, Structured Data, Technical Consulting, Training Data Sets, Unstructured Data, Workflow Analysis 24-Mag Apply To This Job