Note: The job is a remote job and is open to candidates in USA. OpenTrain AI engages part-time independent contractors to create and evaluate data engineering tasks for AI systems. The role involves developing expert solutions and explaining shortcomings in AI-generated work involving data pipelines, processing, databases, and data quality.

Responsibilities

• Create realistic data engineering tasks involving large-scale pipelines and data integration
• Review AI-generated solutions for Python processing and distributed data systems
• Write the expert solution for database optimization and data warehousing
• Explain where and why the AI falls short on reliability and data quality

Skills

• Hands-on experience with large-scale data pipelines, including their development and upkeep
• Advanced proficiency in Python for automating and integrating data processing
• Professional fluency in English, plus strong knowledge of relational and NoSQL databases and frameworks for distributed processing, including Hadoop, Spark or Flink

Benefits

• 100% remote; fully remote, United States
• Fully flexible schedule, with no fixed shifts
• Work directly with frontier AI tools and see how they are built, tested and improved
• Training on the tools

Company Overview