We are sharing a specialised opportunity for advanced STEM researchers and graduate-level experts to contribute to large language model evaluation and training through challenging scientific problem design, rigorous reasoning, and high-quality solution development.

Key Responsibilities

Advanced STEM Problem Development - Design challenging problems across advanced STEM domains - Create tasks that probe limitations in model reasoning - Develop problems requiring abstraction and multi-step analysis - Incorporate symbolic or quantitative reasoning where appropriate - Maintain appropriate difficulty across undergraduate through doctoral-level topics Problem Solving & Solution Development - Solve complex STEM problems accurately and efficiently - Produce clear step-by-step solutions - Explain assumptions and intermediate reasoning explicitly - Structure solutions for ease of evaluation and review - Apply rigorous analytical methods throughout problem-solving workflows Model Evaluation & Error Analysis - Evaluate how large language models respond to advanced STEM tasks - Identify recurring weaknesses in reasoning and problem decomposition - Analyse errors involving abstraction, symbolic manipulation, or multi-step logic - Distinguish conceptual mistakes from calculation or interpretation errors - Provide structured observations to support model improvement Benchmark & Evaluation Design - Help define new STEM evaluation benchmarks - Align problem design with specific research objectives - Contribute tasks spanning different levels of technical difficulty - Refine evaluation criteria based on observed model behaviour - Support consistent assessment across complex reasoning scenarios Research Collaboration & Technical Communication - Collaborate remotely with AI researchers and technical contributors - Explain STEM concepts in clear and accessible language - Provide constructive feedback and detailed annotations - Communicate analytical findings in a structured format - Work independently while maintaining reliable project delivery Ideal Profile - Currently pursuing or holding a Master's, Ph.D., or postdoctoral position in a STEM field - Background in Physics, Applied Physics, Mathematics, Biology, Chemistry, or a related discipline - Strong analytical and research capabilities - Ability to solve complex quantitative and conceptual problems - Strong foundation in advanced STEM reasoning - Ability to break difficult concepts into clear explanations - Comfortable with abstraction and multi-step reasoning - Strong logical and structured problem-solving skills - Ability to provide detailed annotations and constructive feedback - Creative and lateral thinking abilities - Excellent written English communication - Strong remote collaboration skills - Self-motivated and able to work independently - Reliable desktop or laptop setup with a stable internet connection - Ability to explain technical concepts using simple language, visuals, and scientific reasoning where appropriate Engagement Details - Contractor assignment / freelance engagement - Fully remote - Source materials describe the opportunity as full-time, while the formal engagement type is contractor/freelancer - Work will involve advanced STEM problem design, solution development, model evaluation, and benchmark creation - Projects may span physics, mathematics, biology, chemistry, and related scientific disciplines - Physics-focused evaluation may include topics ranging from early undergraduate through Ph.D. level - Collaboration will involve research teams working on advanced language-model evaluation - Contract extension may be available depending on performance and project requirements - No medical or paid-leave benefits are included under the stated contractor arrangement - Work must be completed without using confidential, proprietary, unpublished research, restricted datasets, or otherwise protected information belonging to any employer, laboratory, university, research group, client, or other third party About the Platform - This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. - By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy