Note: The job is a remote job and is open to candidates in USA. SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. They are seeking a Technical Consultant to lead consulting engagements and provide actionable insights related to AI infrastructure and benchmarking.

Responsibilities

• Lead ClusterMAX™ consulting engagements, including technical due diligence projects related to neoclouds, AI accelerators, AI infrastructure, AI labs, and adjacent ecosystems
• Translate ClusterMAX™ benchmarking and testing insights into actionable recommendations and investment decisions for clients
• Contribute to the development of next-generation benchmarking methodologies, TCO analysis frameworks, and future ClusterMAX™ research initiatives
• Collaborate with executives, engineers, and technical teams across major neocloud providers, including Amazon Web Services, Microsoft Azure, Google Cloud, Oracle, CoreWeave, Nebius, Crusoe, Lambda, and Together
• Build and maintain relationships with AI accelerator manufacturers, OEMs, and ecosystem partners, including NVIDIA, AMD, Intel, Google, Amazon, Cerebras, Groq, Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Cisco
• Strengthen relationships with AI labs, investors, startups, and technical communities to better understand industry requirements and operational challenges
• Author detailed technical research reports evaluating architecture design, benchmark performance, reliability, scalability, and operational usability of neocloud and AI infrastructure providers
• Stay informed on emerging trends and technologies through participation in major industry conferences such as NeurIPS, MLSys, NVIDIA GTC, OCP, SC, and Hot Chips

Skills

• Strong understanding of ML frameworks such as PyTorch and JAX
• Familiarity with GPU and TPU cluster environments running orchestration platforms such as Kubernetes or Slurm
• Understanding of distributed storage technologies including Weka, VAST, Lustre, and S3-based storage systems
• Knowledge of high-performance networking technologies such as InfiniBand and RoCEv2
• Understanding of ML systems benchmarking and performance testing tools, including GEMMs, nccl-tests, vLLM, sglang, fio, TorchTitan, Megatron, and related frameworks
• Ability to work proactively and independently within a globally distributed team environment
• Strong analytical, technical communication, and problem-solving capabilities
• Experience working at a hyperscaler, neocloud provider, server OEM, AI accelerator company, or large-scale AI infrastructure environment

Benefits

• Work Setting: Onsite/Remote
• Work Hours: Office Hours

Company Overview