Note: The job is a remote job and is open to candidates in USA. Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate reliable, high-performance inference platforms for large machine learning models in production. The role focuses on systems engineering for AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability.

Responsibilities

• We are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production
• The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads

Skills

• Bachelor's or Master's degree in Computer Science or a related field
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering
• Strong proficiency in Python and a systems language such as Go, Rust, or C++
• Deep experience operating high-throughput, low-latency services in production
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms
• Experience with observability stacks including metrics, tracing, and structured logging
• Solid grounding in performance engineering and capacity planning
• Strong communication and incident response skills
• U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position
• Open-source contributions to model serving infrastructure
• Experience with multi-region or globally distributed AI serving
• Familiarity with model quantization, distillation, and compression techniques
• Exposure to FinOps for AI workloads and cost-efficient serving design
• Experience supporting external-facing AI APIs at scale

Benefits

• 100% Remote (U.S.)
• Tremendous career growth potential

Company Overview