Note: The job is a remote job and is open to candidates in USA. Serko is hiring a Principal Engineer to own the technical vision for its AI platform and operations. The role focuses on building reliable, self-service ML infrastructure and enabling teams to deploy, monitor, and scale AI models efficiently and safely.

Responsibilities

• Define the long-term technical roadmap for our AI platform, covering everything from model serving and feature stores to experiment tracking and CI/CD for ML
• Establish engineering benchmarks for deployment, versioning, A/B testing, and automated rollbacks
• Lead strategies for GPU/compute efficiency and cost optimization while managing the complexities of LLM inference (quantization, batching, and latency) at scale
• Design sophisticated monitoring and alerting systems specifically tailored for AI workloads in production
• Drive platform stability and partner with application teams to ensure our infrastructure meets evolving product needs
• Mentor Senior engineers, lead architecture reviews, and evaluate the next generation of cloud services and ML frameworks

Skills

• 12+ years of engineering experience, with at least 4 years at a Principal or Distinguished level
• Expert-level knowledge of model serving (e.g., Triton, vLLM, Ray Serve) and deep experience with Kubernetes and cloud ecosystems (AWS/GCP/Azure)
• Proven experience with tools like MLflow, Weights & Biases, or Kubeflow
• High proficiency in Python and a "systems-thinking" approach to Docker, Helm, and containerization
• Hands-on experience operating LLM inference at scale and a deep understanding of the trade-offs between throughput and latency
• A track record of building internal platforms that treat other engineers as the primary customer, drastically improving engineering velocity

Benefits

• Medical Benefits
• Discretionary incentive plan based on individual and company performance
• Access to a learning & development platform
• Opportunity to own your career pathways
• Flexible work policy
• Remote role; can be based in either Washington or California State

Company Overview