Note: The job is a remote job and is open to candidates in USA. Programming.com is seeking an experienced infrastructure leader to manage and scale large-scale GPU and AI data center operations. The role oversees GPU clusters, infrastructure reliability, capacity planning, incident management, and 24/7 technical operations teams.

Responsibilities

• Lead end-to-end operations of large-scale GPU clusters, AI infrastructure, and data center IT environments
• Manage GPU server deployment, monitoring, troubleshooting, maintenance, and hardware lifecycle
• Ensure high availability, performance, and reliability of AI training and inference infrastructure
• Oversee multi-site data center operations, infrastructure expansion, and capacity planning
• Lead major incident management, RCA, operational governance, and SLA/SLO performance
• Build and manage 24/7 technical operations teams, engineering managers, and site leaders
• Drive automation, GPU fleet monitoring, operational efficiency, and infrastructure scaling
• Collaborate with engineering teams, hardware vendors, and executive leadership

Skills

• 15+ years in Infrastructure Engineering, Data Center Operations, GPU Cloud, or HPC environments
• 7+ years of leadership experience managing large-scale production infrastructure operations
• Direct experience managing production NVIDIA GPU clusters is mandatory
• Strong knowledge of NVIDIA H100/H200/B200/GB200, DGX/HGX, NVLink, and NVSwitch or comparable GPU infrastructure
• Experience with InfiniBand, RDMA, high-speed networking, Linux, and GPU hardware troubleshooting
• Familiarity with Slurm, Kubernetes, NVIDIA DCGM, Prometheus, and Grafana
• Experience managing multi-site operations, vendors, infrastructure deployments, and technical teams
• Strong leadership, operational strategy, and executive stakeholder management capabilities
• Experience managing thousands of GPUs, hyperscale AI infrastructure, NVIDIA DGX SuperPOD, or GPU cloud platforms

Company Overview