All roles

Open role

[Remote] Principal Architect, Performance Analysis and Modeling

Remote · Malaysia Full-time

Note: The job is a remote job and is open to candidates in USA. d-Matrix develops software and hardware innovations for generative AI applications. The Principal Architect will analyze emerging machine learning workloads, model performance on current and future inference accelerator hardware, and propose hardware and software features in collaboration with product, hardware design, compiler, inference server, and kernels teams.

Responsibilities

  • As a member of the architecture team, you will analyze the latest ML workloads (multi-modal LLMs, CoT reasoning models, video/audio generation)
  • You will contribute hardware and software features that power the next generation of inference accelerators in datacenters
  • This role requires keeping up with the latest research in ML architecture and algorithms and collaborating with different partner teams, including Product, Hardware Design, Compiler, Inference Server, and Kernels
  • Your day-to-day work will include (1) analyzing the properties of emerging machine learning algorithms and workloads and identifying functional, performance implications (2) Creating analytical models to project performance on current and future generations of d-matrix hardware (3) proposing new HW/SW features to enable or accelerate these algorithms

Skills

  • BSEE with 10+ years of industry experience
  • Solid grasp through academic or industry experience in multiple of the relevant areas, computer architecture, hardware-software codesign, performance modeling, ML fundamentals (particularly DNNs)
  • Programming fluency in C/C++ or Python
  • Experience with developing analytical performance models, architecture simulators for performance analysis
  • Self-motivated team player with strong sense of collaboration and initiative
  • MSEE preferred with 8+ years of industry experience
  • Research background with publication record in top-tier architecture, or machine learning venues is a huge plus (such as ISCA, MICRO, ASPLOS, HPCA, DAC, MLSys etc.)

Benefits

  • Offers Equity
  • Offers Bonus
  • Hybrid work arrangement: working onsite at the Santa Clara, CA headquarters 3 days per week
  • Remote work may be considered in the United States

Company Overview

  • D-Matrix is a platform that enables data centers to handle large-scale generative AI inference with high throughput and low latency. It was founded in 2019, and is headquartered in Santa Clara, California, USA, with a workforce of 201-500 employees. Its website is https://www.d-matrix.ai.
  • Company H1B Sponsorship

  • d-Matrix has a track record of offering H1B sponsorships, with 20 in 2025, 15 in 2024, 8 in 2023, 7 in 2022. Please note that this does not guarantee sponsorship for this specific role.
  • More open positions