Senior Performance Engineer

NVIDIA is seeking a highly skilled Senior Performance Engineer to join our Performance and R&D organizations. In this role, you will help build and evolve systems that support performance analysis, telemetry, and optimization for large-scale GPU- and CPU-based clusters used in AI and high-performance computing environments. You will work closely with hardware, networking, firmware, and software teams to collect, analyze, and interpret performance data from live systems. This is a fast-paced R&D environment where system behavior and requirements evolve rapidly, requiring adaptable engineering solutions and strong analytical thinking. What you’ll be doing: • Profile, benchmark, and analyze AI and HPC workloads on GPU and CPU clusters • Explore performance characteristics of high-performance networking and collective communications (e.g., NCCL, RDMA, MPI, RoCE) • Identify performance bottlenecks across networking, compute, memory, and system architecture • Develop and enhance performance analysis, benchmarking, and diagnostic tools • Define performance test plans and establish expectations for new technologies and platforms • Collaborate across hardware, firmware, networking, systems, and software teams to provide actionable performance insights • Support telemetry collection and data refinement efforts to enable accurate performance analysis • Maintain high standards for data quality, reproducibility, and traceability of performance results What we need to see: • B.Sc. or M.Sc. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience • 5+ years of experience in performance analysis, systems engineering, or HPC/AI infrastructure • Demonstrated expertise in performance analysis skills and methodologies • Hands-on experience with high-performance networking (RDMA, MPI, NCCL, congestion control) • Strong understanding of system performance metrics (latency, throughput, resource utilization) • Exposure to hardware, firmware, or embedded telemetry environments • Strong analytical, problem-solving, and communication skills • Ability to work effectively in cross-functional, fast-paced R&D teams Ways to stand out from the crowd: • Knowledge of CUDA, NCCL internals, and congestion control algorithms • Deep system-level understanding of CPU architectures, GPUs, HCAs, memory, and PCIe • Experience with NVIDIA GPUs, CUDA, and deep learning frameworks such as PyTorch or TensorFlow • Experience with cloud platforms • Proficiency in Python; experience with Bash and C/C++ is a plus as well as a strong experience working in Linux environments