AI Compiler & Kernel Engineer

Company: Qualcomm China Job Area: Engineering Group, Engineering Group > Software Engineering General Summary: Qualcomm Cloud AI is seeking an experienced AI Compiler & Kernel Engineer to develop and optimize high-performance AI operators for large-scale cloud inference workloads. You will work across model, compiler, runtime, and hardware layers to maximize inference performance while minimizing memory footprint and resource utilization on Qualcomm Cloud AI platforms. Key Responsibilities • Develop and optimize AI kernels and operators for Qualcomm Cloud AI platforms. • Enable and optimize LLM, MoE, and multimodal models for large-scale cloud inference. • Drive accuracy, performance and efficiency optimizations across the software stack. • Improve model memory footprint and ROM / RAM efficiency through kernel, graph, and compiler optimizations. • Collaborate with performance and modeling teams to deliver best-in-class inference efficiency. • Analyze and resolve performance bottlenecks using profiling, benchmarking, and modeling methodologies. Required Qualifications • Master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Electrical Engineering, or related fields. • 5+ years of experience in Cloud AI inference, kernel/operator development, or AI compiler technologies. • Good verbal and written English communication skills for effective collaboration across global teams. • Proficiency in C++, Python, and Linux development environments. • Deep understanding of Transformer architectures, such as LLMs, MoE, and modern foundation models. • Strong experience with compiler technologies such as MLIR, Triton, TVM, or similar frameworks, including graph transformation, operator lowering, scheduling, operator fusion, kernel auto-tuning, code generation and memory scheduling. • Strong experience with parallel computing architectures and performance optimization techniques, including vectorization, tiling, memory hierarchy optimization, and workload scheduling. • Strong experience with graph optimization, model accuracy validation, performance optimization, and memory optimization. Preferred Qualifications • Experience optimizing transformer-related operators such as Attention, FlashAttention, KV Cache, Embedding, GEMM, Softmax, and MoE routing is highly desirable. • Hands-on experience developing custom operators and high-performance kernels, either manually or through compiler frameworks such as MLIR or Triton with AI accelerator platforms, such as GPUs, NPUs, TPUs, or custom AI hardware. Minimum Qualifications: • Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience. OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 1+ year of Software Engineering or related work experience. OR PhD in Engineering, Information Systems, Computer Science, or related field. • 2+ years of academic or work experience with Programming Language such as C, C++, Java, Python, etc. Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications. If you would like more information about this role, please contact Qualcomm Careers.