Voice AI Systems Test Engineer-Senior engineer

Company: Qualcomm India Private Limited Job Area: Engineering Group, Engineering Group > Systems Test Engineering General Summary: Job Overview Join Qualcomm’s Multimedia Systems Group as a Voice AI Systems Test Engineer, responsible for end-to-end validation of Voice AI features, Model evaluation, and quality KPIs sign-off for on-device Voice AI features for next-generation multimedia platforms. In this role, you will focus on validation, benchmarking, data-driven evaluation, competitive analysis of Always-On AI and Agentic AI voice use cases, which includes ASR, TTS, multilingual translation, and intelligent voice assistants. Your work will ensure that Qualcomm’s Voice AI solutions meet and exceed market expectations by matching or outperforming reference implementations and competing solutions across performance, quality, latency, power, and robustness. Responsibilities Voice AI Validation & System Testing · Perform system-level validation and testing of Voice AI features, with emphasis on Always-On AI and Agentic AI use cases. · Design, execute, and maintain comprehensive test plans for Voice AI pipelines including ASR, TTS, NLP, Translation, Summarization, and Language Models. · Validate functional correctness, latency, power, memory, and long-run stability of Voice AI systems on embedded hardware (NPU, GPU, CPU). · Maintain Performance dashboard o Detect regressions o Identify quality gaps o Predict performance trends across releases Performance, Quality & Competitive Benchmarking · Compare performance and perceptual quality of Qualcomm Voice AI solutions against: o Internal reference implementations o Customer baselines o Competing open-source solutions in the market · Conduct objective and subjective quality analysis for Voice AI features (accuracy, intelligibility, naturalness, latency perception, robustness). · Drive validation with the goal to meet and beat market expectations, using measurable KPIs and user-experience metrics. · Perform competitive benchmarking of open-source and proprietary models from a system-level quality and performance standpoint. Hardware Acceleration & System Integration Validation · Validate HW AI acceleration paths, ensuring correct and efficient offload across NPU, GPU, CPU, and DSP. · Evaluate end-to-end voice AI pipelines, which includes low power modes, and realtime inference behavior in batch mode and streaming mode. · Verify correct interaction across application, framework, DSP, and hardware layers. Automation, Debug & Cross-Team Collaboration · Develop and maintain automated test suites, regression frameworks, and evaluation pipelines for Voice AI and Agentic AI workflows. · Analyze logs, traces, metrics, and dumps to perform root-cause analysis of functional, performance, or quality issues. · Collaborate closely with R&D, Systems, Platform, Product, and Customer teams to drive fixes, improvements, and release readiness. · Document test methodologies, KPIs, validation results, and competitive insights for internal and external stakeholders. Requirements · Strong programming and scripting skills in C/C++ and Python, with focus on test automation, data analysis, and evaluation tooling. · Experience in system-level testing and validation of ML or AI workloads on embedded platforms. · Solid understanding of Voice AI domains: ASR, TTS, NLP, multilingual translation, and voice assistants. · Hands-on experience validating ML inference performance and quality on NPU/GPU/CPU. · Working knowledge of deep learning frameworks such as PyTorch, TensorFlow, ONNX from a testing and inference evaluation perspective. · Understanding of ML architectures (Transformers, LSTM, GRU, diffusion models) for validation, benchmarking, and analysis. · Experience validating model quantization, compression, and hardware acceleration techniques. · Strong debugging skills for embedded systems, DSP pipelines, and AI accelerators. · Experience with AI-assisted test data analysis, model-based evaluation, and KPI-driven benchmarking is a strong plus. · Excellent communication and collaboration skills to work across global, cross-disciplinary teams. Behavioral & Professional Expectations · Strong quality and customer-experience mindset with attention to detail. · Self-driven engineer capable of handling complex system-level validation challenges. · Ability to translate test data and metrics into actionable insights. · Excellent verbal and written communication for clear reporting and cross-team alignment. · Team player who collaborates effectively with R&D, platform, and product organizations. · Commitment to engineering excellence, continuous learning, and innovation. · Actively supports diversity and inclusion within the team and company. Educational Qualification · Bachelor’s / Master’s / in Engineering, Electronics & Communication, Computer Science, or related fields. · 2+ years of experience in Voice AI testing, Audio/AI system validation, ML inference evaluation, or related domains. Minimum Qualifications: • Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Systems Test Engineering or related work experience. OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 1+ year of Systems Test Engineering or related work experience. OR PhD in Engineering, Information Systems, Computer Science, or related field. Preferred Qualifications: • 4+ years of Systems Test Engineering or related work experience. Principal Duties and Responsibilities: • Conducts log analyses to identify where an issue has occurred and makes recommendations for how to address the issue. • Understands basic features of the system. • Collects information (e.g., logs, requirements) and identifies basic patterns/trends related to systems testing. • Manages individual project priorities, deadlines, and deliverables with minimal supervision. • Determines which work tasks are most important for self and junior engineers, avoids distractions, and completes work in a timely manner. • Communicates detailed and regular feedback about identified feature issues to software and systems teams. • Collaborates with individuals inside own team and with other teams to complete project work. • Resolves straightforward technical issues and escalates to technical leads as necessary. • Adapts to significant changes and setbacks in order to manage pressure and meet deadlines. • Gathers, integrates, and interprets information from a variety of sources in order to troubleshoot issues and find solutions. • Detects bugs in the "system under test" and resolves issues using more advanced debugging approaches. • Conducts more advanced field or lab tests as directed by tech leads. • Seeks opinions of others within own team about ways in which a problem can be addressed differently. Level of Responsibility: • Working under some supervision. • Making decisions that are moderate in impact; errors may have relatively minor financial impact or effect on projects, operations, or customer relationships; errors may require involvement beyond immediate work group to correct. • Using verbal and written communication skills to convey information that may be somewhat complex to others who may have limited knowledge of the subject in question. May require basic negotiation and influence, cooperation, tact, and diplomacy, etc. • Having a moderate amount of influence over key organizational decisions (e.g., is consulted by senior leadership to provide input on key decisions). • Completing tasks with multiple steps that can be performed in various orders; some planning and prioritization must occur to complete the tasks effectively; mistakes may result in some rework. • Exercising creativity to draft original documents, imagery, or work products within established guidelines. • Using deductive and inductive problem solving; multiple approaches may be taken/necessary to solve the problem; often information is missing or incomplete; intermediate data analysis/interpretation skills may be required. • May be solicited during strategic planning period. The responsibilities of this role do not include: • Financial accountability (e.g., does not involve budgeting responsibility). Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications. If you would like more information about this role, please contact Qualcomm Careers.