AWS Databricks Platform Engineer

Company: Qualcomm India Private Limited Job Area: Information Technology Group, Information Technology Group > IT Data Engineer General Summary: We are hiring a Data Platform Engineer to design, build, and operate a modern, data platform with AWS Databricks Lakehouse as a core foundation. This role is ideal for a senior engineer who excels in system design, platform innovation, and hands on execution. You will help design, implement and improve reliability of the data platform, influence architectural direction, and mentor engineers while working closely with data scientists, analysts, and application teams. This is a hands on, high impact role with strong ownership across architecture, implementation, reliability, security, and cost optimization. Key Responsibilities • Design and build scalable, distributed data platform systems • Own Databricks workspace architecture, governance, and lifecycle management • Implement infrastructure as code using Terraform/Terramate • Build and support end to end data pipelines, from ingestion to analytics and ML • Develop and maintain CI/CD pipelines for infrastructure, data pipelines, notebooks, SQL, and ML artifacts • Operate and optimize Amazon EKS clusters supporting data workloads • Define and monitor SLIs/SLOs for platform reliability and data quality • Drive innovation and continuous improvement across platform architecture and tooling • Lead incident response, on call rotations, and blameless post mortems • Implement strong security, compliance, and governance controls • Mentor engineers and influence platform standards and best practices - 12+ years of IT-related work experience in Data Platform build-out with a Bachelor's degree. - 10+ years of Platform engineering experience in building and operating AWS Databricks platforms System Design & Innovation • Proven experience in designing complex, distributed data systems end to end • Strong system design skills across cloud infrastructure, data pipelines, storage, governance, and observability • Ability to evaluate and communicate architectural trade offs (scalability, reliability, cost, security, operability) • Demonstrated innovation mindset, such as: Modernizing or simplifying legacy data platforms, Introducing new architectural patterns or platform capabilities, Improving reliability, performance, or developer experience through design Cloud & Data Platform Expertise • Building and operating large scale cloud platforms experience with DevOps, SRE, or DataOps roles • Expert level experience with AWS, including networking, IAM, security, and multi account environments • Strong hands on experience with Databricks Lakehouse Platform, including: Unity Catalog, Delta Lake, MLflow • Experience owning Databricks workspace architecture and governance Infrastructure, Automation & Reliability • Deep experience with Terraform/Terramate (or similar IaC tools) • Proven experience building CI/CD pipelines (GitHub Actions, Jenkins) • Advanced Python and Bash scripting skills • Hands on experience managing Amazon EKS clusters and Helm deployments • Experience defining and operating SLIs/SLOs for platform reliability and data quality Security & Leadership • Strong understanding of cloud security best practices • Experience supporting SOX, GDPR, or regulated environments • AWS Certified DevOps Engineer – Professional (or equivalent experience) • Ability to work independently and mentor team members • Strong communication skills to explain complex system designs to technical and non technical stakeholders • Experience with Acceldata, OpenTelemetry, or data observability tools • Experience with Fivetran Hybrid / HVR or enterprise ingestion tools • Experience working with Hashicorp vault or similar secret management tools • Policy as code experience using OPA • Experience working with static Code analysis tool like Sonar • Experience with data lineage or metadata management tools • Databricks serverless compute optimization and cost management • Experience driving platform strategy across multiple teams distributed globally Minimum Qualifications: • 5+ years of IT-related work experience with a Bachelor's degree in Computer Engineering, Computer Science, Information Systems or a related field. OR 7+ years of IT-related work experience without a Bachelor’s degree. • 3+ years of work experience with programming (e.g., Java, Python). • 3+ years of work experience with SQL or NoSQL Databases. • 3+ years of work experience with Data Structures and algorithms. Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications. If you would like more information about this role, please contact Qualcomm Careers.