Are you passionate about creating ground-breaking technology for next generation of voice assistant technology (Siri) and spatial recognition that will usher the next revolution of human-computer interaction? Join the team that plays a key part in shipping groundbreaking technology for large scale systems in natural language, and artificial intelligence pertaining to Siri and Apple ecosystem that impacts day to day life of billions globally.

Join ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire billions of people!

We are looking for Software Development Engineer in Test with a strong background and experience in Machine-Learning, audio and visual technologies, Conversational and Generative AI. We are seeking an engineer to lead the high quality of AIML products and collaborate with the most innovative product development teams in the world. This team crafts and builds evaluation tools, automation frameworks, acoustic evaluation labs, and methodologies that enable product teams across Apple to develop machine-learning solutions that power amazingly intelligent user experiences. You will engage with innovative new-product teams around Apple, bringing your expertise and passion for innovation to solving technical problems for our next-generation products.

This role as Software Development Engineer in Test will own the qualification of spatial perception that is the critical part for invoking Siri and other Apple user experiences on AIML future technologies and customer facing product features by developing product evaluation, automation and test methodologies. You will be leveraging innovative AI models to build applications and testing solutions on top of Apple’s most advanced technologies. As a Software Engineer focused on product quality of ML models and features, you will be responsible for designing and implementing testing solutions, automation and build AI models for quality insights and testing frameworks. You will work closely with other cross-functional teams to align research, messaging, contribute to roadmaps and development of world class products. You will prototype and test new ideas and bring your research to life. You will be playing a pivotal role in testing, maintaining and shipping artifacts/features to make Siri and other AIML related products empowering customers lives.

The primary responsibilities associated with this position range from data insights, design and implementation of product quality measures, ability to convert research findings into product quality improvement or frameworks, and work closely with product teams before and after product/feature launch. You will write clean, maintainable and production code with appropriate documentation and tests. You will contribute to architecture decisions, design reviews and peer code reviews.

This role as a Software Development Engineer in Test will own the qualification of Siri and AIML future technologies and customer facing product features by developing automation and test methodologies. This role will be responsible for Quality Planning and Test creation, build automation to simulate and evaluate user experiences of Apple Intelligence, Siri and other ML-based products. In this role, your responsibilities include defining and leading all aspects of user impact and success metrics. Innovative solutions and strategies that allow the team to expand the coverage of the features we ultimately deliver to our customers are a must.

We provide the right balance between research and product quality to deliver Apple quality state-of-the-art experiences on various Apple products.

10 + years as Software Development Engineer.4+ years of Designing and Architecting tools and frameworks.Expertise in dealing with datasets and performing analysis for product quality insightsDemonstrated depth of knowledge and application of statistics-based evaluation methodologies or user success metricsDeep Understanding of ML-based concepts including awareness of how data is used to support ML, experimentation and analyticsExperience with analyzing user behavior, deriving patterns and designing test strategies, automation frameworksDeep understanding of Prompt Engineering and Build Prompt fine-tuningUnderstanding of generative AI and experience in using Gen AI for various applications