Does the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get things done, across the globe? Join the ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire millions of people!

We are seeking an engineer to lead the quality of AIML products on new platforms and collaborate with the most innovative product development teams in the world. This team crafts and builds evaluation tools, automation frameworks and methodologies that enable product teams across Apple to develop machine-learning solutions that power amazingly intelligent user experiences. You will engage with innovative new-product teams around Apple, bringing your expertise and passion for innovation to solving technical problems for our next-generation products.

This role as a Software Development Engineer will own the qualification of Siri and AIML future technologies and customer facing product features by developing automation and test methodologies. This role will be responsible for test framework, tooling, and test automation development at scale to simulate and evaluate user experiences of Siri and ML-based products. In this role, your responsibilities include defining and leading all aspects of user impact and success metrics. Innovative solutions and strategies that allow the team to expand the coverage of the features we ultimately deliver to our customers are a must.

10 + years as Software Development Engineer with demonstrated technical leadership experience.4+ years of Designing and Architecting tools and frameworks.Demonstrated depth of knowledge and application of statistics-based evaluation methodologies or user success metricsDeep Understanding of ML-based concepts including awareness of how data is used to support ML, experimentation and analyticsUnderstanding of generative AI and experience in using Gen AI for various applications