At Apple, the AIML the on-device Machine Learning group is responsible for accelerating the adoption of machine learning to create extraordinary experiences for our users. We are looking for a tenured software engineer to help implement innovative (LLMs, Diffusion, GenAI, etc) machine learning models against our powerful machine learning hardware. This is a unique opportunity to work on powerful new technologies and contribute to Apple’s ecosystem, with a commitment to privacy and user experience impacting millions of users worldwide. This role requires a strong engineering sense of building the right solution for a given problem, defining the right APIs, attention to performance, and work with both 1st and 3rd party clients to determine how to best run their models on Apple silicon. If all of this sounds exciting, come join us and be part of the team that is helping Machine Learning developers innovate and ship enriching experiences on Apple devices!

As a member of this team, the successful candidate will build features for our on-device inference stack to support new and existing customers with ever evolving machine learning models. This person will interact with first and third part clients to figure out their functional and performance requirements and work collaboratively with backend teams to map those requirements to functional execution. They will perform analysis when needed to squeeze every ounce of memory for flop from the underlying hardware, and they will drive structural improvements that can be made in the on device machine learning stack.

5+ years proven programming skills using standard ML tools such as C/C++, CUDA/Metal, PyTorch, TensorflowExperience building APIs and/or core components of ML frameworks and strong attention to detailCapacity to iterate on ideas, work with a variety of partners from all parts of the stack — from apps to Compilation, HW Arch, and Power/Performance analysisExcellent problem-solving (e.g. via building forward-looking prototype systems), critical thinking, strong communication, and collaboration skills.