AR/VR Software Performance Engineer

The Vision Product Group is working on exciting new technologies. We are looking for a driven and dedicated performance engineer. This team is building the core foundational platform for some of Apple's most advanced technologies in spatial computing. As part of our creative organization, you will have a uniquely rewarding opportunity to craft future products that will delight and inspire millions of people every day.

Description

As an engineer in this role you will help with ANE efficiency as well as improving overall visionOS responsiveness. You will work closely with Computer Vision and Foundation Model teams to diagnose performance bottlenecks and develop innovative solutions to optimize compute and memory footprint. Your responsibilities will include:

Analyze, benchmark and identify performance bottlenecks for ML/Foundation models in Vision Pro

Develop in-house performance solutions (such as analysis tools) to optimize inference stack \& identify performance wins.

Conduct deep-dive analysis to identify \& reduce bottlenecks and measure inference improvements in terms of memory, compute and latency.

Partner with feature and product teams to consult on algorithm and SW architectural design decisions to achieve visionOS performance goals

Optimize SW and HW via tunable parameters \& integrate research findings into product implementation","responsibilities":"Designing and implementing computer vision and machine learning algorithm optimizations; CPU C\+\+ implementations and python bridge to TensorFlow/Pytorch;

Identify performance bottlenecks in software C\+\+ code using advanced CPU profiling technologies and in ML networks.

Analyzing performance issues and resolving performance regressions reported by Apple’s users around the world.

Developing microbenchmarks and performance validation tests to catch performance regressions in computer vision and machine learning algorithms to preserve the performance quality of Apple’s products.

Working on integration of Foundation Models (including LLMs) into Apple Vision Pro and making sure it meets power and performance targets.

Working with Apple’s customers to troubleshoot performance issues and suggest optimizations across a variety of use cases; and

Working on analytical and simulation models to predict application, algorithm, OS and real time interactive graphics performance and power.

Preferred Qualifications

Familiarity with PyTorch, Tensorflow or CoreML

Knowledge of AI/ML fundamentals including model evaluation and deployment/inference.

Familiarity with optimizing model architectures for on-device inference

Familiarity with Computer Vision, Transformers and LLM architectures.

Exceptional written and verbal communication skills

Minimum Qualifications

Minimum BS and 1\+ years of relevant industry experience

Familiarity with Operating Systems, embedding programming, parallel programming.

Academic or industry experience using C/C\+\+, Python or Swift

Understanding of compilers, runtimes, system performance, system software engineering and ML architectures.

Familiarity with optimizing inference latency, memory and compute.

Familiarity with Gen AI coding tools. Demonstrated ability to use them for design, code generation, and debugging.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .

Pay \& Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $126,800 and $220,900, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.