AI Software Development Engineer

Description

Job Details:

Responsibilities

• We are seeking a skilled AI Software Development Engineer to join our team in optimizing AI inference workloads for the company GPUs. In this role, you will work across the full AI software stack, focusing on improving performance-critical GPU kernels, graph compilation flows, and inference runtimes. Your contributions will directly enhance the efficiency and scalability of modern AI workloads, helping unlock the full potential of the company's AI technologies.
• Business Group
• As part of the company's Software Group, you will join a team dedicated to delivering innovative software solutions that enable and enhance the company's AI products. The group plays a pivotal role in developing tools, frameworks, and optimizations that empower developers worldwide, shaping the future of AI-driven applications and advancing the company's mission to create world-changing technology.
• Optimize AI inference workloads, such as Large Language Models (LLMs), multimodal models, and emerging generative AI applications, for the company GPUs.
• Design, develop, and tune performance-critical GPU kernels and runtime components using C++, SYCL, Vulkan Compute, OpenCL, or similar parallel programming technologies.
• Develop and optimize graph compilation flows and compiler passes using technologies like MLIR, LLVM, or related frameworks.
• Identify and resolve performance bottlenecks across compiler, runtime, framework, and kernel layers.
• Profile, benchmark, and analyze AI workloads to validate performance improvements and guide optimization strategies.
• Collaborate with hardware, driver, compiler, and framework teams to drive hardware/software co-optimization.
• Contribute to and optimize open-source AI inference frameworks such as OpenVINO, llama.cpp, vLLM, PyTorch, or related ecosystems.

Requirements

• Minimum Qualifications
• Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, with 4+ years of relevant industry experience, OR Master's degree with 3+ years, OR Ph.D. with no prior professional experience.
• Strong proficiency in C++ programming, debugging, and problem-solving.
• Solid understanding of GPU architectures, Graphics Device Driver, Firmware, AI accelerators, or parallel computing systems.
• Experience with performance analysis, profiling, and optimization for compute-intensive applications.
• Hands-on experience with modern neural network architectures and their execution on hardware accelerators.
• Preferred Qualifications
• Experience optimizing end-to-end AI inference workloads in production environments.
• Familiarity with AI inference frameworks such as OpenVINO, PyTorch, TensorRT, ONNX Runtime, or similar technologies.
• Knowledge of neural network optimization techniques, including quantization, kernel fusion, and memory optimization.
• Experience across multiple layers of the AI software stack, including inference runtimes, graph compilers, and GPU kernels.
• Experience contributing to open-source software projects is a plus.
• We're excited about the opportunity to work with individuals passionate about pushing the boundaries of AI innovation. If you're ready to make a meaningful impact and collaborate with a dynamic team, we encourage you to apply today.
• Job Type:
• Experienced Hire
• Shift:
• Shift 1 (United States of America)
• Primary Location:
• US, California, Folsom
• Additional Locations:
• US, California, Santa Clara
• Posting Statement:
• Position of Trust
• N/A

Benefits

• We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock bonuses, and benefit programs which include health, retirement, and vacation. Find out more about the benefits of working at the company .
• Annual Salary Range for jobs which could be performed in the US: $149,750.00-275,580.00 USD
• The range displayed on this job posting reflects the minimum and maximum target compensation for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific compensation range for your preferred location during the hiring process.
• Work Model for this Role
• This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned the company site and off-site. Job posting details (such as work model, location or time type) are subject to change.
• ADDITIONAL INFORMATION: the company is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.