AI Runtime / ML Model Systems Engineer

Description

This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development, installation, and maintenance of state-of-the-art software applications and services for the company. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools.

Houston in-office requirement: 4 days

Responsibilities

• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Leads the building of various software development projects and platforms while aligning them with business and security strategies and requirements.
• Builds standards, designs, and automates the deployment of software.
• Designs and develops solutions that protect and manage software products and data.
• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.
• Education & Experience Recommended
• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
• Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.
• Strong AI runtime expertise.
• Optimize inference execution.
• Required Qualifications
• ONNX, TensorRT, OpenVINO.
• NPU/GPU scheduling.
• Edge AI deployment.
• Knowledge & Skills
• Agile Methodology
• Amazon Web Services
• Application Programming Interface (API )
• Automation
• C++
• Computer Science
• DevOps
• Docker (Software)
• Full Stack Development
• Java (Programming Language)
• JavaScript (Programming Language)
• Kubernetes
• Microservices
• Microsoft Azure
• Python (Programming Language)
• React.js
• Scalability
• Software Development
• Software Engineering
• SQL (Programming Language)
• The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.

Benefits

• HP offers a comprehensive benefits package for this position, including:
• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave ( US benefits overview )
• The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject to applicable law.
• Job -
• Software
• Schedule -
• Full time
• Shift -
• No shift premium (United States of America)
• Travel -
• 25%
• Relocation -