CrawlJobs Logo

Software Engineer, Inference – AMD GPU Enablement

openai.com Logo

OpenAI

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

295000.00 - 555000.00 USD / Year

Job Description:

We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from low-level kernel performance to high-level distributed execution - and collaborate closely with research, infra, and performance teams to ensure our largest models run smoothly on new hardware. This is a high-impact opportunity to shape OpenAI’s multi-platform inference capabilities from the ground up with a particular focus on advancing inference performance on AMD accelerators.

Job Responsibility:

  • Own bring-up, correctness and performance of the OpenAI inference stack on AMD hardware
  • Integrate internal model-serving infrastructure (e.g., vLLM, Triton) into a variety of GPU-backed systems
  • Debug and optimize distributed inference workloads across memory, network, and compute layers
  • Validate correctness, performance, and scalability of model execution on large GPU clusters
  • Collaborate with partner teams to design and optimize high-performance GPU kernels for accelerators using HIP, Triton, or other performance-focused frameworks
  • Collaborate with partner teams to build, integrate and tune collective communication libraries (e.g., RCCL) used to parallelize model execution across many GPUs

Requirements:

  • Experience writing or porting GPU kernels using HIP, CUDA, or Triton
  • Familiarity with communication libraries like NCCL/RCCL
  • Experience working on distributed inference systems
  • Ability to solve end-to-end performance challenges across hardware, system libraries, and orchestration layers
  • Ability to thrive in a small, fast-moving team building new infrastructure from first principles

Nice to have:

  • Contributions to open-source libraries like RCCL, Triton, or vLLM
  • Experience with GPU performance tools (Nsight, rocprof, perf) and memory/comms profiling
  • Prior experience deploying inference on other non-NVIDIA GPU environments
  • Knowledge of model/tensor parallelism, mixed precision, and serving 10B+ parameter models
What we offer:
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, Inference – AMD GPU Enablement

Software Engineer II and Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right
New

Senior Materials Scientist

Do you want to change how the world creates? At Formlabs, we’re building the too...
Location
Location
United States , Boston
Salary
Salary:
111000.00 - 143000.00 USD / Year
formlabs.com Logo
Formlabs GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S., M.S., or PhD in a relevant science or engineering field
  • Solid understanding of the fundamentals of materials science and polymer development
  • Passionate about testing and troubleshooting
  • Love to harness data
  • can design and conduct rigorous experiments to optimize materials
  • Can work autonomously and take initiative to learn new skills to complete an objective
  • Understand the value of good documentation
  • Excited to collaborate with a diverse group of scientists and engineers
Job Responsibility
Job Responsibility
  • Conduct research and develop world-class materials for 3D printing from initial lab explorations to validation and commercialization
  • Collaborate with hardware and software engineers to ensure new and existing materials print on our hardware seamlessly and reliably
  • Design and perform experiments, and use the results to inform and develop materials performance improvements
  • Partner with product management, hardware, and software engineers to continuously improve our materials
What we offer
What we offer
  • Robust equity program to build future wealth through RSUs
  • Comprehensive healthcare coverage (Medical, Dental, Vision)
  • 401K matching and access to financial advisors
  • Generous paid Parental Leave (up to 16 weeks)
  • Tenure-based paid Sabbatical Leave (up to 6 weeks)
  • Flexible Out of Office Plan
  • Ample on-site parking & pre-tax commuter benefits
  • Healthy on-site lunches, snacks, beverages, & treats
  • Regular sponsored professional development opportunities
  • Many opt-in culture events across our diverse community
  • Fulltime
Read More
Arrow Right
New

Mechanical Engineering - Hardware Reliability Intern

The Hardware Reliability Engineering team ensures that Formlabs products in deve...
Location
Location
United States , Somerville
Salary
Salary:
Not provided
formlabs.com Logo
Formlabs GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Are well versed with complex electromechanical systems and are passionate about understanding what it takes to make them work reliably
  • Have experience developing full system test plans and know how to execute them in fast-paced product development timelines
  • Have experience with testing a wide range of sensors, actuators, and mechanical components
  • Can prototype and run your own tests, from experimental setup to hardware and software implementation
  • A portfolio of your previous engineering work/projects is required
Job Responsibility
Job Responsibility
  • Develop, execute, and manage system, subsystem, and component level validation test plans to ensure products meet design and reliability requirements. Work with other teams to ensure a thorough system is completed
  • Perform hands-on and data-driven root cause analysis to triage field failures and electromechanical systems, utilizing common problem-solving methodologies and a 'physics of failure' approach
  • Design, build, and implement automated testing equipment for subsystem characterization and reliability/environmental testing
  • Collaborate with the design team throughout product development to perform risk assessments, manage continuous testing, and contribute to design reviews
What we offer
What we offer
  • Flexible Out of Office Plan
  • Ample on-site parking & pre-tax commuter benefits
  • Catered on-site lunches (3x per week), snacks, beverages, & treats
  • Cohort-based social and professional development experience for interns
  • Many opt-in culture events across our diverse community
  • unlimited 3D prints
  • social events
  • networking opportunities
  • access to fully-stocked kitchens and onsite lunches
  • Fulltime
Read More
Arrow Right
New

Software Asset Management (SAM) & ServiceNow Platform Administrator

Join Amgen’s Mission of Serving Patients. In this vital role you will help make ...
Location
Location
United States , Houston; Thousand Oaks
Salary
Salary:
118128.00 - 145342.00 USD / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate degree
  • OR Master’s degree and 2 years of experience with ServiceNow platform administration, including SAM Pro and CMDB modules.
  • OR Bachelor’s degree and 4 years of experience with ServiceNow platform administration, including SAM Pro and CMDB modules.
  • OR Associate’s degree and 8 years of experience with ServiceNow platform administration, including SAM Pro and CMDB modules.
  • OR High school diploma / GED and 10 years of experience with ServiceNow platform administration, including SAM Pro and CMDB modules.
Job Responsibility
Job Responsibility
  • Serve as primary administrator for SAM Pro and related CMDB components within ServiceNow.
  • Manage normalization, reconciliation, and entitlement automation using ServiceNow’s Software Recognition Library (SRL).
  • Oversee SAM Pro upgrades, patch management, and release testing, ensuring compliance with Amgen’s ESM release schedule.
  • Monitor and maintain Mid-Server health and integrations supporting SAM and discovery tools.
  • Partner with Enterprise Service Management (ESM) and Platform Engineering teams to validate post-release functionality.
  • Lead the technical roadmap for SAM Pro in alignment with Amgen’s Enterprise Technology Rationalization (ETR) and Architecture strategies.
  • Collaborate with SAM Process Owner and Product Manager to translate business requirements into platform configurations and automated workflows.
  • Evaluate new ServiceNow SAM capabilities, perform proof-of-concepts, and document change impact analyses.
  • Build, validate, and optimize integrations between ServiceNow and SCCM, Tanium, Nexthink, and Flexera.
  • Develop dashboards and reporting for data completeness, reconciliation results, and compliance status.
What we offer
What we offer
  • A comprehensive employee benefits package, including a Retirement and Savings Plan with generous company contributions, group medical, dental and vision coverage, life and disability insurance, and flexible spending accounts
  • A discretionary annual bonus program, or for field sales representatives, a sales-based incentive plan
  • Stock-based long-term incentives
  • Award-winning time-off plans
  • Flexible work models where possible.
  • Fulltime
Read More
Arrow Right
New

Credit Risk Model Development Intmd Analyst

The Model/Anlys/Valid Intmd Anlyst is a developing professional role. Deals with...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years experience
  • Proficient in Microsoft Office with an emphasis on MS Excel
  • Consistently demonstrates clear and concise written and verbal communication skills
  • Self-motivated and detail oriented
  • Demonstrated project management and organizational skills and capability to handle multiple projects at one time
  • Bachelor’s/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Develops, enhances, and validates the methods of measuring and analyzing risk, for all risk types including market, credit and operational
  • Supports the design, development, delivery and maintenance of best-in-class Risk programs, policies and practices for Risk Management
  • Reviews institutional or retail analytics and Models and other documents to ensure compliance with various regulatory and legal requirements
  • Identifies potential risks and escalates for further review
  • Handles preliminary investigations, assists with reconciliation procedures and prepares routine correspondence
  • Creates and maintains reports for control, tracking, and analysis purposes and ensures appropriate and secure retention of documents
  • Works with more senior staff in investigating and responding to customer and operational complaints
  • Interacts and works with other areas within Risk Management, as necessary
  • Appropriately assess risk when business decisions are made
  • Fulltime
Read More
Arrow Right
New

Program Management Supervisor

We are looking for a Program Management Supervisor to oversee customer service o...
Location
Location
United States , Chicago
Salary
Salary:
68000.00 - 75000.00 USD / Year
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 3 years of experience in customer service, program management, or operational oversight
  • Strong interpersonal and communication skills, with the ability to manage sensitive situations professionally
  • Proven ability to monitor workflows and ensure adherence to procedural and compliance standards
  • High attention to detail and organizational skills, especially in fast-paced, client-facing environments
  • Familiarity with affordable housing programs, including the Housing Choice Voucher program, preferred
  • Expertise in property management, including residential or commercial settings
  • Proficiency in handling escalated customer service concerns and delivering resolutions
  • Demonstrated ability to train and mentor staff effectively
Job Responsibility
Job Responsibility
  • Supervise daily office operations to ensure an efficient and organized environment that supports customer needs
  • Serve as the first point of escalation for complex customer inquiries, applying de-escalation skills and sound judgment to resolve issues effectively
  • Monitor workflow progress, deadlines, and work queues to ensure timely processing and service delivery
  • Provide guidance and mentorship to staff, encouraging attention to detail and maintaining high performance standards
  • Ensure compliance with program regulations, policy guidelines, and quality standards
  • Coordinate with leadership to identify risks, escalate concerns, and uphold accountability to service objectives
  • Manage front-desk activities, customer flow, and service-area organization to maintain office readiness
  • Document case details, operational challenges, and escalations accurately and in a timely manner
  • Support communication and transparency with client representatives and stakeholders, resolving issues as needed
What we offer
What we offer
  • health, dental and vision insurance
  • 401K
  • PTO
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Manufacturing Test Manager

As a Manufacturing Test Manager, you’ll lead the team that will design and devel...
Location
Location
United States , Somerville
Salary
Salary:
150000.00 - 200000.00 USD / Year
formlabs.com Logo
Formlabs GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience developing complex electromechanical products, managing both internal development and external global partnerships
  • Power user in Linux environments, comfortable using the command line and SSH to develop, debug, and deploy
  • Strong multidisciplinary foundation across embedded, electrical, and mechanical engineering
  • Proven track record of managing complex projects and setting clear expectations across diverse, cross-functional teams
  • Thrive in high-impact, small-team environments where personal interaction and rapid knowledge sharing are critical to making decisions
  • Passionate about software quality and have the technical discipline to maintain a robust, documented tools ecosystem
Job Responsibility
Job Responsibility
  • Lead the strategic architecture and deployment of hardware and software test infrastructure across global Contract Manufacturers to ensure reliable, repeatable production
  • Architect and maintain a Python-based ecosystem of manufacturing, engineering, and support tools from initial design through release
  • Oversee the development and validation of calibration and test stations, including all technical documentation and implementation specifications
  • Partner with cross-functional engineering teams to define hardware testability requirements and establish rigorous calibration standards
  • Apply data science techniques to production line data to extract actionable insights that improve yield and operational efficiency
  • Manage and mentor a team of four manufacturing test software engineers, fostering their technical growth and subject matter expertise
  • Streamline the development and deployment process to ensure high-quality software releases reach our factories worldwide without friction
What we offer
What we offer
  • Robust equity program to build future wealth through RSUs
  • Comprehensive healthcare coverage (Medical, Dental, Vision)
  • Low cost fund options in our 401K and access to advisors
  • Generous paid Parental Leave (up to 16 weeks)
  • Tenure-based paid Sabbatical Leave (up to 6 weeks)
  • Flexible Out of Office Plan – Take time when you need it
  • Ample on-site parking & pre-tax commuter benefits
  • Healthy on-site lunches, snacks, beverages, & treats
  • Regular sponsored professional development opportunities
  • Many opt-in culture events across our diverse community
  • Fulltime
Read More
Arrow Right
New

Associate Manufacturing Systems Engineer

In this vital role, you will be part of Amgen's newest and most sophisticated fi...
Location
Location
United States , New Albany
Salary
Salary:
96918.00 - 105697.00 USD / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree
  • OR Associate’s degree and 4 years of Information Systems, Business Analysis, or related experience
  • OR High school diploma / GED and 6 years of Information Systems, Business Analysis, or related experience
  • Strong analytical and problem-solving skills
  • Clear verbal and written communication skills
  • Ability to work effectively in cross-functional and virtual teams
  • High level of initiative, curiosity, and eagerness to learn
  • Ability to manage multiple priorities in a fast-paced environment
  • Team-oriented mindset with a focus on collaboration and shared success
Job Responsibility
Job Responsibility
  • Own and support key manufacturing and digital systems within the Amgen Ohio operations and technology portfolio
  • Perform troubleshooting, maintenance, and performance monitoring of manufacturing systems
  • Collaborate with delivery, platform, and architecture teams to ensure solutions align with approved standards and guidelines
  • Support projects and initiatives including system upgrades, enhancements, and new technology introductions
  • Create process flows and diagrams to help visualize current-state and future-state processes and identify improvement opportunities
  • Work with business partners to understand how automation and digital solutions can improve workflow, data visibility, and productivity
  • Assist in gathering, documenting, and validating business and system requirements from end users and stakeholders
  • Support the creation and execution of test cases, test plans, and validation documentation to ensure systems meet business and regulatory requirements
  • Develop and maintain documentation such as SOPs, user guides, process maps, functional/design documents, and operational diagrams
  • Learn and apply Industry 4.0 concepts and manufacturing data integrations under the guidance of senior team members
What we offer
What we offer
  • A comprehensive employee benefits package, including a Retirement and Savings Plan with generous company contributions, group medical, dental and vision coverage, life and disability insurance, and flexible spending accounts
  • A discretionary annual bonus program, or for field sales representatives, a sales-based incentive plan
  • Stock-based long-term incentives
  • Award-winning time-off plans
  • Flexible work models where possible
  • Fulltime
Read More
Arrow Right