Staff Infrastructure Software Engineer, Enterprise AI Job at Scale (New York)

Staff Software Engineer, AI Runtime

We’re seeking a Staff Software Engineer to help power the future of agentic AI w...

Location

United States

Salary:

185000.00 - 215000.00 USD / Year

Apollo GraphQL

Expiration Date

Until further notice

Requirements

Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
Deep expertise in Rust programming language
Strong background in distributed systems, server architecture, and high-performance backend development
Proven experience with protocol design, message routing, and server-side orchestration frameworks
Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
Passion for clean, maintainable code, high system reliability, and scalable architecture
Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams

Job Responsibility

Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
Build and maintain tools for agent discovery, communication, and coordination
Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
Integrate observability, logging, and monitoring for full visibility into server and agent behavior
Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs

What we offer

Offers Equity
Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
Dental and Vision benefits are provided by Sun Life Financial

Fulltime

Staff AI Engineer

As a Staff AI Engineer you will get to play with petabyte data gathered from a m...

Location

Salary:

Not provided

Balbix

Expiration Date

Until further notice

Requirements

Ph.D./M.S. in Computer Science or Electrical Engineering with hands-on software engineering experience
5+ years of experience in the field of Machine Learning and programming in Python
Expertise in programming concepts and building large scale systems
Knowledge of state-of-the-art algorithms combined with expertise in statistical analysis and modeling
Robust understanding of NLP, Probabilistic Graphical Models, Deep Learning with graphs structures, model explainability, etc.
Foundational knowledge of probability, statistics and linear algebra

Job Responsibility

Design and develop an ensemble of classical and deep learning algorithms for modeling complex interactions between people, software, infrastructure and policies in an enterprise environment
Design and implement algorithms for statistical modeling of enterprise cybersecurity risk
Apply data-mining, AI and graph analysis techniques to address a variety of problems including modeling, relevance and recommendation
Build production quality solutions that balance complexity and performance
Participate in the engineering life-cycle at Balbix, including designing high quality ML infrastructure and data pipelines, writing production code, conducting code reviews and working alongside our infrastructure and reliability teams
Drive the architecture and the usage of open source software library for numerical computation such as TensorFlow, PyTorch, and ScikitLearn

Fulltime

New

Staff Software Engineer – Forward Deployed

We are seeking a skilled Software Engineer who will design, build, and maintain ...

Location

China , Shanghai; Dalian; Wuhan

Salary:

Not provided

Pfizer

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or related field with 8-12 years of relevant experience
AI-Augmented Development: optimize AI tool usage, train engineers on AI-augmented workflows, evaluate new AI development tools, establish practices that balance AI speed with verification rigor
Business Immersion: rapidly acquire domain expertise, translate between business and engineering, mentor engineers on immersion
Data Integration: navigate complex enterprise data landscapes, build relationships to gain data access, handle undocumented schemas, build robust integration solutions, mentor engineers on data integration
Full-Stack Development: build complete applications rapidly across any technology stack, select the right tools, balance technical debt with delivery speed, mentor engineers on full-stack development
Multi-Audience Communication: influence through communication at all levels, handle difficult conversations skillfully, train engineers on effective communication, represent teams across the function
Problem Discovery: seek out undefined problems, embed with users to discover latent needs, coach engineers on problem discovery techniques, turn ambiguity into clear problem statements
Rapid Prototyping & Validation: lead rapid delivery initiatives, coach on prototype-first approaches, establish trust through consistent fast delivery, define clear criteria for prototype-to-production transitions
Site Reliability Engineering: define reliability standards, drive post-incident improvements systematically, design capacity planning processes, mentor engineers on SRE practices
Stakeholder Management: influence senior stakeholders, manage complex stakeholder landscapes with competing agendas, build trust rapidly with new stakeholders, shield teams from organizational friction

Job Responsibility

Delivery: Lead technical delivery of complex projects across multiple teams, unblock others through hands-on contributions, ensure engineering quality
AI: Design AI-augmented engineering workflows for your area, evaluate new AI tools, train engineers on effective AI usage, balance speed with verification
People: Coach multiple engineers on career growth, lead hiring for technical roles across your area, shape team technical culture
Business: Drive business outcomes through technical solutions across your area, influence product roadmaps, partner effectively with business stakeholders
Process: Drive process efficiency within your team, coordinate cross-functional technical work, lead retrospectives
Documentation: Design documentation strategies for your projects, ensure knowledge persists beyond individuals, write specifications that enable effective collaboration

Fulltime

New

Staff Software Engineer, Enterprise

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

195400.00 - 275600.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

8+ years of software engineering experience with deep specialization in building enterprise SaaS platforms or wide breadth across multiple relevant domains
Expert-level proficiency in backend development (Go, Python, Java, or similar) with strong opinions on when to use what
Extensive experience designing, building, and operating large-scale distributed systems
Deep understanding of API design, service architecture, and system integration patterns
Strong knowledge of databases, caching, and data pipeline architectures
Experience with cloud platforms (AWS, GCP, or Azure) and container/orchestration technologies
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Proven track record of leading complex technical initiatives from conception through delivery
Ability to make sound architectural decisions that account for scale, reliability, security, and maintainability
Experience defining technical standards and driving adoption across teams

Job Responsibility

Define the technical architecture for Docker's unified enterprise governance platform, ensuring it scales to support thousands of enterprise customers
Design the Unified Internal Access Control Endpoint that will serve as the single source of truth for permissions, settings, and policies across all Docker products
Architect systems that balance immediate customer needs with long-term platform extensibility
Identify gaps in existing processes and systems, recommend solutions, and drive implementation
Own end-to-end delivery of major platform components such as the Enterprise Command Center, group management/RBAC systems, or high-volume audit logging infrastructure
Lead technical design for SIEM/API integrations that enable enterprises to ingest Docker telemetry into their existing security infrastructure
Solve complex problems creatively and efficiently, often navigating ambiguity and competing priorities
Make technical decisions that balance customer impact, engineering velocity, and operational sustainability
Mentor engineers across the organization, helping them grow their technical skills and judgment
Set technical standards and best practices that raise the bar for the entire platform organization

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

New

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

251000.00 - 352000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
Expert-level understanding of API design, service architecture, and system integration patterns at scale
Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
Experience translating business strategy into technical architecture and roadmaps
Demonstrated ability to identify and prioritize investments that provide maximum platform leverage

Job Responsibility

Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

New

Principal Software Engineer, AI Cloud

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

232000.00 - 319000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

10+ years of software engineering experience, including 3+ years in technical leadership roles (Staff or Principal level)
Proven experience designing and building highly scalable distributed systems in production environments
Deep understanding of cloud infrastructure (AWS, Azure, GCP, or OCI), including compute, networking, and storage primitives
Proficiency in Go, Rust, or Java
Expertise in Kubernetes, microservices, and service mesh architectures
Strong foundation in observability, CI/CD, and infrastructure-as-code (Terraform, Pulumi, or CloudFormation)
Experience operating high-availability (99.99%+) production systems
Exceptional communication skills and ability to influence across technical and business domains
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Job Responsibility

Define and drive the long-term technical strategy for Docker AI Cloud’s control and data plane services
Architect highly available, multi-region systems capable of operating seamlessly across multiple cloud providers
Design APIs and service abstractions that integrate Docker Desktop, Hub, and enterprise cloud services
Establish standards for reliability, scalability, and observability across the Docker AI Cloud platform
Lead cross-functional technical discussions and influence architectural decisions company-wide
Design and implement distributed systems for workload orchestration, service discovery, and lifecycle management
Build and operate control plane components that manage multi-tenant workloads and cloud networking
Develop infrastructure that delivers predictable performance, intelligent scaling, and automated failover
Ensure security, data integrity, and compliance across Docker’s global infrastructure footprint
Partner with platform and product teams to deliver developer-friendly APIs and cloud experiences

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

New

AI Engineer

Reporting to the AI & Technology Oversight Manager, the AI Engineer is responsib...

Location

India , Mumbai

Salary:

Not provided

Waystone Governance Ltd.

Expiration Date

Until further notice

Requirements

Deep understanding of the distinction between Generative AI and Agentic AI, including their foundations, capabilities, and appropriate use cases
Strong understanding of AI, ML and LLM concepts, including prompt engineering, prompt grounding, iterative loop techniques, context windows, embeddings, RAG, agentic workflows
Proven ability to integrate AI capabilities both into low-code automation flows and high-code stacks, including, applications, APIs, microservices, distributed systems, and development or testing tools
Solid software development background with hands-on coding experience in one or more engineering ecosystem such as .NET (C#), Python, or TypeScript
Excellent communication skills, with the ability to translate complex AI concepts for non‑experts and to effectively influence and collaborate with stakeholders at all levels, both technical and non‑technical
Strong writing skills, with the ability to contribute to AI literacy and AI fluency documentation
Strong understanding of responsible AI principles, including governance, bias mitigation, compliance, and risk-based decision-making
Analytical thinking with excellent problem‑solving ability and keen attention to details
Ability to mentor developers and testers, and to drive innovation across engineering, QA, and architecture
Ability to assess AI‑enabled capabilities in third‑party SaaS platforms (e.g., Appian, Salesforce,etc) and provide guidance on responsible, effective adoption

Job Responsibility

Hands-on contributor to the design and development of AI-enabled solutions, capable of writing both production-quality code and rapid experimental prototypes
Develop and implement AI‑enabled microservices, APIs, applications, and internal tools
Integrate AI capabilities following secure, scalable engineering best practices
Design, build and validate AI‑driven solutions leveraging providers such as OpenAI and Anthropic
Enhance low‑code/no‑code automation platforms (e.g., Power Automate, n8n, Workato) by embedding intelligent processing and applying agentic patterns where relevant
Implement Model Context Protocol (MCP) servers for secure AI‑to‑system connectivity
Lead AI‑based document parsing and intelligent data extraction initiatives
Contribute to educating and enabling Enterprise Capabilities areas, including Integration and Automation, by providing guidance, training, and best practices, e.g., on effective use of n8n agents
Engage with business stakeholders to understand requirements, constraints, and key drivers, identifying and implementing high‑value AI opportunities across Waystone
Prototype AI features and iterate towards production‑ready capabilities

Fulltime

New

AI Engineer

Reporting to the AI & Technology Oversight Manager, the AI Engineer is responsib...

Location

United Kingdom , Leeds

Salary:

Not provided

Waystone Governance Ltd.

Expiration Date

Until further notice

Requirements

Deep understanding of the distinction between Generative AI and Agentic AI, including their foundations, capabilities, and appropriate use cases
Strong understanding of AI, ML and LLM concepts, including prompt engineering, prompt grounding, iterative loop techniques, context windows, embeddings, RAG, agentic workflows
Proven ability to integrate AI capabilities both into low-code automation flows and high-code stacks, including, applications, APIs, microservices, distributed systems, and development or testing tools
Solid software development background with hands-on coding experience in one or more engineering ecosystem such as .NET (C#), Python, or TypeScript
Excellent communication skills, with the ability to translate complex AI concepts for non‑experts and to effectively influence and collaborate with stakeholders at all levels, both technical and non‑technical
Strong writing skills, with the ability to contribute to AI literacy and AI fluency documentation
Strong understanding of responsible AI principles, including governance, bias mitigation, compliance, and risk-based decision-making
Analytical thinking with excellent problem‑solving ability and keen attention to details
Ability to mentor developers and testers, and to drive innovation across engineering, QA, and architecture
Ability to assess AI‑enabled capabilities in third‑party SaaS platforms (e.g., Appian, Salesforce,etc) and provide guidance on responsible, effective adoption

Job Responsibility

Hands-on contributor to the design and development of AI-enabled solutions, capable of writing both production-quality code and rapid experimental prototypes
Develop and implement AI‑enabled microservices, APIs, applications, and internal tools
Integrate AI capabilities following secure, scalable engineering best practices
Design, build and validate AI‑driven solutions leveraging providers such as OpenAI and Anthropic
Enhance low‑code/no‑code automation platforms (e.g., Power Automate, n8n, Workato) by embedding intelligent processing and applying agentic patterns where relevant
Implement Model Context Protocol (MCP) servers for secure AI‑to‑system connectivity
Lead AI‑based document parsing and intelligent data extraction initiatives
Contribute to educating and enabling Enterprise Capabilities areas, including Integration and Automation, by providing guidance, training, and best practices, e.g., on effective use of n8n agents
Engage with business stakeholders to understand requirements, constraints, and key drivers, identifying and implementing high‑value AI opportunities across Waystone
Prototype AI features and iterate towards production‑ready capabilities

Fulltime

Staff Infrastructure Software Engineer, Enterprise AI

Scale

Location:
United States , New York ▼
San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
February 20, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Staff Infrastructure Software Engineer, Enterprise AI

Staff Software Engineer, AI Runtime

Staff AI Engineer

Staff Software Engineer – Forward Deployed

Staff Software Engineer, Enterprise

Senior Principal Software Engineer, Infrastructure

Principal Software Engineer, AI Cloud

AI Engineer

AI Engineer

Staff Infrastructure Software Engineer, Enterprise AI

Scale

Location:United States , New York ▼San Francisco

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:February 20, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Staff Infrastructure Software Engineer, Enterprise AI

Staff Software Engineer, AI Runtime

Staff AI Engineer

Staff Software Engineer – Forward Deployed

Staff Software Engineer, Enterprise

Senior Principal Software Engineer, Infrastructure

Principal Software Engineer, AI Cloud

AI Engineer

AI Engineer

Location:
United States , New York ▼
San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
February 20, 2026