CrawlJobs Logo

Software Engineer, AI Gateway

vercel.com Logo

Vercel

Location Icon

Location:
United States , San Francisco ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

196000.00 - 294000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

Job Responsibility:

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights

Requirements:

  • At least 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment
What we offer:
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed

Additional Information:

Job Posted:
February 14, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Vercel - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, AI Gateway

Senior Software Engineer, AI Runtime

We’re seeking a Senior Software Engineer to help power the future of agentic AI ...
Location
Location
United States
Salary
Salary:
157000.00 - 198900.00 USD / Year
apollographql.com Logo
Apollo GraphQL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Job Responsibility
Job Responsibility
  • Scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams within our org to ensure the MCP Server meets evolving product and developer needs
Read More
Arrow Right

Staff Software Engineer, AI Runtime

We’re seeking a Staff Software Engineer to help power the future of agentic AI w...
Location
Location
United States
Salary
Salary:
185000.00 - 215000.00 USD / Year
apollographql.com Logo
Apollo GraphQL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Job Responsibility
Job Responsibility
  • Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs
What we offer
What we offer
  • Offers Equity
  • Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
  • Dental and Vision benefits are provided by Sun Life Financial
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer

As a one person team to start, you are both a product lead and the technical SME...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
frankieone.com Logo
FrankieOne
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience in building AI applications with end to end ownership
  • 10 plus years experience in engineering teams in an Agile environment using JS based frameworks like React
  • 5 plus years developing & supporting Full Stack TS-based SaaS applications production in AWS/Cloud ecosystem
  • Experience in HTML5, ES6, CSS3/Sass, javascript, typescript, React, React Native for Web (optional), npm and other front-end technologies to deliver enterprise grade frontend applications
  • Experience in depth of back-end oriented technologies such as nodejs, typescript for managing BFF
  • Knowledge and experience in tracking technological developments especially AI with vendor offerings and ability to quickly evaluate their value proposition e.g AWS Bedrock
  • Experience in architecting & building enterprise grade AI applications with Data and AI governance, AI gateways, context management (RAG), inference/prompt management, tools/functions (MCP, A2A), memory & fine-tuning
  • Experience in capturing business requirements from stakeholders to documenting, architect and building AI applications for both internal and external users
  • Experience in designing web applications based on AWS well architectured principles, 12 factor web application principles, cloud based software architecture patterns (pub-sub, saga, circuit breaker etc)
  • Experience in designing reactjs based frontend and backend in nodejs or golang
Job Responsibility
Job Responsibility
  • Inspire others
  • Design with quality
  • Collaborate
  • Be proactive
  • Be an advocate for FrankieOne, for our product, and our values
Read More
Arrow Right

Staff Software Engineer

We are seeking a Staff Software Engineer to lead the technical vision and execut...
Location
Location
Argentina , Buenos Aires
Salary
Salary:
Not provided
gofundme.com Logo
GoFundMe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience
  • strong full-stack capabilities
  • solid foundation in modern JavaScript/TypeScript development
  • deep experience with frontend and application development, particularly in frameworks such as Angular, React/Next.js
  • strong track record of designing and building APIs, webhooks, and event-driven features
  • experienced with AWS services (Lambda, SQS/SNS, CloudWatch, API Gateway, etc.)
  • skilled at diagnosing and preventing performance and scalability issues using tools such as New Relic, BugSnag
  • take pride in mentoring and supporting other engineers
Job Responsibility
Job Responsibility
  • Define and drive the technical roadmap for the new GoFundMe Pro Live ticketing and events platform
  • lead the design and implementation of core system components, including front-end architecture, APIs, event-driven flows (Kafka/SQS/SNS equivalents), webhooks, and cross-application connectivity
  • champion modern, AI-assisted development tools (e.g., GitHub Copilot, Cursor)
  • mentor and elevate engineers through design reviews, pair programming, technical coaching
  • enhance system reliability and operational excellence by participating in the on-call rotation and leading incident investigation
  • collaborate closely with cross-functional partners—Product, Design, QA, and other engineering teams
What we offer
What we offer
  • Make an Impact: Be part of a mission-driven organization
  • Innovative Environment: Work with a diverse, passionate, and talented team
  • Collaborative Team: Join a fun and collaborative team
  • Competitive Benefits: Enjoy competitive pay and comprehensive healthcare benefits
  • Holistic Support: Enjoy financial assistance for things like hybrid work, family planning, along with generous parental leave, flexible time-off policies, and mental health and wellness resources
  • Growth Opportunities: Participate in learning, development, and recognition programs
  • Commitment to DEI: Contribute to diversity, equity, and inclusion through ongoing initiatives and employee resource groups
  • Community Engagement: Make a difference through our volunteering program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are looking for a passionate back-end Software Engineer who is deeply driven ...
Location
Location
United States
Salary
Salary:
Not provided
cyware.com Logo
Cyware
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • US Citizenship is a requirement of this position in accordance with 8 U.S.C 1324b(a)(2)(C)
  • Bachelor’s degree or higher, in Computer Science, Engineering, IT or a related discipline
  • 5+ years of practical experience in building Django applications is a huge plus
  • Knowledge in Python, with the ability to build efficient REST API using Django REST Framework
  • Experience with AI/ML integrations: building and consuming REST / gRPC services that use LLMs (OpenAI, local models, etc.)
  • Hands-on experience designing and implementing RAG pipelines (vector stores, embeddings, document indexing, retrieval strategies)
  • Experience with Go (GoLang) for building high-performance microservices or backend components is a strong plus
  • Knowledge of scheduling framework or event-driven programming in Django
  • The ability to naturally follow good development practices like test automation, CI/CD, source version control, GitHub, etc.
  • Experience with applications that have scaled
Job Responsibility
Job Responsibility
  • Develop features from proposal to polished end result
  • Manage and review code contributed by the rest of the team and work with them to get it ready for production
  • Take initiative in improving the software in small or large ways to address pain points in your own experience as a developer
  • Keep code easy to maintain and keep it easy for others to contribute
  • Work with multi-disciplinary teams to maintain and support production and operations of Cyware Products
What we offer
What we offer
  • We offer a comprehensive benefits package including time off, paid holidays, retirement plans, insurance coverage and much more
  • We’ll invest in your career
  • We offer competitive compensation packages
  • Fulltime
Read More
Arrow Right

Senior TypeScript Backend Engineer - CoreApps Platform

Join the CoreApps Platform team, the foundational engineering group at Groupon r...
Location
Location
Salary
Salary:
Not provided
groupon.com Logo
Groupon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional backend software development experience (or 3+ years with proven, exceptional AI-driven impact)
  • Strong professional experience in building backend systems with TypeScript and Node.js
  • Mandatory: Proven track record using AI coding tools (e.g., Cursor, GitHub Copilot, Claude Code) to successfully deliver production features and refactor complex, multi-service codebases
  • Proven experience designing and building high-throughput distributed systems (e.g., handling 100K+ RPM)
  • Strong understanding of microservices, event-driven architecture (e.g., Kafka), and transactional systems
  • Proficiency with SQL/NoSQL databases (MySQL/PostgreSQL, MongoDB) and leveraging Kubernetes in a cloud environment (GCP/AWS)
Job Responsibility
Job Responsibility
  • Architect and Develop high-throughput, low-latency Core Platform services (e.g., API Gateway, Deal Catalog, User Identity)
  • Drive Modernization by actively refactoring and migrating critical services from legacy stacks to a modern TypeScript/Node.js microservices architecture
  • Champion AI-Assisted Development by leveraging AI coding tools (e.g., Copilot, Cursor) to accelerate feature delivery, navigate complex codebases, and mentor team members on best practices
  • Ensure Operational Excellence for global, production systems, including incident response, system resilience design (circuit breakers, retry logic), and participation in the on-call rotation
  • Design Distributed Systems that are fault-tolerant, self-healing, and resilient, including sophisticated caching and rate-limiting strategies
  • Own Complex Commerce Logic for financial systems, order management, and payment processing within the platform
Read More
Arrow Right

Full-Stack Engineer (Data)

We are seeking a motivated and talented Full-Stack Engineer with a strong backgr...
Location
Location
United Kingdom
Salary
Salary:
Not provided
spectrum.life Logo
Spectrum Life
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Full-Stack Engineer, with a strong portfolio of backend-focused or AI-driven projects
  • Expert proficiency in TypeScript and Node.js, with a deep understanding of modern JavaScript (ES6+), asynchronous programming patterns, and building scalable backend APIs and services
  • Extensive, hands-on experience architecting and building solutions on the AWS ecosystem. This includes core serverless services (Lambda, API Gateway, S3, EventBridge), databases (RDS, DynamoDB), security (IAM), and infrastructure as code tools (AWS CDK, CloudFormation, or Terraform)
  • Strong experience in database design and management, with proficiency in both relational (e.g., PostgreSQL) and NoSQL databases. You should be comfortable with schema design, query optimization, and data modeling
  • A solid understanding of Generative AI concepts and practical experience working with LLMs
  • Comfortable with the principles of LLM design, including prompt engineering and an understanding of model evaluation techniques
  • A solid understanding of the full software development lifecycle, including testing, monitoring, and deployment
Job Responsibility
Job Responsibility
  • Architectural Ownership & Design: Lead the technical design and architectural decisions for our core AI product. You will take ownership of the entire LLM lifecycle, from model selection and evaluation to deployment and monitoring, ensuring a clear and scalable design
  • LLM & Backend Engineering: Develop clean, secure, and performant serverless backend services using AWS Lambda and the wider AWS ecosystem
  • Design, build, and maintain the scaffolding for invoking Large Language Models (LLMs) via services like AWS Bedrock
  • Compare and evaluate different LLMs to determine the best fit for our use cases, establishing clear metrics and evaluation frameworks
  • Implement and manage robust data processing and storage solutions to support our AI features
  • Infrastructure & Best Practices: Design and deploy cloud infrastructure using modern best practices (e.g., Infrastructure as Code)
  • Implement comprehensive testing, robust exception handling, and application monitoring to ensure the high availability and reliability of our AI services
  • Take charge of your local development environment and see features through to production, collaborating with the wider team to ensure seamless product integration
  • Champion and maintain high standards for code quality, scalability, and maintainability
What we offer
What we offer
  • Full time permanent contract
  • Competitive salary (Dependent on experience)
  • In-office, remote or hybrid working options
  • 25 days annual leave
  • 24/7 EAP and a wide range of health and wellbeing supports
  • Extensive list of employee perks and benefits
  • Fulltime
Read More
Arrow Right

Senior Full Stack Software Engineer

As we continue to grow, we are looking for a Senior Full Stack SWE to join our t...
Location
Location
United States
Salary
Salary:
Not provided
resonate.com Logo
Resonate
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience, with a strong portfolio of building and scaling SaaS applications
  • Expert-level proficiency with Java/Spring Boot backend development and React/TypeScript frontend development
  • Demonstrated expertise in designing, deploying, and managing cloud-native applications on AWS
  • Proven experience integrating AI/ML models and third-party APIs into a production software environment
  • Strong architectural skills and a deep understanding of distributed systems, microservice patterns, and event-driven design
  • Proficiency with relational databases and SQL
  • A pragmatic approach to engineering, with a solid understanding of the trade-offs between performance, cost, and scalability in AI systems
  • A passion for mentoring and elevating the skills of the entire engineering team
Job Responsibility
Job Responsibility
  • Build the architecture and development of scalable, resilient backend microservices and deploy them within our AWS infrastructure
  • Build and enhance our user-facing platform with modern React, TypeScript, and Next.js creating intuitive interfaces that seamlessly integrate complex, AI-driven features
  • Design and implement the core technical infrastructure to support our AI agents, including API gateways, state management systems for agentic workflows, and observability into AI operations
  • Integrate and orchestrate various LLM models and services to connect our AI's reasoning to our backend systems and data stores
  • Develop and optimize data architectures using relational and vector databases to provide our agents with fast, relevant context for memory and RAG
  • Leverage a suite of AWS services to build, deploy, and monitor our AI-native applications
  • Apply engineering best practices and processes to support the technical vision for the platform
What we offer
What we offer
  • Uncapped growth potential
  • The chance to have a meaningful impact on the company
  • The opportunity to work on cutting-edge, AI-powered marketing data and identity solutions
  • Competitive 401(k) match
  • Open PTO policy that encourages real time off
  • Comprehensive benefits package designed to meet the diverse needs of our employees and their families
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy