CrawlJobs Logo

Principal Software Engineering Manager - AI Engineering

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
Canada , Vancouver

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

142400.00 - 257500.00 CAD / Year

Job Description:

The Fabric Data Engineering Experience & Infrastructure team is hiring a Principle Software Engineering Manager to lead a team building LLM-powered data engineering experiences and supporting infrastructure for Fabric Data Engineering, based on Apache Spark. This role spans people leadership and technical leadership: you will grow and coach engineers while guiding design and delivery of agentic workflows and scalable LLM-backed data features (e.g., AI-assisted notebook experiences, evaluation/telemetry, production-grade orchestration patterns) that help Data Engineers achieve more through Microsoft Fabric.

Job Responsibility:

  • Lead and grow a team: Hire, onboard, coach, and develop engineers
  • set clear expectations
  • create an inclusive culture of accountability, learning, and collaboration.
  • Drive execution and delivery: Guide team planning and prioritization across multiple workstreams
  • manage dependencies, risks, and release readiness
  • ensure predictable delivery from requirements → architecture → implementation → rollout → live-site operations.
  • Shape requirements with partners: Partner with Product Management, Design, Research, and dependent engineering teams to translate ambiguous customer needs into crisp scenario plans and measurable outcomes.
  • Guide architecture and technical strategy: Lead identification of dependencies and development of design documents
  • guide architectural decisions for distributed, cloud-scale systems (Spark/PySpark + Python services) with explicit tradeoffs across performance, reliability, cost, security, privacy, and operability.
  • Raise the engineering quality bar: Establish and reinforce engineering standards (design reviews, coding patterns, test strategy, performance practices, operational readiness)
  • ensure code and designs meet quality and scale expectations.
  • Operational excellence and accountability: Own service health for your area—live-site readiness, on-call excellence, incident response, postmortems, and sustained improvements. Hold accountability for outcomes when services do not meet performance or reliability expectations.
  • AI Engineering at production scale: Guide the team to build and operationalize LLM-powered experiences using robust orchestration, grounding, evaluation/quality gates, telemetry, and iterative improvements aligned to customer value and Responsible AI principles.
  • Cross-team influence: Build partner relationships across organizations and geographies
  • align on shared goals, interfaces, and SLAs
  • unblock execution and drive decisions when tradeoffs arise.

Requirements:

  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have:

  • Modern LLM / AI Engineering: Solid understanding of LLM systems and applied AI Engineering (prompting, grounding/RAG, tool/function calling, agent orchestration, evaluation). Ability to define quality bars and drive adoption of repeatable patterns across teams.
  • Operationalizing AI/ML at scale: Experience establishing monitoring/telemetry, experimentation (A/B), rollout strategies, and cost/latency optimization—driving predictable operations and continuous improvement across services.
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • People leadership: Experience leading and developing engineering teams (hiring, coaching, performance management, career growth), building inclusive culture, and improving team effectiveness.
  • Technical depth in distributed systems: Proven ability to guide design and delivery of scalable distributed systems and production services, including reliability, diagnosability, and operational excellence.
  • Spark + data platform expertise: Hands-on understanding of Apache Spark/PySpark and data engineering patterns for large-scale structured/semi-structured/unstructured workloads
  • ability to guide platform-level improvements (performance, cost, operability).
  • Cloud + security/compliance rigor: Cloud-native engineering experience (Azure compute/storage/networking) and ability to ensure solutions meet security, privacy, and compliance expectations.
  • Cross-team partner leadership: Demonstrated ability to align with multiple partner teams, manage dependencies, and deliver high-impact customer outcomes through influence and collaboration.

Additional Information:

Job Posted:
March 13, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Software Engineering Manager - AI Engineering

Principal Software Engineer - Central AI

The Central AI org’s purpose is to accelerate AI innovation across all our produ...
Location
Location
United States , Mountain View; San Francisco; Austin; New York
Salary
Salary:
170800.00 - 274300.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 12 years of hands-on experience in software/technology roles, in Enterprise Products & Solutions in the cloud
  • Proficiency with cloud-native technologies, ideally AWS
  • At least 2 years of experience architecting and implementing multiple features of a SaaS product at a high scale, performance and reliability of 4 nines
  • Experience with building and delivering multi-tenant cloud-native SaaS software
  • Strong understanding of distributed systems, modern cloud-native architectures, and distributed data management
  • Excellent communication skills and demonstrated success in articulating and pitching technical vision to stakeholders
  • Ability to balance short- and long-term objectives, focusing on both technical and business outcomes
Job Responsibility
Job Responsibility
  • Shape the forward-looking technical direction and long-term architecture for pillars in the Search and Data Ecosystem org
  • Collaborate with product, engineering, and design leaders to influence the broader department-level strategy
  • Ensure that the technical strategy you build is aligned with the technical strategy of Atlassian products and platforms
  • Regularly unblock challenges faced in the software development cycle, from technical design to launch
  • Lead code reviews and documentation and take on complex bug fixes, especially on high-risk problems
  • Set the standards for shipping high quality code at high velocity by improving the developer experience
  • Mentor, hire and develop other engineers
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Principal Engineering Manager - Applied AI

We are looking for a Principal Engineering Manager to join our growing Applied A...
Location
Location
United States , Seattle
Salary
Salary:
240870.00 - 297652.00 USD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in Generative AI and Agentic AI systems, including LLMs, context engineering, and modern vector-based retrieval systems
  • 4+ years working as an engineering manager
  • 8+ years working as a professional software developer
  • A great understanding of Generative AI systems, best practices and experience in shipping Agentic AI into distributed, data-intensive production systems
  • Experience developing and operating Cloud services at enterprise scale
  • Strong programming skills in Java, Python, C#, Typescript or equivalent programming language
  • Substantial depth and breadth of management experience to lead and grow an Applied AI team
  • Great collaboration with teams with different backgrounds/expertise/functions
  • Expertise in full product lifecycle
  • technical designs, project planning, iterative implementation, and successful product launches
Job Responsibility
Job Responsibility
  • Lead a team of Applied AI engineers that works at the bleeding edge of Generative AI to solve high-impact business challenges
  • Apply Generative AI to solve hard unsolved challenges in the application of Agentic AI to real-world business challenges
  • Grow, coach, build and scale the Applied AI team
  • Drive operational excellence to achieve enterprise-grade scale, reliability, security, cost-efficiency and performance
  • Drive technical direction for building a safe, scalable and reliable Agentic AI platform for all of Highspot
  • Communicate complex concepts and the results of analyses in a clear and effective manner to technical and non-technical audiences
  • Collaborate with other team members and cross-functionally to share knowledge and discuss initiatives
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Health Savings Account (HSA) with employer contribution
  • 401(k) Matching with immediate vesting on employer match
  • Flexible PTO
  • 8 paid holidays and 5 paid days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • 18 weeks paid parental leave
  • Access to Coaches and Therapists through Modern Health
  • 2 volunteer days per year
  • Commuting benefits
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer

Atlassian’s Global Experiences organization is dedicated to creating unified, se...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience in software engineering, with deep expertise in platform and product engineering at scale
  • Exceptional communication and collaboration skills
  • able to influence and partner across teams
  • Deep product engineering background, ideally with experience in platform environments at scale
  • Full stack experience preferred, or strong back-end skills with front-end capability
  • Proven ability to architect, build, and operate large-scale, distributed systems and user-facing applications
  • Strong product mindset and UX sensibility
  • Experience leading multi-year, cross-org technical initiatives that drive business outcomes
  • Passion for innovation, continuous improvement, and fostering an inclusive, high-performing engineering environment
Job Responsibility
Job Responsibility
  • Leading technical strategy and architecture for Platform Apps, ensuring solutions are robust, secure, and consistent
  • Driving innovation in user and admin experiences, including integrating AI-powered insights and advancing Atlassian’s System of Work
  • Collaborating with product, UX, and engineering leaders to define and deliver a roadmap of high-impact, standalone apps
  • Managing negotiations and dependencies across multiple teams and departments, balancing deep project involvement with platform-wide strategic thinking
  • Standardising and mechanising app development processes , transitioning from ad hoc to scalable, repeatable approaches
  • Mentoring engineers and championing engineering excellence, continuous improvement, and an inclusive culture
What we offer
What we offer
  • Flexibility: Work from anywhere Atlassian has a legal entity, with support for remote, hybrid, or in-office work
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right

Principal Engineer, AI Strategy and Innovation

Shape the architecture and execution of CLEAR’s AI platform strategy, from infra...
Location
Location
United States , New York
Salary
Salary:
250000.00 - 290000.00 USD / Year
clearme.com Logo
Clear
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years in software engineering and/or technical experience with deep expertise in AI systems, ML platforms, and data infrastructure
  • At least 5 years of experience with various AI technologies including GenAI, ML, Deep Learning, RPA or others
  • Proven ability to scale AI capabilities into high-throughput, low-latency environments
  • Strong technical background in cloud-native architectures (AWS or similar) and modern AI/ML stacks (TensorFlow/PyTorch, MLflow, RAG, MCP, etc.)
  • Experience leading AI strategy and platform adoption in enterprise-scale environments
  • Skilled at translating regulatory and compliance requirements into responsible AI practices
  • Track record of partnering closely with Product, Engineering, Analytics, and Security teams as well as business executives
  • Excellent communicator who can set a vision for AI, explain technical trade-offs, and influence executives, peers, and partners
  • Passionate about embedding AI into core products to deliver measurable impact for members and enterprise partners
Job Responsibility
Job Responsibility
  • Define and scale CLEAR’s AI strategy: spanning data pipelines, ML lifecycle management, and intelligent applications
  • Lead engineering execution for AI models (development, deployment, monitoring, retraining) with a focus on reliability, observability, and ethical AI practices
  • Modernize analytics and intelligence systems to deliver predictive insights and partner-facing transparency in real time
  • Operationalize trust in AI by embedding privacy, compliance, and security into all platforms and workflows
  • Influence cross-functional stakeholders across the business, fostering a culture of technical rigor, collaboration, and innovation, advising C Suite executives, leaders, and individual contributors
  • Lead the AI Governance group and drive best practices across business functions
  • Track and optimize KPIs on AI adoption, model performance, scalability, and business impact
What we offer
What we offer
  • Comprehensive healthcare plans
  • Family-building benefits (fertility and adoption/surrogacy support)
  • Flexible time off
  • Annual wellness stipend
  • Free OneMedical memberships for you and your dependents
  • A CLEAR Plus membership
  • A 401(k) retirement plan with employer match
  • Catered lunches every day
  • Fully stocked kitchens
  • Stipends and reimbursement programs for well-being and learning & development
  • Fulltime
Read More
Arrow Right

AI Machine Learning Principal Engineer

Our Regulatory Engineering team thrives on the challenge of operating in a compl...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
dell.com Logo
Dell
Expiration Date
March 31, 2026
Flip Icon
Requirements
Requirements
  • Requires 8+ years of related experience in a professional role with a Bachelor’s degree
  • or 6+ years with a Master’s degree
  • or 3+ years with a PhD
  • or equivalent experience
  • Knowledge on product compliance, Safety, EMC, Wireless, Telecom and Environmental (e.g. Energy, Material, ECO Labels, Accessibility, Repairability, Packaging and etc.) legislation programs will be plus
  • Track record of being an enthusiastic and effective team player with experience leading and influencing internal and external stakeholders to ensure successful outcomes
Job Responsibility
Job Responsibility
  • Apply knowledge of AI machine learning, statistics, optimization, software engineering and data engineering to produce code for testing, operationalizing and governing software-integrated machine learning models
  • Works with stakeholders including business owners, software engineers, data scientists and data engineers to align and execute end-to-end solutions which start with data collection and management, extend through machine learning methodologies and efficiencies in software engineering, and end with governance of machine learning model performance
  • Optimizes code for existing data streams, machine learning models and APIs using best practices in software engineering and experimental design
  • Defines best practices for AI ML engineering, code optimization, model and system validation and model governance and educates prospects and customers on analytics and machine learning offerings
  • Leads the design and testing of analytical technologies, or the development/testing of new algorithms/functions to enhance capabilities within key market segments of interest
  • Leads definition of machine learning and data analytics vision, multiple use-case evaluation and selection criteria, as well as project-level scope definition for customers
  • Proactively identifies gaps and collaborates with engineering teams to find solutions, while solidifying commitments to execute these
  • Drives partnerships & relationships with third parties to develop vertical/horizontal analytical solutions and product integrations
What we offer
What we offer
  • Comprehensive Healthcare Programs
  • Award Winning Financial Wellness Tools and Resources
  • Generous Leave of Absence for New Parents and Caregivers
  • Industry Leading Wellness Platform
  • Employee Assistance Program
Read More
Arrow Right

Principal AI Engineer

At JFrog, we’re reinventing DevOps to help the world’s greatest companies innova...
Location
Location
Israel , Netanya/Tel Aviv
Salary
Salary:
Not provided
jfrog.com Logo
JFrog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's degree or higher in Computer Science, Data Science, or a related field
  • Proven experience in software development
  • Proficiency in LLM-related tools, processes, and frameworks, including OpenAI Models and APIs, Hugging Face Transformers, LangChain, vector databases, and prompt management tools like PromptPerfect/PromptBase and Guardrails
  • Experience with cloud platforms, such as AWS, Google Cloud, or Azure
  • Proficiency in Python programming
  • Experience deploying LLM-based applications in a production environment
  • Excellent problem-solving and analytical skills
  • Experience with CI / CD tools
  • Strong communication skills and the ability to collaborate effectively in a team
Job Responsibility
Job Responsibility
  • Recommend and test agentic productivity tools
  • Collaborate with key organizational stakeholders to understand AI requirements and design end-to-end AI productivity solutions
  • Explore and experiment with novel ML and AI techniques and architectures to drive DevX and productivity innovation
  • Evaluate and recommend ML and AI tools and frameworks to enhance productivity and effectiveness
  • Provide technical guidance and mentorship to development teams on AI and ML technologies and practices
  • Define meaningful KPIs and closely monitor cost
Read More
Arrow Right

Senior Principal Product Manager, Confluence AI

As a Senior Principal Product Manager on the AI team for our Confluence product,...
Location
Location
United States , San Francisco
Salary
Salary:
183200.00 - 294400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in product management, with a focus on AI, machine learning, or related technologies
  • Proven track record of successfully leading cross-functional teams to deliver complex software projects and successfully iterating on functionality through experimentation
  • Strong understanding of AI and machine learning concepts, with experience in applying these technologies to real-world products and solutions
  • Excellent communication and interpersonal skills, with the ability to convey complex ideas to both technical and non-technical stakeholders
  • Demonstrated ability to thrive in fast-paced environments with high levels of ambiguity, where priorities may shift rapidly and flexibility is essential for success
Job Responsibility
Job Responsibility
  • Own the vision and roadmap for AI within Confluence
  • Act as an AI leader across Atlassian, shaping the overall product strategy and thinking of AI from your vantage point within Confluence
  • Lead a direct cross-functional team of ~60 engineers, designers, data scientists, and other discipline leads to deliver high-quality AI functionality and features to end users
  • Collaborate closely with internal Confluence teams to support the integration of AI capabilities into their feature development process, ensuring alignment with AI program goals and coherence of experiences
  • Work closely with partner teams, including central platform teams, to align on vision, strategy, and execution plans for AI initiatives across Atlassian products
  • Define key results (KRs) and metrics to measure the success and impact of AI features, and use data-driven insights to iterate and improve
  • Meet regularly with customers to gather feedback and requirements, and to obtain a deep understanding of customer pain points
  • Stay informed about industry trends, emerging technologies, and competitive landscape related to AI and machine learning, and leverage this knowledge to drive innovation within Confluence
  • Act as a subject matter expert on AI technologies and methodologies, providing guidance and mentorship to team members and stakeholders
  • Communicate effectively with stakeholders at all levels of the organization, including executive leadership
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right