CrawlJobs Logo

Senior AI Hardware Architect

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Mountain View

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

119800.00 - 234700.00 USD / Year

Job Description:

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live. We are seeking a Senior AI Hardware Architect to join the AI Systems Architecture (ASA) group, where we define, analyze, and optimize next-generation AI accelerator platforms and large-scale inference and training systems. In this role, you will lead performance analysis, profiling, kernel-level optimization, and end-to-end performance characterization across GPU and accelerator architectures, working across hardware, software, and system boundaries. You will analyze real-world AI workloads across modern GPU platforms and in-house AI accelerators, identifying performance bottlenecks and architectural trade-offs through rigorous measurement and benchmarking. A key aspect of this role is correlating on-silicon measurements, software traces, and kernel execution behavior with architectural models and simulators, enabling deep insight into performance behavior and guiding data-driven architectural decisions. You will collaborate closely with architecture, microarchitecture, compiler, runtime, and systems teams, and contribute to the development of data correlation, analysis, and visualization tools that improve performance insight and optimization velocity. Through quantitative analysis and cross-platform understanding, you will play a critical role in shaping future accelerator and system architectures across the AI hardware and software stack.

Job Responsibility:

  • Lead performance analysis, profiling, and benchmarking across GPU and in-house AI accelerator architectures, applying rigorous data and statistical analysis to identify complex performance bottlenecks, root causes, and optimization opportunities across hardware, software, and system layers
  • Run and analyze end-to-end AI models on production-like serving infrastructure, performing deep dives into modern AI serving stacks (e.g., optimized LLM serving frameworks, schedulers, runtimes, and memory management systems) to understand performance behavior, scalability limits, and system-level trade-offs
  • Provide data-driven recommendations and architectural trade-offs to senior technical leadership, balancing performance, complexity, cost, quality, reliability, and development timelines to inform accelerator and system architecture decisions
  • Develop and implement technical solutions to complex performance, quality, and design challenges, including kernel-level optimization, architectural tuning, and system-level performance improvements across multiple products or feature areas
  • Correlate on-silicon measurements, software traces, and kernel execution behavior with architectural models and simulators, ensuring alignment between measured performance and architectural intent, and identifying gaps that drive future design enhancements
  • Design, build, and evolve data correlation, analysis, and visualization tools and workflows that scale performance insight, accelerate debugging, and improve clarity and communication of optimization opportunities across teams
  • Lead and contribute to design and performance documentation, including architecture reviews, performance reports, functional specifications, and customized analyses
  • communicate progress, risks, and recommendations within and across teams, and help identify and mitigate significant project risks

Requirements:

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 3+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 5+ years technical engineering experience OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements for this role
  • Passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have:

  • Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 3+ years technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 6+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience
  • MS or PhD in Machine Learning, Computer Architecture/Systems, Electrical Engineering, High-Performance Computing, or related areas
  • 4+ years of experience in Computer Architecture, AI Systems, or closely related technical domains
  • Experience with GPU and AI accelerator architectures, including compute pipelines, memory hierarchies, interconnects, and parallel execution models
  • Demonstrated expertise in performance profiling, benchmarking, and root-cause analysis, using hardware performance counters, software traces, and workload-level measurements
  • Hands-on experience with kernel-level performance analysis and optimization, and correlating kernel behavior with architectural and system-level performance
  • Strong programming and scripting skills in Python and C/C++ for performance analysis, tooling, benchmarking, and automation
  • Experience with architectural modeling or simulators and correlating modeled behavior with measured hardware performance
  • Experience running and analyzing end-to-end AI models on serving or training infrastructure, with the ability to diagnose performance issues across hardware, runtime, and system layers
  • Hands-on experience with AI frameworks and runtimes, including PyTorch, and familiarity with modern AI serving stacks such as vLLM and SGLang frameworks
  • Ability to communicate complex technical concepts clearly through design documentation, performance reports, functional specifications, and technical presentations

Additional Information:

Job Posted:
February 13, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AI Hardware Architect

Senior Solution Architect AI & HPC

AI is a high-growth market for HPE, and we believe we are uniquely suited to bri...
Location
Location
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Engineering, Computer Science, or similar quantitative focus preferred
  • Ability to quickly prototype functionality into scripts for demos, integrations, troubleshooting, etc.
  • Expertise in cloud architectures, specifically with public cloud platforms such as AWS, Azure, or Google Cloud
  • Strong understanding of AI technologies, including machine learning, deep learning, and neural networks
  • Experience participating in solution configurations and the creation of PoCs to meet customer requirements
  • Solid knowledge of infrastructure components, including servers, storage, networking, and virtualization
  • Experience with high-performance computing (HPC) and GPU-accelerated systems is advantageous
  • Demonstrates expert technical skills in assigned area of specialization
  • Expert knowledge of the company offerings, strategic initiatives, current trends, competitor products and strategies within area of responsibility
  • Expert level written and verbal communication skills and mastery over English and local language
Job Responsibility
Job Responsibility
  • Collaborate with sales teams to understand customer requirements and develop tailored solutions for their AI infrastructure needs
  • Engage in pre-sales activities, including technical presentations, demonstrations, and proof-of-concepts
  • Act as a trusted advisor to customers, addressing their questions, concerns, and technical challenges effectively
  • Stay up-to-date with the latest advancements in AI technologies, cloud architectures, and infrastructure trends
  • Lead Proof-of-Concepts (PoC) for HPE customers expanding into Deep Learning or Machine Learning use cases
  • Architect reusable end-to-end AI solutions for HPE customers and prospects
  • Lead technical discussions with customers and partners to propose HPE and partner Integrated solutions
  • Identify solutions, define action plans, and help coordinate and deliver optimal solutions and enhancements
  • Recommend configurations and settings for different types of hardware and interconnect fabrics
  • Assist in any product or technical issue towards an initial sale or renewal of a customer
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Director Product Management (Artificial Intelligence Hardware)

Do you want to be at the forefront of innovating the latest hardware designs to ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/project/program management or software development OR equivalent experience
  • 3+ years of experience working on AI systems as an architect or a product manager
  • 7+ years of technical product management experience, including products within datacenter Hardware systems and/or Cloud infrastructure
  • 7+ years experience creating product roadmap(s) from conception to launch, driving end-to-end program execution, defining product go-to-market strategy, and leading program direction discussions
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Collaborate with customers and partner organizations to define future generations of Artificial Intelligence (AI) Hardware for Azure at Microsoft
  • Lead the strategic product vision, roadmap and product requirements for our next generations of AI hardware platforms
  • Identify and prioritize customer needs, market opportunities, and competitive gaps, and translate them into clear and actionable product requirements and specifications
  • Drive executive decision making for new investments, including competitive analysis, program goals and business requirements, architectural concepts, risk management strategies, financial analysis, schedule and hardware strategy
  • Lead technical programs from concept to execution, collaborating with architecture, engineering and business teams to develop and drive end-to-end product development
  • Develop and maintain a high level of technical proficiency in AI workload requirements, AI technology landscape and AI Industry roadmaps
  • Engage with senior leadership, highlighting risks across functional teams and providing recommendations to support product level decisions
  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate
  • Fulltime
Read More
Arrow Right

Senior AI Software Architect

Do you want to be at the forefront of innovating the latest hardware designs to ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Port and optimize large-scale AI models (e.g., foundation models, diffusion models, YOLO) to run efficiently on Maia hardware
  • Integrate models using frameworks such as PyTorch, ONNX, vLLM, and SGLang
  • Apply techniques like KV cache quantization (e.g., BF16 → FP8), checkpointing, and re-sharding for efficient inference and training
  • Experiment with parallelism strategies (TP, PP) and analyze performance impacts across interconnects (NVLink vs PCIe)
  • Collaborate on improving inference pipelines, including KV caching in sglang/vllm and performance tuning at the PyTorch level
  • Work with Triton kernels for basic operations (e.g., FP8 dequantization) and assist in kernel performance analysis
  • Partner with hardware architects and kernel developers for co-design discussions
  • Communicate effectively with multiple stakeholders to align on performance goals and deliverables
  • Fulltime
Read More
Arrow Right

Senior Camera System Architect

The Surface team is lighting up Microsoft experiences with the next generation o...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Electrical Engineering, Computer Engineering, or related field AND 3+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, or related field AND 5+ years technical engineering experience OR equivalent experience
  • Experience with PC or mobile camera systems
  • Expert knowledge of image capture and image signal processing design (ISP)
  • Knowledge of Complementary Metal-Oxide-Semiconductor(CMOS) image sensors and lenses
  • Experience delivering high performance imaging systems in a high-volume consumer product
  • Excellent interpersonal skills and cross-group collaboration
Job Responsibility
Job Responsibility
  • Own delivery of camera solutions as a product’s lead camera system engineer
  • Design and develop end-to-end camera systems, integrating sensors, optics, ISP pipelines, and AI-based imaging algorithms
  • Collaborate with cross-functional teams (hardware, software, product) to define camera system requirements and performance targets
  • Work with silicon partners to understand ISP capability of selected platforms and to influence and define ISP roadmaps
  • Contribute to the camera team’s development of a multi-year camera roadmap for sensors and customer experiences that spans the business roadmap
  • Stay up-to-date with the latest advancements in imaging AI, camera hardware, and power-efficient computing
  • Fulltime
Read More
Arrow Right
New

Principal Hardware Technical Program Management - Quantum

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, physics or a related STEM field, product/technical program management, data analysis, or product development OR equivalent experience.
  • 3+ years of experience managing large-scale, interdisciplinary hardware technology projects from concept to delivery, including system integration, cross-functional team leadership, and coordination across multiple teams.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Ability to work in an “AI-first” environment using modern AI tools to accelerate discovery through both hardware and software development.
  • Ability to design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval.
Job Responsibility
Job Responsibility
  • Program Management: Lead all phases of quantum hardware projects, from concept to delivery, working closely with architects, scientists, and engineers for success. Create concise, data-driven updates on program status, risks, dependencies, and impact for stakeholders and senior executives.
  • Planning & Roadmapping: Coordinate with leadership and engineering teams to build and maintain clear development roadmaps, align milestones, manage resources, and support long-term goals. Guide Agile processes, encourage transparency, and remove obstacles to meet critical deadlines.
  • Team Coordination: Ensure effective collaboration across device physics, cryoelectronic, materials science, manufacturing, supply chain, integration, and cloud hardware operations for scalable solutions.
  • Customer Feedback: Use input from internal and pilot customers to improve hardware and processes. This includes potential customers from US Government.
  • Risk Mitigation: Identify and reduce risks in technology, scheduling, and operations, applying continuous improvement throughout.
  • Supplier Relations: Manage external partnerships, enforce quality and safety standards, and drive cross-company compliance.
  • Culture & Mentorship: Foster respect, collaboration, integrity, inclusivity, and continuous learning within the team.
  • Other: Embody our Culture and Values.
  • Fulltime
Read More
Arrow Right

Senior Networking Software Engineer

We are looking for a Senior Networking Software Engineer to take a key role in d...
Location
Location
Poland , Kraków
Salary
Salary:
Not provided
onhires.com Logo
OnHires
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BSc or MSc in Computer Science, Computer Engineering, or Electrical Engineering
  • Strong hands-on experience in C
  • Solid experience with Linux networking and networking protocols
  • Experience with embedded systems and HW–SW integration
  • 5+ years of relevant software / system-level engineering experience
Job Responsibility
Job Responsibility
  • Design and implement networking software for a custom AI SoC
  • Develop Linux networking components and performance-critical data paths
  • Participate in SoC architecture discussions and definition of HW–SW interfaces
  • Work on embedded Linux and embedded cores in a high-throughput, multi-threaded environment
  • Support pre-silicon validation, bring-up, and post-silicon development
  • Collaborate with firmware, hardware, and system architects
  • Fulltime
Read More
Arrow Right

Senior Specialist IT AV Technology

Our IT team plays a critical role in enabling collaboration and innovation acros...
Location
Location
United States of America , Somerville
Salary
Salary:
82000.00 - 111315.00 USD / Year
about.puma.com Logo
Puma Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7+ years in enterprise AV/UC environments, with at least 3 years in a senior or architect-level role
  • CTS-D or CTS-I (AVIXA), Crestron Certified Programmer, Cisco Collaboration certifications, ITIL
  • Deep expertise in AV-over-IP, video codecs, DSP programming, and network protocols
  • Hands-on experience with Microsoft Teams Rooms, Zoom Rooms, Polycom, Cisco Webex
  • Working knowledge of video production and audio mixing software (e.g., editing platforms, virtual audio mixers, and sound‑design tools) to support high‑quality multimedia content creation and live event streams
  • Strong leadership, vendor management, and executive communication skills
  • Bachelor’s in Computer Science, Electrical Engineering, or related field
Job Responsibility
Job Responsibility
  • Architect and implement enterprise AV solutions for conference rooms, executive boardrooms, showrooms and event spaces
  • Define AV standards, governance, and lifecycle management strategies
  • Evaluate emerging technologies (AR/VR collaboration, AI-driven AV analytics, unified communication hardware and software) for adoption
  • Configure and manage AV control systems (Crestron, AMX), video conferencing platforms (Microsoft Teams Rooms), and integrated collaboration tools
  • Oversee AV network integration, QoS, and security compliance
  • Perform troubleshooting for complex AV and unified communications issues
  • Primary technical contact for in-office digital signage (AppSpace & Vidari)
  • Lead AV infrastructure projects from concept to deployment, including budgeting, vendor selection, and risk management
  • Coordinate global rollouts of AV standards and technologies
  • Collaborate with remote IT, end users and vendors on events like regional town halls, sales meetings, product launch events
What we offer
What we offer
  • Bonus
  • Benefits
  • Fulltime
Read More
Arrow Right

Senior Performance Architect

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the...
Location
Location
United States , Hillsboro
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 1+ year(s) technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 4+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 5+ years technical engineering experience OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • 3+ years of experience developing SOC or IP performance models and benchmarks from conception to microarchitecture specification
  • Deep understanding of computer architecture, System on Chip (SOC) and system-software architectures, and their performance tradeoffs
  • Significant understanding of input/output (I/O), memory subsystems, coherency flows, interconnect, Quality of Service (QoS) traffic
  • Excellent communication, collaboration and teamwork skills and ability to contribute to diverse and inclusive teams
Job Responsibility
Job Responsibility
  • Develop performance modeling methodologies by creating and owning System on Chip (SOC) / Intellectual Property (IP) cycle-accurate/approximate performance models and analysis tools in C++ and Python
  • Use workload information and working with Micro-architects and Register Transfer Level (RTL) team to identify performance bottlenecks
  • Collaborate across functionally to propose architectural/microarchitectural changes and provide the required quantitative justification
  • Leverage AI tools and infrastructure for comprehensive performance modeling, including coding, performance tuning, analysis
  • Verify the correlation of the SOC performance models to the RTL implementation
  • Work closely with the product architecture System On Chip (SOC) architecture teams, IP architecture, to ensure our SOC and IPs enable performant, efficient, and industry-leading systems
  • Demonstrate Microsoft core values: Customer Focus, Adaptability, Collaboration, Growth Mindset, Drive for Results, Influence for Impact, Judgement, and Diversity & Inclusion
  • Fulltime
Read More
Arrow Right