Job Description:
Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live. We are seeking a Senior AI Hardware Architect to join the AI Systems Architecture (ASA) group, where we define, analyze, and optimize next-generation AI accelerator platforms and large-scale inference and training systems. In this role, you will lead performance analysis, profiling, kernel-level optimization, and end-to-end performance characterization across GPU and accelerator architectures, working across hardware, software, and system boundaries. You will analyze real-world AI workloads across modern GPU platforms and in-house AI accelerators, identifying performance bottlenecks and architectural trade-offs through rigorous measurement and benchmarking. A key aspect of this role is correlating on-silicon measurements, software traces, and kernel execution behavior with architectural models and simulators, enabling deep insight into performance behavior and guiding data-driven architectural decisions. You will collaborate closely with architecture, microarchitecture, compiler, runtime, and systems teams, and contribute to the development of data correlation, analysis, and visualization tools that improve performance insight and optimization velocity. Through quantitative analysis and cross-platform understanding, you will play a critical role in shaping future accelerator and system architectures across the AI hardware and software stack.