N
NVIDIA
AI Engineer

Senior Hardware Architect Artificial Intelligence

On-siteStaffAI Engineerposted 1mo ago
✦Role summaryAI-generated

This role leads the design of AI-powered hardware architectures for NVIDIA’s networking platforms, blending deep hardware expertise with cutting-edge AI/ML to automate tradeoff exploration and validation. The incumbent will shape agentic workflows, collaborate with AI engineering teams, and establish technical standards for AI-driven architectural innovation across NIC and switch development.

Skills required

About this role

NVIDIA is building some of the most sophisticated semiconductor platforms globally, powering breakthroughs in networking, AI infrastructure, and high-performance computing. Our NICs and Switches link the largest AI clusters worldwide. Powered by the AI revolution we are changing how hardware architecture work happens!

We strive to define and implement this new agentic hardware architecture, and we are seeking an experienced architecture lead for our AI-for-Architecture team within the Networking Architecture group. You will define and promote intelligent architecture flows across our NIC and Switch architecture groups. You will develop the agents, tools, and processes that transform how architects explore design tradeoffs, and validate models and specifications. In this leadership role with org-wide scope, you will collaborate with an AI engineering team to develop flows from concept to production. You will also serve as the technical authority on what good AI architecture work means at NVIDIA.

What You'll Be Doing:

  • Define the roadmap for AI-driven architecture flows — from data collection, modelling and micro-architecture agents that help architects explore feature options, to review and validation agents that set the standard for output quality.
  • Work with architects on tough problems, suggest and build agentic flows to address these problems and shorten the time to a good solution.
  • Partner with the AI engineering pod to translate architecture workflows into production agents, MCP integrations, and eval harnesses.
  • Act as the domain authority and quality judge: recognize what excellent architecture output looks like and verify that AI-assisted flows meet that bar.
  • Drive adoption: work with networking architects, run beta cycles, close feedback loops and facilitate widespread usage of our tools/methods.
  • Represent the team's technical direction to senior architecture and product leadership.

What We Need to See:

  • B.A, M.Sc. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.
  • 6+ years in hardware, firmware, or system architecture — NIC, switch, DPU, CPU, or SoC. Experience with architectural workflows defining microarchitecture specs, performance models, or architecture decision documents, etc..
  • Ability to understand and adopt agentic AI workflows and tools (Claude/Codex/Cursor).
  • Engineering committed to quality — for example, the ability to judge AI output quality for architecture tasks and suggest validation-fix strategies to improve it.
  • Strong interpersonal skills — explain AI flows for architects lacking AI engineering expertise, and distill hardware architecture trade-offs for engineers without architectural backgrounds.
  • Consistent track record driving adoption of new tools or processes across a technical organization.

Ways to Stand Out from the Crowd:

  • Hands-on experience applying LLMs, agents, or prompt-plus-code pipelines to real engineering work.
  • Expertise with high-speed networking silicon — InfiniBand, Ethernet, switch fabric architecture, NIC/RDMA subsystems.
  • Familiarity with LLMs: transformer architecture (attention, MLP, MoE) and LLM training/inference parallelism (DP, PP, EP, TP).
  • Background defining and measuring engineering productivity metrics — making the impact or our work visible to leadership.
  • Track record shipping internal platform tools or developer-experience infrastructure at scale.

NVIDIA's architecture teams are among the most technically demanding in the industry. If you're a senior architect who has already started using AI — and wants to institutionalize that change across an entire organization — we want to hear from you.

Apply on NVIDIA →Opens in new tab
score your resume against this role

Similar open roles

A
NEW

Director Of AI Engineering

Actalent·Morrisville,NC,27560,USA
HybridStaffAI Engineer
$475k – $600k USD
yesterday
JC
NEW

Sr. Lead Software Engineer - AWS/AI Engineer

JPMorgan Chase·Columbus, OH, United States
On-siteSeniorAI Engineer
2d ago
JC
NEW

Applied AI ML Lead-AI Engineer

JPMorgan Chase·Bengaluru, Karnataka, India
On-siteSeniorAI Engineer
2d ago
JC
NEW

Applied AI/ML Lead

JPMorgan Chase·Jersey City, NJ, United States
On-siteSeniorAI Engineer
2d ago
E
NEW

Manager, RAG/LLM Specialist

EXL·Gurugram, Haryana, India
On-siteSeniorAI Engineer
2d ago
E
NEW

Gen AI Engineer

EXL·Noida, Uttar Pradesh, India
On-siteMidAI Engineer
2d ago
Apply on NVIDIA →