Senior Software Engineer - AI Inference
USonsitesenior
Posted today · via Workday
About this role
NVIDIA is the platform upon which every new AI‑powered application is built. We are seeking a Senior Software Engineer – AI Inference to advance open‑source LLM serving by contributing directly to upstream inference engines like vLLM and SGLang-ensuring they run best‑in‑class on NVIDIA GPUs and systems-and by improving the underlying stack that enables high‑throughput, low‑latency inference at scale. This is a hands-on role for an engineer who enjoys digging into performance bottlenecks, designing pragmatic runtime improvements, and shipping high‑quality changes that are broadly useful to the community and production deployments.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, c++, pytorch, teams
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in US. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonc++pytorchteams
More at Nvidia
- View →Senior CUDA Technical Marketing Engineer6 Locations
- View →Formal Verification EngineerIsrael, Yokneam
- View →Deep Learning Performance ArchitectChina, Shanghai
- View →Firmware EngineerChina, Beijing
- View →Senior CUDA Test Development Software Engineer, SDETChina, Shanghai
- View →Senior Signal and Power Integrity Engineer - HardwareUS, CA, Santa Clara