Two rounds. Both technical and some coding at the end. The technical questions are related to the CV. In my case, things like variations of transformers, GNNs, DDP etc. They asked me to explain some of my research papers too. At the end, they asked me to code a NN from scratch.
Interview questions [1]
Question 1
What is difference between gradient checkpointing and gradient accumulation ?
I applied through other source. I interviewed at NVIDIA
Interview
Tl;dr: Long interview process, very intellectually stimulating discussions, no offer due to internal restructuring.
The interviewers were experts in the various skill areas required for the job, and they asked abstract, open questions. Each interviewer seemed highly qualified. Each interview was therefore an interesting discussion.
At the end, the recruiter informed me that due to some internal restructuring, the position had to be cancelled.
Interview questions [1]
Question 1
How to accelerate and parallelize prefix-sum (exclusive scan) computation on the GPU?
I applied through an employee referral. The process took 4 weeks. I interviewed at NVIDIA (Santa Clara, CA) in Mar 2025
Interview
Several rounds:
Round 1: with the Hiring VP
Round 2: with members of the team
Round 3: with cross-functional leaders.
The executive round was disappointing, From the start, the interviewer was quite rude, reading e-mail on his phone the entire time. half the time challenging, half the time not listening.