Senior Software Architect, AI Networking
NVIDIATel-Aviv, Tel-Aviv District, Israel • North District, Israel
Posted November 12, 2025
Full Time
About the Company
NVIDIA is widely considered one of the most desirable places to work in tech – we are passionate about what we do and are committed to fostering a culture of excellence, innovation, and collaboration.
Job Description
NVIDIA is seeking a Senior Software Architect to help shape the future of LLM inference at scale. Join our dynamic E2E Architecture group and work across software and hardware domains to design and optimize inference infrastructure for large language models.
Requirements
- Bachelor's, Master's, or PhD in Computer Science, Electrical Engineering, or equivalent experience
- 8+ years of experience building large-scale distributed systems or performance-critical software
- Deep understanding of deep learning systems, GPU acceleration, and AI model execution flows and/or high performance networking
- Solid software engineering skills in C++ and/or Python, preferably demonstrate strong familiarity with CUDA or similar platforms
- Strong system-level thinking across memory, networking, scheduling, and compute orchestration
- Excellent communication skills and ability to collaborate across diverse technical domains
Benefits
- Competitive salary
- Stock options
- Medical, dental, and vision benefits
- 401(k) matching
- Paid time off