Principal Software Engineer - Rack Management

  • Santa Clara, CA, USA
  • Aug 02, 2023
Full-time Artificial Intelligence (AI) C++ Computer Science Data Architecture Product Development Programming Project Management Python Quality Assurance (QA) Software Engineering

Job Description

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and establish teams with the most thoughtful people in the world.

NVIDIA GH200 superchip provides performance and productivity required for strong scaling for HPC and generative AI workload. Scale out is inherent to design of this massive superchip. We are looking for expert engineers to come and help design rack level solutions for next generation scaling AI supercomputing platforms. Join us at the forefront of technological advancement.

What you’ll be doing:

  • Drive next generation rack management solution for scaling AI infrastructure using GPUs and GH200 solution from NVIDIA
  • Work with customers, product management and other architects to narrow down on requirements for implementation to ensure speed of light product development
  • Partner with customers and other architects, understand their requirements: Identify which is best way Build Rack Manager, integrate management APIs for DC stack at rack level and define NV strategy for managing rack level solution
  • Detailed architecture, do POCs to validate architecture. Educate customers about product architecture and take feedback to make necessary changes
  • Write architecture specs, design documents and own end to end delivery of product by working across the teams. Do code review for the code produced as a result of architecture specs
  • Ensure product is properly tested by working with the development team to enhance unit testing and proper test plan in place. Drive product life cycles with QA teams to productize the code, and be responsible as a product owner
  • Articulate requirements as part of Jira and bug management tools and work out an end to end execution plan in collaboration with other managers
  • Contribute to all phases of product development, from product definition and architecture and design, through implementation, debugging, testing and early customer support

What we need to see:

  • 15+ years of relevant experience building rack or server management solutions
  • BS, MS, or PhD in EE/CS or related field of education or equivalent experience
  • Proven record of delivering rack management solutions for large data centers
  • Strong knowledge of data center management, server architecture and server manageability in data centers
  • Strong and demonstrable skill in C/C++ and Python
  • Experience programming and debugging skills for server platforms
  • Experience in SCM (e.g. Git, Perforce) and project management tools like Jira
  • You should possess excellent written and oral communication skills, good work ethics, high sense of team-work, love to produce quality work and commitment to finish your tasks every single day
  • You are a self-starter who loves to find creative solutions to complicated problems and hands on with coding

Ways to stand out from the crowd:

  • Active OCP and DMTF contributor in relevant areas. Worked on OpenRMC or related rack management projects
  • Hands on with x86 or ARM system architecture. Familiar with processor microarchitecture such as caches, pipelining, memory hierarchy, and instruction set architecture (ISA)
  • Experience with code coverage and static analysis tools

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is $268,000 - $414,000. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Job ID



$268,000 - $414,000