Staff Software Engineer - CUDA/C++

**NOTE: We are open to REMOTE candidates in the Eastern or Central time zone at this time. 

Meet the team: 

Meet the Inference Engine Team: At the forefront of innovation, our team delivers a cutting-edge software SDK designed to fine-tune deep learning frameworks for embedded chips. We're dedicated to optimizing performance, ensuring that our solutions drive the maximum efficiency of AI applications on embedded systems. Our expertise lies in bridging the gap between advanced deep learning technologies and the unique demands of embedded environments, making AI more accessible and effective in real-world applications. Join us in pushing the boundaries of embedded AI.

What you'll do: 

• Design and implement highly efficient algorithms optimized for NVIDIA GPUs
• Leverage data parallelism and CUDA programming to accelerate deep learning inference (TensorRT), achieving significant performance gains
• Analyze and optimize CUDA kernels using profiling and optimization tools, identifying and eliminating performance bottlenecks
• Contribute to the development of internal tools and libraries to further enhance inference performance on GPUs
• Document your work clearly and concisely, sharing knowledge effectively with team members

What you’ll need to Succeed: 

• Bachelor's degree in computer science, data science, artificial intelligence, or related field with 10+ years of professional experience or a master's degree with 7+ years of experience 
• Mastery of Modern C++ (14 or more recent) and Python, with the ability to write efficient and maintainable code for both performance and flexibility
• Familiarity with object-oriented software design patterns, and their implementation in C++
• In-depth knowledge of CUDA programming and experience with optimizing CUDA kernels
• Excellent understanding of parallel computing (GPGPU) and high-performance (HPC) concepts 
• Excel at working in a highly collaborative environment 
• Familiarity with AGILE development practices 
• Comfortable using collaborative development tools such as Git and Jira
• Ability to adhere to company coding standards
• Proven dedication to writing production-quality code that is robust, efficient, portable, maintainable, and bug-free

Bonus points! 

• PhD with 5+ years of experience 
• Experience working on safety critical systems 
• Experience with other relevant NVIDIA libraries and frameworks, such as CUBLAS, CuDNN, and NPP
• Deep Learning frameworks such as TensorFlow, PyTorch, or Caffe
• Stay abreast of the latest advancements in deep learning frameworks like TensorFlow and PyTorch, maximizing their potential on GPUs

Perks of Being a Full-time Torc’r 

Torc cares about our team members and we strive to provide benefits and resources to support their health, work/life balance, and future. Our culture is collaborative, energetic, and team focused. Torc offers:    

• A competitive compensation package that includes a bonus component and stock options  
• 100% paid medical, dental, and vision premiums for full-time employees    
• 401K plan with a 6% employer match  
• Flexibility in schedule and generous paid vacation (available immediately after start date) 
• Company-wide holiday office closures  
• AD+D and Life Insurance