Scale-out Engineer

We're seeking a skilled AI Scale-Out Software Engineer to build and optimize our Tenstorrent scale-out fabric (TT-fabric) for distributed inference and training infrastructure. The ideal candidate will have expertise in deep learning, distributed systems, and low-level networking.

This role is hybrid, based out of Santa Clara, CA; Austin, TX; or Toronto, ON.

Responsibilities:

• Design, develop, and maintain TT-fabric, a low-level networking library for Tenstorrent AI processors built on top of Ethernet protocol
• Design and implement efficient distributed training systems for large-scale deep learning models
• Optimize network communication for multi-node AI processor clusters
• Tune system performance for inference and training of key AI models
• Work in the TT-Metalium team and integrate scale-out APIs into the Programming Model
• Work with AI model builder and researchers to improve both the scale out infrastructure and as well as model design

Experience & Qualifications:

• • Bachelor's or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • Proven experience in low-level software development.
  • Strong proficiency in programming languages such as C / C++.
  • Experience with MPI or similar distributed computing frameworks
  • Experience with low-level networking libraries (e.g., libfabric, libibverbs)
  • Knowledge of networking protocols, especially Ethernet and InfiniBand
  • Knowledge of high-performance interconnects
  • Familiarity with RDMA programming
  • Familiarity with large-scale deep learning frameworks (e.g., PyTorch, TensorFlow)
  • Familiarity with network offload engines and SmartNICs
  • Strong communication skills and the ability to work effectively with cross-functional teams.
  • Passion for technology and a commitment to pushing the boundaries of what is possible in AI.

Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets. Experience, skills, education, background and location all impact the actual offer made.

Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.

Due to U.S. Export Control laws and regulations, Tenstorrent is required to ensure compliance with licensing regulations when transferring technology to nationals of certain countries that have been licensing conditions set  by the U.S. government.

Our engineering positions and certain engineering support positions require access to information, systems, or technologies that are subject to U.S. Export Control laws and regulations, please note that citizenship/permanent residency, asylee and refugee information and/or documentation will be required and considered as Tenstorrent moves through the employment process.

If a U.S. export license is required, employment will not begin until a license with acceptable conditions is granted by the U.S. government.  If a U.S. export license with acceptable conditions is not granted by the U.S. government, then the offer of employment will be rescinded.