Embedded Compiler Engineer

Who we are

Latent AI believes in a vibrant and sustainable future driven by the power of AI. Our mission is to enable the vast potential of AI that is efficient, practical and useful.

We are a diverse, ambitious team of scientists, engineers, entrepreneurs and visionaries revolutionizing how the next generation AI systems are built. We are deeply passionate about the future of AI, our work, and how we can make our customers and ourselves successful. We value mentorship, personal and professional growth at Latent AI! Our leadership consists of seasoned professionals who welcome the opportunity to share their knowledge and experience with a motivated team willing to learn, collaborate, and think big. 

Latent AI is backed by Future Ventures, Blackhorn Ventures, Auto Tech Ventures, Booz Allen Hamilton,  Lockheed Martin, Standard Investments, Pegasus Tech Ventures, and SRI International.

What we do

Latent AI enables creation of more robust, efficient, and agile edge applications that improve user adoption and mission impact.Our current product mission is simplifying and accelerating traditional AI workflows from model training and optimization to deployment and support. Our flagship product, the Latent AI Efficient Inference Platform™ (LEIP), is a unified SDK built for machine learning engineers and AI software developers. Our solutions are being used in more places than ever before including manufacturing automation, predictive maintenance, process control, consumer electronics, and defense and aerospace applications. And we are just getting started.

Who we're looking for

We are looking for an embedded software engineer with experience delivering machine learning applications on embedded platforms.  The ideal candidate will be. familiar with common compiler technologies targeting embedded platforms such as handheld devices and a willingness to learn environments such as the Android NDK. 

What you’ll do

The Embedded Compiler Engineer will:

• Optimize Latent AI Compiler and Runtime Framework components to deliver highly optimized machine learning models on mobile and embedded devices.
• Integrate and extend compiler technologies for maximum performance on CPU, GPU (Adreno, Nvidia and others) and DSP.
• Develop components for efficient Machine Learning integration into ATAK environments

How we decide

We are a true team focused on the same mission. Our interviews are designed to be collaborative, where you learn as much about us as we learn about you. We believe that cultural fit is as important to our success as the technical one. The winning candidate will also have a combination of work experience and expertise that aligns with the requirements listed below: 

Key Qualifications

• 2+ years experience developing production quality compilers, tools or similar system software
• Experience using ML frameworks (Pytorch, Tensorflow)
• Fluent in C/C++ and Java (including JNI).
• Comfortable using, creating and linking external C based libraries
• Familiar with ML datatypes (e.g. DLTensors, NumPy tensors, libTorch tensors)
• Experience with libraries such as libTorch, OpenCV and/or OpenCL
• Excellent verbal and written communication skills
• Proven ability to multitask on several projects concurrently
• Computer science, electrical engineering degree or related experience
• Location: Princeton, NJ or willingness to travel

Preferred Qualifications

• Experience with TVM, LLVM, MLIR or GLOW
• Knowledge of Android Neural Network API (NNAPI)
• Familiar with Python
• Experience with distributed systems and cloud (AWS, Azure, GCP)
• Advanced degree in Computer Science or Engineering

Latent AI provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, sex or gender, gender identity or expression, sexual orientation, national origin, ancestry, age, genetic information, physical or mental disability, marital or protected military or veteran status, or any other consideration made unlawful by federal, state, or local laws.

Note to Recruiters and Placement Agencies: Latent AI does not accept unsolicited agency resumes. Latent AI will not be responsible for any agency fees associated with unsolicited resumes.