Senior Software Engineer, LLM

Our growing company is actively seeking a highly-skilled Large Language Model (LLM) Engineer to join our team. This role will have you directly involved in the design and development of state-of-the-art LLM-based algorithms and systems that power our conversational AI applications. If you possess a passion for pushing the boundaries of LLM technologies and have relevant LLM experience, we would love to connect.

Your Impact

• Spearhead the design, development and optimization of robust, scalable systems and infrastructure for deploying pioneering algorithms and systems based on large language models.
• Conduct research and rapidly prototype neural network architectures, training pipelines, inference servers, etc., ensuring we continually stay a step ahead in serving production workloads.
• Benchmark and profile diverse software/hardware configurations, striving for optimal model performance. 
• Drive implementation of model optimizations for a more scalable and cost effective LLM system.
• Collaborate closely with our team of research engineers to streamline the transition of machine learning models and algorithms into production.
• Monitor and incessantly enhance system efficiency, latency, throughput and more.

We're looking for someone who

• A Masters Degree in Computer Science or a related technical discipline, PhD is a plus.
• 5+ years of demonstrated experience in the construction and optimization of AI/NLP infrastructure and pipelines.
• Proficiency in Python and experience with frameworks like PyTorch/TensorFlow.
• Experience working with existing large language models is highly desirable.
• Superior system design and analytical abilities, with an eye for problem-solving.
• Demonstrated capacity to deliver in a high-velocity, dynamic environment.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.