Sr LLM Engineer

Jobgether · India

Company

Jobgether

Location

India

Type

Full Time

Job Description

Team: IT

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Sr LLM Engineer in India.

This role is designed for a senior-level AI/ML professional with strong expertise in Large Language Models and Generative AI systems. You will play a key role in designing, building, and optimizing LLM-powered applications that solve real-world business problems at scale. The position involves working across the full AI lifecycle, from model experimentation and prompt engineering to production deployment and monitoring. You will contribute to the development of intelligent systems leveraging techniques such as RAG, agents, and advanced prompting strategies. In this role, you will also help define technical direction, guiding engineering teams toward scalable and efficient AI solutions. Working in a remote, long-term contract setup, you will collaborate closely with cross-functional stakeholders, including business experts and technical teams, to translate requirements into robust AI-driven products. Your work will directly influence the evolution of next-generation AI capabilities within the organization.

Accountabilities:

You will be responsible for designing, building, and optimizing LLM-based systems while contributing to the technical direction of AI initiatives. The role combines hands-on engineering with architectural and leadership responsibilities.

  • Design and develop LLM-powered applications using modern Generative AI techniques such as prompt engineering, RAG, and agent-based systems.
  • Build scalable machine learning and AI pipelines to support production-grade deployment of LLM solutions.
  • Contribute to defining and executing the technical roadmap for AI/ML initiatives, guiding engineering efforts toward best practices.
  • Develop robust backend systems using Python and SQL to support data processing and model integration workflows.
  • Leverage LangChain and related frameworks to orchestrate LLM workflows and multi-step reasoning systems.
  • Work with cloud platforms such as Azure, AWS, or GCP to deploy and manage scalable AI services.
  • Collaborate with business stakeholders and SMEs to translate requirements into technical AI solutions.
  • Ensure performance, reliability, and scalability of deployed LLM-based systems in production environments.
  • Requirements:

    The ideal candidate is a senior AI engineer with strong experience in machine learning systems and hands-on expertise in Generative AI and LLM technologies.

    • 7+ years of professional experience in Machine Learning engineering, model development, or AI system design.
    • At least 1+ year of hands-on experience working with LLMs and Generative AI techniques.
    • Strong practical knowledge of prompt engineering, Retrieval-Augmented Generation (RAG), and agent-based AI systems.
    • Proficiency in Python and SQL, with experience building scalable data and ML pipelines.
    • Hands-on experience with LangChain or similar LLM orchestration frameworks.
    • Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying AI solutions.
    • Strong ability to define technical direction and contribute to engineering roadmap planning.
    • Excellent communication skills and ability to collaborate effectively with business stakeholders and SMEs.
    • Benefits:

      • Long-term contract opportunity with remote work flexibility in India.
      • Exposure to cutting-edge Generative AI and LLM technologies in production environments.
      • Opportunity to shape technical strategy and influence AI roadmap decisions.
      • Work on impactful AI-driven solutions solving real-world business challenges.
      • Collaboration with experienced engineering and business teams in a dynamic environment.
      • Access to modern cloud and AI tooling ecosystems (AWS, Azure, GCP, LangChain).
      • Competitive contract-based compensation (based on experience and market standards).
Apply Now

Date Posted

05/29/2026

Views

0

Back to Job Listings Add To Job List Company Profile View Company Reviews
Neutral
Subjectivity Score: 0
142,000+ Jobs Tracked
12,400+ Companies
1,930 Categories