Software Engineer : AI Performance

About the Role

DevRev is ushering in the SaaS 2.0 era — where enterprise software is not just connected but intelligent. Our mission is to reintroduce the Computer to the enterprise: not as a form filler or a workflow router but as an agent that thinks reasons and acts on behalf of users. We’re looking for seasoned software engineers who have built and scaled applications APIs and cloud architectures — and are ready to level up into AI performance and benchmarking. You don’t need prior AI experience — just strong engineering fundamentals curiosity and the drive to learn. DevRev will provide structured training and mentorship to help you bridge into this next frontier of engineering.

What You’ll Do

• Participate in a structured training track to develop expertise in AI benchmarking profiling and performance tuning.

• Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.

• Design agent evaluation pipelines that measure reasoning accuracy alignment and user outcomes.

• Participate in a structured AI benchmarking training track gaining expertise in profiling telemetry and performance tuning.

• Collaborate with AI and Infra teams to instrument model-serving systems (vLLM Triton Ray or Kubernetes-based deployments).

• Develop data and telemetry pipelines that capture model performance latency and quality

• Contribute to DevRev’s open benchmarking frameworks defining how intelligent SaaS software is measured globally.

• Work with cross-functional teams to ensure benchmarks reflect real-world customer value and system impact.

What You'll Bring

• 3–10+ years of experience as a Software Engineer in backend systems or infrastructure roles

• Strong foundation in Python or similar backend languages — Go Java C# or Node.js

• Hands-on experience in building APIs and cloud-native architectures (AWS GCP or Azure; Kubernetes a plus)

• Understanding of metrics profiling or observability tools (Grafana Prometheus ELK or similar)

• Curiosity and commitment to learn AI benchmarking LLM evaluation and performance frameworks

• Strong analytical and product intuition — you care about what the benchmark represents not just what it measures

• Bonus: exposure to vector search model tuning (LoRA DPO) or open-source contributions

Why This Role Matters

Agents are not APIs — they reason adapt and learn. But with that power comes ambiguity in how we measure success. At DevRev we believe the benchmarks of the past aren’t enough for the software of the future.This role is your opportunity to design the KPIs of the AI-native enterprise — to bring rigor to systems that reason and structure to software that thinks.Join us to shape how intelligence is measured in SaaS 2.0.