Senior / Staff Machine Learning Research Scientist Agents

About Scale

At Scale AI our mission is to accelerate the development of AI applications. For 8 years Scale has been the leading AI data foundry helping fuel the most exciting advancements in AI including: generative AI defense applications and autonomous vehicles. With our recent Series F round we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI) and building upon our prior model evaluation work with enterprise customers and governments to deepen our capabilities and offerings for both public and private evaluations.

About the ACE team 

The Agent Capabilities & Environments (ACE) team part of Scale’s Research organization brings together customer-facing Researchers and Applied AI Engineers. Our core mission includes research on agent environments and RL reward signals benchmarking autonomous agent performance across real-world scenarios and environments creating robust data programs to improve Large Language Models (LLMs) agentic capabilities and building foundational tools and frameworks for evaluating models as agents. ACE focuses on autonomous agents that dynamically interact with diverse external environments including code repositories GUI interfaces browsers and more. 

About This Role

This role is at the intersection of cutting-edge AI research and practical application with a focus on studying the data types essential for building state-of-the-art agents such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent adaptable AI agents guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data interaction and evaluation. You will contribute to impactful research publications on agents collaborate with customer researchers and work alongside the engineering team to translate these advancements into real-world scalable solutions.

• Practical experience working with LLMs with proficiency in frameworks like Pytorch Jax or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
• A track record of published research in top ML venues (e.g. ACL EMNLP NAACL NeurIPS ICML ICLR COLM etc.)
• At least three years of experience addressing sophisticated ML problems either in a research setting or product development.
• Strong written and verbal communication skills and the ability to operate cross-functionally. 

• Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax. 
• Hands-on experience and publications in building applications and evaluations related to AI agents such as tool-use text2SQL browser agents coding agents and GUI agents.
• Hands-on experience with agent frameworks such as OpenHands Swarm LangGraph etc.
• Familiarity with agentic reasoning methods such as STaR and PLANSEARCH 
• Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging their grasp of research concepts and their alignment with our organizational culture. We will not ask any LeetCode-style questions.

What We Do

Scale accelerates the development of AI applications by helping machine learning teams generate high-quality ground truth data. Our advanced LiDAR image video and NLP annotation APIs allow machine learning teams at companies like OpenAI Lyft Pinterest and Airbnb focus on building differentiated models vs. labeling data.