Compensation
This employer didn't list pay. Model a likely range with the calculator.
Model this offer in the calculatorJob description
We're hiring an Engineering Manager to lead our Observe/Evaluation team — the team responsible for making sure our voice agents actually work in production. Your core focus is two-fold: the observability tooling that gives us visibility into how agents behave and the evaluation frameworks that let us systematically measure and improve agent quality over time. You'll also touch the integrations that connect our systems to the broader ecosystem and a customer-facing copilot product that lets customers iterate on their own agents easily.
RESPONSIBILITIES:
- Lead and grow a team of 3-5 engineers — set expectations support career development and hold a high hiring bar
- Own execution of the observability and evaluation roadmap: tooling that surfaces how voice agents are performing and frameworks that let teams evaluate agent quality systematically
- Stay hands-on enough to jump into Python code debug production issues and make tactical contributions when needed
- Partner with the other product teams to translate voice-agent quality signals into tooling and metrics that are actually actionable
- Own the reliability and scalability of the team's integrations — the connections that link our systems to complex external and internal systems and that need to scale as the business grows
- Support the copilot product's roadmap in collaboration with Product — the tool that lets customers iterate on their voice agents easily
- Remove blockers for your team — whether that means adjusting process pairing on a hard debugging session or resolving cross-functional friction
- Be actively involved in hiring: sourcing interviewing and onboarding
WHAT YOU'LL OWN:
- Observability tooling: Systems that give visibility into how voice agents are behaving in production — what's working what's degrading and why
- Evaluation frameworks: Tooling that lets the org systematically evaluate and improve voice agent quality over time rather than relying on ad hoc checks
- Integrations: The complex external and internal integrations that connect our systems to the broader ecosystem built to scale as usage grows
- Copilot product: A customer-facing product that lets customers iterate on their voice agents easily — this is a product we ship not an internal tool
ABOUT YOU:
- 6+ years of experience in a relevant engineering role
- 1-3 years of experience managing a team
- Hands-on experience with Python and Typescript — you can still write and debug code at a senior level even if you now do it less often
- Solid experience with AWS including services like Lambda and SQS and streaming systems (e.g. Kinesis)
- Comfortable managing ambiguity — this space (observability + eval for AI agents) is still being defined and you'll help define it
- Strong written and verbal communication skills; able to work with both technical and non-technical stakeholders
- A track record of mentoring engineers and helping them grow
NICE TO HAVE:
- Experience with MCP (Model Context Protocol) or building agentic applications
- Background in observability monitoring or evaluation tooling specifically
- Experience working adjacent to applied AI or ML teams
- Prior startup experience at the Series B–D stage
BENEFITS/PERKS
- We care about your health!
- Medical Dental and Vision plans - 80% covered by the company
- Flexible PTO & 11 paid holidays/year
- We care about future you!
- 401k Plan
- Paid parental leave
- Pre-tax commuter benefits
- We care about connection!
- In-office breakfast and snacks daily
- Happy hours team outings & annual off-sites
- Complete laptop workstation
- & more to come!
Skills Required
- 6+ years of experience in a relevant engineering role
- 0-3 years of experience managing a team
- Hands-on experience with Python
- Hands-on experience with TypeScript
- Solid experience with AWS (including Lambda and SQS)
- Experience with streaming systems (e.g. Kinesis)
- Ability to debug production issues and make tactical code contributions
- Track record of mentoring engineers and supporting career development
- Strong written and verbal communication skills; work with technical and non-technical stakeholders
- Position located in New York City (in-office T/W/TH optional M/F)
- Experience with MCP (Model Context Protocol) or building agentic applications
- Background in observability monitoring or evaluation tooling
- Experience working adjacent to applied AI or ML teams
- Prior startup experience at the Series B-D stage
What the Team is Saying
Regal Compensation & Benefits Highlights
- Healthcare Strength—Public postings indicate employer-subsidized medical dental and vision coverage with added mental-health support (e.g. Talkspace) and access to FSA. This combination points to a robust health offering for a growth-stage startup.
- Leave & Time Off Breadth—Materials highlight flexible paid time off alongside company holidays. This suggests employees can step away from work with fewer rigid constraints.
- Wellbeing & Lifestyle Benefits—Descriptions call out daily in-office meals/snacks team events and off-sites commuter benefits and a fully provisioned workstation. These everyday perks and wellness touches can meaningfully enhance the overall package.
Regal Insights
What We Do
Founded in 2020 Regal is the AI Agent Platform. Regal gives every company the tools to transform customer communications with delightful AI Agents that are connected to your data easy to customize and monitor always-available and ready to take action. Our Values Customers are Royalty We serve our customers above all else. If we don’t earn their love someone else will. Fast Execution Wins We work with urgency and speed because by moving forward we learn more about how to solve the problem than by theorizing. Growth Mindset Your learning curve should be as steep as the company’s growth curve. Data Beats Opinion We make decisions based on analysis and data not anecdotes. Enjoy the Journey We bring our whole selves to work and build meaningful friendships. We appreciate and are kind to each other.
Why Work With Us
At Regal every team member makes an impact. We move fast solve complex challenges and build game-changing AI solutions—together. Our culture thrives on fast execution data-driven decisions and continuous learning. If you want to grow be challenged and work with brilliant motivated people Regal is where you want to be.
Gallery
Regal Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
We're in the office Tues-Thurs & WFH/Office Optional on Mon/Fri. Our HQ is in NYC. Annual offsites in fun spots such as Breckenridge Miami CT & more!
Similar Jobs
Regal
Enterprise Account Executive
Regal
Director Of Engineering
Regal
Director Go-To-Market (GTM)
Regal
AI Forward Deployed Engineer
Related roles