Software Engineer, Operational AI

Engineering at Brex

The Engineering team includes Data, IT, Security, and Software, and is responsible for building innovative products and infrastructure for both internal and external users. We have multiple autonomous and collaborative teams who are eager to learn, teach, and constantly improve how things work. Together, we strive to build robust and scalable systems that enable Brex to grow rapidly and help our customers reach their full potential.

What you’ll do

We are looking for a software engineer to join our new Operational AI team. The Operational AI team is in charge of the AI projects, such as operational automation, that keep our business running behind the scenes. Delivering on these projects requires development on the platform to enable both traditional ML model and generative AI at Brex, with a vision to scale and democratize machine learning and AI to meet the needs of the business. You would be collaborating with data scientists and engineers from across all of Engineering within Brex to build, maintain, and scale our AI systems.

Responsibilities

• Design and develop the infrastructure to provide a cohesive, integrated, and managed development life cycle for traditional ML models and LLMs
• Architect, build, and diagnose production AI/ML systems
• Work closely with AI/ML application teams to design seamless workflows for continuous model training, inference, and monitoring
• Define and provide strong SLAs and metrics around latency, throughput, and resource
• Interface with both ML experts and platform engineers to understand workflows, pinpoint and resolve inefficiencies, and inform the next set of features for the platforms
• Troubleshoot and debug user issues
• Provide operational and user-facing documentation
• Be responsible for developing, cultivating, and nurturing the AI-driven culture within Brex

Requirements

• 3+ years of professional experience in a software engineering role or equivalent experience
• Experience working with backend programming languages, such as Kotlin, Python, etc.
• Experience building custom MLOps platform solutions based in business needs 
• Experience leveraging and integrating industry MLOps solutions, such as AWS Sagemaker, Databricks, etc. 
• Experience using LLM technologies such as langchain, LLM AIs 
• Familiarity with software engineering development cycles
• Ability to hold yourself and the team to high standards
• Strong communication and interpersonal skills
• Must be willing to work in office 2 days per week on Wednesday and Thursday

Bonus points

• Experience driving initiatives at a broader level across an organization or company
• Strong writing skills
• Proactive approach
• You know what prompt engineering is and how to get the most out of an LLM

Compensation

The expected salary range for this role is $152,000 - $190,000. However, the starting base pay will depend on a number of factors including the candidate’s location, skills, experience, market demands, and internal pay parity. Depending on the position offered, equity and other forms of compensation may be provided as part of a total compensation package.