Lead architecture and technical strategy for AI-driven product quality systems using LLMs and agents. Build scalable evaluation frameworks detect regressions generate insights and drive cross-functional adoption while mentoring engineers and defining standards for trustworthy AI.

Block is one company built from many blocks all united by the same purpose of economic empowerment. The blocks that form our foundational teams - People Finance Counsel Hardware Information Security Platform Infrastructure Engineering and more - provide support and guidance at the corporate level. They work across business groups and around the globe spanning time zones and disciplines to develop inclusive People policies forecast finances give legal counsel safeguard systems nurture new initiatives and more. Every challenge creates possibilities and we need different perspectives to see them all. Bring yours to Block.
The Role
At Block we believe product quality is foundational to great user experiences and AI is transforming how we measure understand and improve that quality at scale. Our team builds the intelligence layer that evaluates system behavior across millions of real-world interactions helping ensure our products are reliable safe and continuously improving.
We're looking for a Senior Machine Learning Engineer to lead the technical direction of next-generation quality systems powered by LLMs and AI agents. You'll drive the architecture and strategy behind systems that evaluate product behavior surface emerging issues generate actionable insights and enable teams across Block to make higher-confidence product decisions.
In this role you'll operate across ambiguous high-impact problem spaces and shape how quality is measured and operationalized across the organization. You'll work across engineering product platform and leadership teams to define long-term technical direction establish scalable evaluation frameworks and build systems that become foundational infrastructure for AI-driven product quality.
You Will

• Lead the technical strategy and architecture for AI-driven quality and evaluation systems used across products and teams.
• Drive the development of scalable systems that use LLMs agents and behavioral signals to evaluate quality detect regressions and generate product insights.
• Define long-term approaches for evaluation measurement and quality intelligence across complex product surfaces.
• Translate ambiguous organizational needs into clear technical direction roadmap priorities and platform capabilities.
• Influence engineering standards and best practices for building reliable measurable and trustworthy AI systems.
• Lead complex cross-functional initiatives spanning product infrastructure data and applied AI teams.
• Mentor and level up engineers across the organization through technical leadership design reviews and systems thinking.
• Identify leverage opportunities where AI systems can fundamentally improve how teams understand debug and improve product behavior.

You Have

• 5+ years of experience in software engineering machine learning engineering or applied AI.
• Deep experience designing and shipping large-scale AI/ML systems in production environments.
• Strong expertise with LLMs agents evaluation systems retrieval architectures and modern AI infrastructure.
• Proven ability to lead ambiguous high-impact technical initiatives from concept through adoption across multiple teams.
• Strong systems thinking and architectural judgment with the ability to balance experimentation scalability and operational rigor.
• Experience defining technical strategy and influencing roadmaps beyond your immediate team.
• Excellent communication and cross-functional leadership skills with the ability to align engineering product and organizational priorities.
• A track record of creating leverage through platforms frameworks and systems that enable other engineers and teams to move faster and make better decisions.

We're working to build a more inclusive economy where our customers have equal access to opportunity and we strive to live by these same values in building our workplace. Block is an equal opportunity employer evaluating all employees and job applicants without regard to identity or any legally protected class. We will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances.
We believe in being fair and are committed to an inclusive interview experience including providing reasonable accommodations to disabled applicants throughout the recruitment process. We encourage applicants to share any needed accommodations with their recruiter who will treat these requests as confidentially as possible. Want to learn more about what we're doing to build a workplace that is fair and square? Check out our I+D page .
While there is no specific deadline to apply for this role U.S. roles are typically open for an average of 55 days before being filled by a successful candidate. Please refer to the date listed at the top of this job page for when this role was first posted.
Block takes a market-based approach to pay and pay may vary depending on your location. U.S. locations are categorized into one of four zones based on a cost of labor index for that geographic area. The successful candidate's starting pay will be determined based on job-related skills experience qualifications work location and market conditions. These ranges may be modified in the future.
To find a location's zone designation please refer to this resource . If a location of interest is not listed please speak with a recruiter for additional information.
Zone A:
$228700 - $343100 USD
Zone B:
$217300 - $325900 USD
Zone C:
$205900 - $308900 USD
Zone D:
$194500 - $291700 USD
Application Guidelines
Candidates may submit up to 9 active applications within a 60-day period. Reapplications to the same role are accepted 90 days after a previous application has been reviewed.
Use of AI in Our Hiring Process
We may use automated AI tools to evaluate job applications for efficiency and consistency. These tools comply with local regulations including bias audits and we handle all personal data in accordance with state and local privacy laws.
Contact us here with hiring practice or data usage questions.
Every benefit we offer is designed with one goal: empowering you to do the best work of your career while building the life you want. Remote work medical insurance flexible time off retirement savings plans and modern family planning are just some of our offering. Check out our other benefits at Block.
Block Inc. (NYSE: XYZ) builds technology to increase access to the global economy. Each of our brands unlocks different aspects of the economy for more people. Square makes commerce and financial services accessible to sellers. Cash App is the easy way to spend send and store money. Afterpay is transforming the way customers manage their spending over time. TIDAL is a music platform that empowers artists to thrive as entrepreneurs. Bitkey is a simple self-custody wallet built for bitcoin. Proto is a suite of bitcoin mining products and services. Together we're helping build a financial system that is open to everyone.