Staff Software Engineer, AI Systems
Job Description
Team: IT
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Software Engineer, AI Systems based in Canada.
This is a high-impact engineering role focused on building the core backend systems that power next-generation AI-driven products. You will work at the intersection of distributed systems, backend engineering, and applied machine learning, helping design and scale agent-based architectures in production environments. The role involves shaping how LLMs interact with structured data, APIs, and real-world workflows to deliver reliable, production-grade AI capabilities. You will contribute across the full stack of AI systems—from orchestration and tooling to evaluation and deployment. This is a deeply technical position suited for engineers who thrive in ambiguity and enjoy building foundational infrastructure. You will collaborate closely with cross-functional teams to translate complex business workflows into intelligent, automated systems.
Accountabilities:
- Design and build scalable AI agent systems and orchestration frameworks that power LLM-driven product experiences across production environments.
- Develop robust backend services integrating LLMs with structured datasets, internal APIs, and platform workflows to enable intelligent automation.
- Build and maintain infrastructure for prompt iteration, evaluation pipelines, observability, and performance monitoring of AI systems.
- Define and implement architectural standards for reliable, secure, and scalable AI-native systems in production.
- Partner with product and engineering teams to translate domain workflows into AI-enabled features and user-facing capabilities.
- Contribute to platform modernization efforts including tooling, developer frameworks, and distributed system improvements.
- Ensure systems are production-ready by focusing on reliability, latency, maintainability, and scalability across services.
- 10+ years of experience in backend engineering, data engineering, or equivalent roles in production environments.
- Strong expertise in designing and building scalable backend systems, APIs, and distributed architectures.
- Hands-on experience with LLMs, agent frameworks, prompt engineering, or generative AI applications in production.
- Proficiency in Python (or similar backend languages) with strong software engineering fundamentals.
- Experience working with cloud infrastructure, microservices, and distributed system design.
- Familiarity with building internal tooling, developer platforms, or AI/ML infrastructure is a strong asset.
- Strong ability to operate across the stack, from infrastructure-level design to product integration.
- Excellent collaboration skills with the ability to navigate ambiguity in fast-moving technical environments.
- Bonus: Experience in fintech, SaaS, or regulated industries, and contributions to AI or data infrastructure projects.
- Competitive base salary ranging from $215,000 – $250,000 CAD annually
- Equity participation through stock options
- Comprehensive health, dental, and vision insurance coverage
- Flexible remote-first work environment across Canada
- Opportunities for high-impact ownership in foundational AI systems
- Collaborative, fast-paced engineering culture focused on innovation
- Professional growth in cutting-edge AI and distributed systems development.
Requirements
Benefits
Explore More
Date Posted
07/04/2026
Views
0
Similar Jobs
Staff Engineer, Security Engineering Partners - Jobgether
Views in the last 30 days - 0
View Details