Experienced Software Engineer - Machine Learning Infra
Company
Plaid
Location
USA
Type
Full Time
Job Description
The Plaid Machine Learning Infrastructure (ML Infra) team is responsible for creating and maintaining the foundational systems tools and processes that enable efficient scalable reliable responsible and secure machine learning workflows for Plaid ML practitioners. The core ML Infra components and responsibility covering core areas but not limited to these:
1. Feature Store Development: Developing a robust and efficient Feature Store platform customized for Plaid use cases to streamline feature engineering for both batch and real-time streaming features.
2. Model Serving and Deployment: Developing and maintaining infrastructure and tools for deploying models into production with observability and low latency.
3. Data Exploration and Experimentation: Using both vendor-based solutions like Sagemaker Notebook and in-house/open-source solutions like ML-Flow and Trino to support early model experimentation model version monitoring and tracking
4. ML Data Cost: Developing creative framework to forecast monitor attribute and track the cost for end-to-end ML development life cycle.
You will lead the machine learning Infra team to design and develop Feature Store Platform for Plaid. You will support the team to set the multi-year technical strategy and roadmap. You will maintain current infrastructure for ML developer environment ML model training ML data feature creation/serving ML model hosting/serving ML model management ML model service monitoring vendor services (Tecton OpenAI Sagemaker and etc) and the CI/CD pipelines/infrastructure deploying all assets.
You will also help pioneer on early foundation of LLM AI platform for Pl. Working with MLEs and product engineers to support different ML-based product lines and working with other Data Platform engineers to continuously improve overall Plaid data ecosystems.
Responsibilities
-
Passionate about ML infrastructure and how it can solve real-world problems especially in fintech world.
-
Both leading and hands-on contribution to build the Feature Store for entire Plaid.
-
Shape the future of ML world for Plaid.
-
Technical leadership in engineering excellence and mentorship.
Qualifications
-
8+ years of software engineering experience.
-
Extensive hands-on software engineering experience with a strong track record of delivering successful projects within the ML Infrastructure or Platform domain at similar or larger companies.
-
Deep understanding of high-quality ML Infrastructure systems including Feature Stores Training Infrastructure Serving Infrastructure and Model Monitoring.
-
Experience in developing Feature Store system.
-
Strong cross-functional collaboration communication and project management skills with proven ability to coordinate effectively.
-
Demonstrated leadership abilities including experience mentoring and guiding junior engineers.
-
[Nice to have] Experience with AWS Sagemaker Tecton or LLM training/serving infra/platform.
$182520 - $297000 a year
Target base salary for this role is between $182520 and $297000 per year. Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan including medical dental vision and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position candidate's work experience and skillset and location. Pay and benefits are subject to change at any time consistent with the terms of any applicable compensation or benefit plans.
Date Posted
11/20/2024
Views
0
Similar Jobs
Software Engineering L5 - GenAI Platform - Netflix
Views in the last 30 days - 0
The text highlights Netflixs leadership in entertainment and data innovation emphasizing their worldclass data infrastructure and GenAI platform initi...
View DetailsStaff Security Engineer - Modern Health
Views in the last 30 days - 0
This job description highlights a key role in ensuring security and privacy at Modern Health offering impactful opportunities and comprehensive benefi...
View DetailsSenior Platform Engineer - Infrastructure - Kalepa
Views in the last 30 days - 0
This job posting describes a senior infrastructure engineer role with competitive compensation and equity options The position involves working on clo...
View DetailsNetwork & Systems Administrator - MetroSys
Views in the last 30 days - 0
This job posting seeks a Network Systems Administrator for fractional IT support requiring expertise in patch management vulnerability assessments an...
View DetailsSales Development Representative - Inspectiv
Views in the last 30 days - 0
Inspectiv seeks a Sales Development Representative to drive growth through outbound outreach and lead generation The role offers competitive compensat...
View DetailsAsset Management Associate - SunStrong Management, LLC
Views in the last 30 days - 0
This job posting seeks a detailoriented Asset Management Associate to oversee solar asset portfolios ensure compliance with financial agreements and c...
View Details