Experienced Software Engineer - Machine Learning Infra

Plaid • USA

Company

Plaid

Location

USA

Type

Full Time

Job Description

The Plaid Machine Learning Infrastructure (ML Infra) team is responsible for creating and maintaining the foundational systems, tools, and processes that enable efficient, scalable, reliable, responsible and secure machine learning workflows for Plaid ML practitioners. The core ML Infra components and responsibility covering core areas but not limited to these:

1. Feature Store Development: Developing a robust and efficient Feature Store platform customized for Plaid use cases to streamline feature engineering for both batch and real-time streaming features. 
2. Model Serving and Deployment: Developing and maintaining infrastructure and tools for deploying models into production with observability and low latency. 
3. Data Exploration and Experimentation: Using both vendor-based solutions, like Sagemaker Notebook and in-house/open-source solutions, like ML-Flow and Trino, to support early model experimentation, model version monitoring, and tracking 
4. ML Data Cost: Developing creative framework to forecast, monitor, attribute and track the cost for end-to-end ML development life cycle.

You will lead the machine learning Infra team to design and develop Feature Store Platform for Plaid. You will support the team to set the multi-year technical strategy and roadmap. You will maintain current infrastructure for ML developer environment, ML model training, ML data feature creation/serving, ML model hosting/serving, ML model management, ML model service monitoring, vendor services (Tecton, OpenAI, Sagemaker and etc), and the CI/CD pipelines/infrastructure deploying all assets.

You will also help pioneer on early foundation of LLM AI platform for Pl. Working with MLEs and product engineers to support different ML-based product lines and working with other Data Platform engineers to continuously improve overall Plaid data ecosystems. 


Responsibilities
  • Passionate about ML infrastructure and how it can solve real-world problems, especially in fintech world.
  • Both leading and hands-on contribution to build the Feature Store for entire Plaid.
  • Shape the future of ML world for Plaid. 
  • Technical leadership in engineering excellence and mentorship.


    • Qualifications
  • 8+ years of software engineering experience. 
  • Extensive hands-on software engineering experience, with a strong track record of delivering successful projects within the ML Infrastructure or Platform domain at similar or larger companies.
  • Deep understanding of high-quality ML Infrastructure systems, including Feature Stores, Training Infrastructure, Serving Infrastructure, and Model Monitoring.
  • Experience in developing Feature Store system.
  • Strong cross-functional collaboration, communication, and project management skills, with proven ability to coordinate effectively. 
  • Demonstrated leadership abilities, including experience mentoring and guiding junior engineers.
  • [Nice to have] Experience with AWS Sagemaker, Tecton, or LLM training/serving infra/platform.
    • Apply Now

    Date Posted

    11/22/2024

    Views

    0

    Back to Job Listings ❤️Add To Job List Company Info View Company Reviews
    Positive
    Subjectivity Score: 0.8

    Similar Jobs

    Developer II - Eventbrite, Inc.

    Views in the last 30 days - 0

    Eventbrite is seeking a Web Application Developer to join their highperforming GTM Gotomarket Business Systems team The role involves implementing and...

    View Details

    Mobile Engineering Manager - Mobile Retention - Dropbox

    Views in the last 30 days - 0

    Dropbox is seeking a Mobile Engineering Manager to lead a team of iOS and Android engineers working on the Dropbox apps The role involves managing cri...

    View Details

    Commercial Account Executive - Mid Market - MariaDB plc

    Views in the last 30 days - 0

    MariaDB is a leading database for modern application development used by 75 of the Fortune 500 and billions of people daily The company is seeking a C...

    View Details

    Account Manager - SMB - Syndigo

    Views in the last 30 days - 0

    The Syndigo Account Manager SMB role involves managing client relationships creating strategies and ensuring value delivery The individual will work c...

    View Details

    Engineering Manager - Lattice

    Views in the last 30 days - 0

    Lattices Engineering team is dedicated to improving their product and craft using a modern tech stack They prioritize maintainable robust and performa...

    View Details

    Chief of Staff - brightwheel

    Views in the last 30 days - 0

    Brightwheel is a leading provider of highquality early education trusted by millions of educators and families The company is seeking a Chief of Staff...

    View Details