Model Monitoring Analyst

Octane® is revolutionizing recreational purchases by delivering a seamless, end-to-end digital buying experience. We connect people with their passions by combining cutting-edge technology and innovative risk strategies to make lifestyle purchases - like powersports vehicles, RVs, and OPE - fast, easy, and accessible.

Octane adds value throughout the customer journey: inspiring enthusiasts with our editorial brands, including Cycle World® and UTV Driver®, instantly prequalifying consumers for financing online, routing customers to dealerships for an easy closing, and supporting customers throughout their loan with superior loan servicing.

Founded in 2014, we’re a company with 550+ employees and over 30 OEM and 4,000 dealer partners.  We are both the platform and the lender, which means we have both high growth and positive unit economics—rare for a fintech. Octane has raised >$100M in equity from IA Ventures, Valar Ventures, Contour Venture Partners, Citi Ventures, and other leading investors.

Now for the exciting opportunity, we are looking for a talented Model Monitoring Analyst to support monitoring predictive ML models deployed in production. You will be working with a versatile team of data scientists and financial professionals to analyze the performance of deployed models using dedicated monitoring tools and metrics. You will touch different phases of the model monitoring lifecycle from working closely with data science team to understand how the models should ideally perform based on pre-defined expectations to collaborating with business partners to ensure the efficacy of the deployed models is preserved to then visualizing different input features and the model score itself to flag alerts. You will have the opportunity to report key findings and metrics on a regular cadence to a larger group of professionals and bring forth recommendations relating to the quality of the model's health.

Responsibilities

• Apply state of the art machine learning model monitoring techniques to drive business value 
• Convert insights into concrete, significant recommendations for business or product improvement, and succinctly communicate these findings to both executive and non-executive partners
• Analyze large data sets of proprietary and third-party data to detect drift in features and/or model score and suggest recommendations for policy, strategy, or product decisions
• Research and keep up to date with new visualization and monitoring techniques and tools

Requirements

• A recent advanced degree in Math, Statistics, Physics, Engineering, Computer Science or another quantitative field, OR a bachelor's degree followed by 2+ years of experience inclusive of business analytics, performance analysis, mathematical modeling, and/or data science
• Ability to critically think and prioritize needs of the business
• Familiarity / Experience with SQL
• Familiarity / Experience with some data visualization tools, such as Tableau, Looker, Periscope, PowerBI, or similar software for reporting
• Familiarity / Experience with Excel, Google Sheets or similar software 

Preferred 

• Knowledge of Python, PySpark, SparkSQL, and statistical / ML packages
• Experience with Databricks
• Experience with cluster computing for data manipulation, analysis and data science 
• Possesses understanding of machine learning algorithms and techniques
• Basic command line experience
• Experience with AWS or other cloud computing environments, specifically within the data domain
• Experience with Git for code management
• Experience with MLflow

Compensation: The role described above offers a base salary of $110,000 to $130,000.  Your offer will be based on the alignment of your qualifications with the requirements of the job, location and internal equity.  In addition to the above-mentioned salary, Total Rewards include a stock option package, and benefits as outlined below.

Benefits:

• Robust Health Care Plans (Medical, Dental & Vision)
• Generous Parental Leave
• Up to 5 weeks time off (self-managed)
• Retirement Plan (401k) with company match!
• Educational Assistance/Tuition Reimbursement up to $3K/year 
• Life Insurance (Basic, Voluntary & AD&D)
• Short Term / Long Term Disability
• Robust Ancillary benefits including accident insurance, hospital insurance, etc.
• Wellhub wellness benefit
• Powersports Safety Benefit

Octane Lending is an equal opportunity employer committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected status with respect to recruitment, hiring, promotion and other terms and conditions of employment.

#LI-JL1

#LI-Remote