Data Engineer

Lyft thrives on community—it's the essence of who we are and what we do. Our commitment to fostering an open, inclusive, and diverse environment is paramount, ensuring every team member is valued for their unique contributions.

At Lyft, data isn't just part of our decision-making process; it's the foundation. It drives our ability to deliver exceptional transportation experiences and offers insights into the impact of our product launches and features.

Joining Lyft as a Data Engineer means becoming a pivotal part of a team dedicated to shaping the future of transportation. You'll be tasked with developing robust data infrastructure—encompassing data transport, collection, and storage—and providing services that enable our leadership to make informed, risk-reducing decisions. We're in search of a Data Engineer to construct a scalable insurance data pipeline that will inform our financial strategies. Collaborating closely with our claims engineering, actuarial, and science teams, as well as our insurance partners, you'll lead the charge from technical proposal to final implementation. This role involves clear communication of technical challenges to both our internal teams and external partners, ensuring a cohesive approach to problem-solving.

As the steward of our core data pipeline, which underpins Lyft's key metrics, you'll leverage your data expertise to refine data models and spearhead the creation and launch of scalable data pipelines. These efforts will support Lyft's expanding needs in insurance data processing and analytics, providing critical business and user behavior insights. With access to vast amounts of Lyft data, your work will empower teams across Analytics, Data Science, Engineering, and beyond, driving innovation and growth.

Responsibilities:

• Design and implement insurance and claim-related data pipeline to help optimize insurance operation strategies
• Tune ETL and MapReduce job to improve data processing performance
• Partner with external insurance partners and Lyft business stakeholders to ensure seamless execution within established timelines
• Owner of the core company data pipeline, responsible for converting the business and engineering need to efficient & reliable data pipelines
• Main contributor to the team roadmap and lead the team to make the right technical decisions

Experience:

• 3+ years of relevant professional experience
• Strong experience with Spark
• Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
• Strong skills in a scripting language (Python, Ruby, Bash)
• Good understanding of SQL Engine and able to conduct advanced performance tuning
• Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
• Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
• Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering
• Preferred to have experience of building and maintaining insurance related data pipeline for large organizations 

Benefits:

• Great medical, dental, and vision insurance options
• Mental health benefits
• Family building benefits
• In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
• 401(k) plan to help save for your future
• 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
• Pre-tax commuter benefits
• Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program

Lyft is an equal opportunity/affirmative action employer committed to an inclusive and diverse workplace. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by law. We also consider qualified applicants with criminal histories consistent with applicable federal, state and local law.  

This role will be in-office on a hybrid schedule — Team Members will be expected to work in the office 3 days per week on Mondays, Thursdays and a team-specific third day. Additionally, hybrid roles have the flexibility to work from anywhere for up to 4 weeks per year. #Hybrid

The expected range of pay for this position in San Francisco is $144,000 - $180,000. Salary ranges are dependent on a variety of factors, including qualifications, experience and geographic location. Range is not inclusive of potential equity offering, bonus or benefits. Your recruiter can share more information about the salary range specific to your working location and other factors during the hiring process.