Lead Data Engineer

Lumos is making it a joy for companies to manage their apps and identities ✨. By integrating usage spend compliance and access data we provide a level of clarity and insight previously unimaginable. To deliver a best-in-class product Lumos depends on state-of-the-art data pipelines that power our analytics and AI-driven solutions.

We are seeking a Lead Data Engineer to expand and enhance our existing data infrastructure built around MySQL Fivetran Airbyte and Snowflake. In this role you will design and implement production-ready data pipelines with a strong emphasis on reliability testing and scalability. Your work will ensure that our AI products and in-product analytics perform flawlessly at scale driving value for our customers.

✨ Your Responsibilities

• Your mission is to architect build and maintain cutting-edge data pipelines that empower our AI products in-product analytics and internal reporting.

• You will ensure the scalability reliability and quality of our analytics data infrastructure enabling the seamless integration of usage spend compliance and access data to drive business insights and deliver exceptional value to our customers.

• By focusing on testing automation and best-in-class engineering practices you will play a pivotal role in transforming complex data into actionable intelligence fueling Lumos' growth and innovation.

🙌 What We Value

• Extensive experience designing and implementing medallion architectures (bronze silver gold layers) or similar data warehouse paradigms. Skilled in optimizing data pipelines for both batch and real-time processing.

• Proficiency in deploying data pipelines using CI/CD tools and integrating automated data quality checks version control and deployment automation to ensure reliable and repeatable data processes.

• Expertise in advanced SQL ETL processes and data transformation techniques. Strong programming skills in Python.

• Demonstrated ability to work closely with AI engineers data scientists product engineers product managers and other stakeholders to ensure that data pipelines meet the needs of all teams.

💰 Pay Range

• $190000 - $245000. Note that this range is a good faith estimate of likely pay for this role; upon hire the pay may differ due to skill and/or level of experience.