Senior Data Engineer

The Role: 

Carrot is seeking a Senior Data Engineer to join our rapidly growing Business Intelligence function as it scales to meet - and anticipate - the needs of the organization and its clients. As a Senior Data Engineer at Carrot, you are tasked with defining and driving the development of the BI department’s data infrastructure. From ETL/ELT pipeline development to data warehouse administration and workflow orchestration, the Senior Data Engineer is responsible for the systems that make analytics possible. The reliability of these systems is essential for the accuracy and recency of data that is used by the organization to inform data-driven decision-making and the future of the business. As such, it is essential that these systems be made robust, with a strong emphasis on code quality and thoughtful systems design.

Core responsibilities for the role include:

• Design and execute implementation of Business Intelligence data infrastructure, identifying opportunities for data acquisition and exploring ways to enhance data quality and reliability
• Define data integration from source data into a centralized data warehouse
• Orchestrate data workflows to automate data integration and reporting tasks
• Develop software systems that enable advanced data analytics capabilities, for example, complex data visualization and advanced algorithms
• Make data infrastructure robust by building out CI/CD, unit and integration testing, logging, monitoring, and alerting
• Develop, test, deploy, monitor, maintain, and continuously improve scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.
• Leverage end-user/stakeholder data requests and needs, to proactively inform infrastructure and architecture design
• Partner with backend product engineers to optimize production database schemas with data use cases in mind
• Mentor and partner with team to support growth and development 

The Team:

The Business Intelligence team at Carrot is a highly cross-functional team that is central to Carrot’s long-term success.  The growing team is led by our Senior Director of Analytics and Business Intelligence and includes data engineers, data scientists, and business intelligence analysts.

Minimum Qualifications: 

• Advanced knowledge of SQL with ability to write efficient and complex SQL queries
• Strong experience with Python development. Including unit and integration testing.
• Strong experience with cloud based data lake/data warehouse technologies, platforms, and services such as Snowflake, AWS, etc.
• Strong experience and deep understanding of database relational modeling
• Experience working with version control systems (Git preferred)
• Strong experience with modern data ingestion and transformation technologies such as Fivetran, dbt, etc. 
• Strong experience building end-to-end ETL/ELT pipelines
• Strong experience with workflow orchestration tools such as Prefect, Airflow, etc.
• Demonstrated experience identifying opportunities to simplify and automate tasks while building reusable components across multiple use cases
• Adaptable, open to change and able to work in ambiguous situations and respond to new information or unexpected circumstances
• Dependendable, strong, technical individual with ability to execute and deliver high quality work

Preferred Qualifications: 

• Direct experience with existing techstack including but not limited to Snowflake, Fivetran, dbt, Prefect, etc.
• Direct experience with best-in-class and enterprise business intelligence platforms
• Experience with event streaming; knowledgeable on integrating batch and real time data ingestion processes
• Previous experience with a startup or similar fast-paced growth environment  [ plus + ]
• Healthcare industry working experience with understanding of healthcare data standards (HL7, FHIR, etc.), privacy laws and data regulations (HIPAA, GDPR, etc.), and healthcare data exchange (HIEs, EDI, etc.)  [ plus + ]

Compensation:

Carrot offers a holistic Total Rewards package designed to support our employees in all aspects of their life inside and outside of work, including health and wellness benefits, retirement savings plans, short- and long-term incentives, parental leave, family-forming assistance, and a competitive compensation package. The expected base salary for this position will range from $130,000 - $175,000. Actual compensation may vary from posted base salary depending on your confirmed job-related skills and experience.