Senior Data Engineer

So what will you be doing all day? You would join us as a Senior Data Engineer working on things like…

• Building and maintaining a data warehouse utilizing the DataVault architecture
• Developing and maintaining production data pipelines for a diverse set of structured and unstructured data leveraging the Azure platform
• Providing subject matter expertise and direct delivery of data acquisition, curation, and consumption pipelines on Azure
• Architecting data systems that are resilient to disruptions and failures
• Ensuring high uptime for all data services
• Bringing modern technologies and practices into the system to improve reliability and support rapid scaling of the business’s data needs
• Maintaining and managing current and emerging state of the art computer and cloud-based solutions and technologies
• Maintaining familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog, etc.
• Building and scaling up the data infrastructure that works to provide business analytics
• Maintaining different data/analytics outlets including Power BI and Dundas to ensure data delivery to team members and ad-hoc reporting/visualization requirements
• Participating in basic implementation and delivery of BI visualizations
• Providing technical input to and support data governance policies and standards and processes related to data with clear data classification and ownership, access and security (privacy & protection) of sensitive data
• Partnering with business domain experts, data analysts and application development teams to ensure data design is aligned with business strategy and direction
• Building effective relationships with internal stakeholders

We'd love for you to apply for this position if you…

• Bachelor's degree in Computer Science, Information Technology, Management Information Systems (MIS), Data
• Science or related field. Years of experience may be considered in lieu of degree
• Minimum 8 years of experience in software engineering required
• In-depth knowledge of relational databases required
• Expert in SQL with an in-depth knowledge of database and query performance tuning required
• Experience with leading large and complex data projects, preferred
• Experience with large-scale data warehousing architecture and data modeling, preferred
• Proficiency with cloud-based architecture such as Azure, AWS or Google Cloud, preferred
• Experience working with big data technologies e.g., Snowflake, Redshift, Synapse, Postgres, Airflow, Kafka, Spark,
• DBT, preferred
• Experience implementing pub/sub and streaming use cases, preferred
• Experience leading design reviews, preferred
• Ability to influence a team’s technical and business strategy by making insightful contributions to team priorities and approaches, preferred
• Working knowledge of high-level languages such as Python, C#, R or Scala, preferred
• Prior experience as a DBA, preferred
• Demonstrated ability to analyze large data sets to identify gaps and inconsistencies in ETL pipeline and provide solutions for pipeline reliability and data quality, preferred
• Working knowledge of non-relational data technologies such as Graph databases, NoSQL, ElasticSearch, preferred
• Experience in an infrastructure as code/CICD development environment, preferred
• Firsthand experience implementing data solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, Kubernetes, Docker, preferred
• Experience developing and maintaining data visualizations using PowerBI, preferred