Senior Data Engineer

K2 Integrity is seeking a highly skilled Senior Data Engineer to join the team. The Senior Data Engineer will be responsible for designing and implementing scalable and efficient data architecture solutions, primarily on the Azure cloud platform. The Senior Data Engineer will create robust data models, optimize data storage and retrieval, and ensure the overall integrity and security of data. In the role, the engineer will collaborate with cross-functional teams to understand business requirements and translate them into effective data architecture solutions that support data-driven decision-making. This role will have varying responsibilities as the engineer will participate in many meaningful and interesting projects that K2 Integrity engages in.
Responsibilities:

• Design and implement end-to-end data architecture solutions on Azure and future state cloud platforms
• Collaborate with business stakeholders, data engineers, and data scientists to understand data requirements and design scalable and flexible data models
• Develop data ingestion strategies and frameworks to efficiently capture and integrate data from various sources into Azure and other cloud data services
• Define data storage and retrieval mechanisms, including multi-tenant data partitioning, indexing, and compression, to optimize performance and cost efficiency
• Implement data governance and data management practices to ensure data quality, consistency, and compliance with relevant regulations
• Create and maintain data pipelines and ETL/ELT processes to transform, cleanse, and integrate data across different data sources
• Collaborate with security and compliance teams to establish and enforce data security measures, including data encryption, access controls, and data masking
• Perform data profiling, analysis, and troubleshooting to identify and resolve data-related issues
• Stay up to date with the latest advancements in Cloud data services and recommend innovative solutions to enhance data architecture capabilities
• Provide technical guidance and mentorship to junior team members and promote best practices in data architecture design and implementation

Requirements:

• Bachelor's or master's degree in computer science, engineering, or a related field
• 8+ years of data architect / data engineer experience
• Extensive experience designing and implementing data architecture solutions on the Azure and other cloud platforms
• Strong proficiency in Azure data services such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage, Azure Databricks, and Azure Cosmos DB
• Deep understanding of data modeling principles and experience with relational, dimensional, and NoSQL data modeling techniques
• Solid knowledge of ETL/ELT processes, data integration patterns, and data warehouse concepts
• Familiarity with big data processing frameworks like Apache Spark or Hadoop
• Proficiency in SQL and programming languages such as Python or Scala
• Experience with data governance, data security, and compliance practices in Azure and other cloud platforms
• Strong problem-solving and analytical skills with the ability to troubleshoot and resolve complex data-related issues
• Excellent communication and collaboration skills to work effectively with stakeholders at all levels
• Ability to manage multiple projects and priorities in a fast-paced and dynamic environment

About K2 Integrity
K2 Integrity helps clients understand and manage risk so they can lead with confidence in a complex world—and build organizations that are safer, more transparent, and more resilient. By encouraging and enabling organizations to act with integrity, we can increase trust in institutions and promote prosperity and growth throughout the world.
K2 Integrity has realized this promise in its role as the preeminent risk, compliance, investigations, and monitoring firm—built by industry leaders, driven by interdisciplinary teams, and supported by cutting-edge technology to safeguard clients’ operations, reputations, and economic security.