Azure Data Engineer

We are seeking an experienced Azure Data Engineer with expertise in machine learning (ML) and Snowflake. The ideal candidate will have a strong background in designing, developing, and maintaining scalable data solutions on the Azure cloud platform, integrating machine learning models, and working with Snowflake data warehousing solutions.

Key Responsibilities:

• Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
• Implement and optimise data solutions in Snowflake, focusing on performance and scalability.
• Collaborate with data scientists and ML engineers to integrate machine learning models into the data pipeline and support model deployment and monitoring.
• Develop and manage data workflows and transformations using Azure Data Lake and Azure Databricks.
• Ensure data quality and integrity by implementing robust data validation and monitoring mechanisms.
• Optimise and troubleshoot Snowflake environments, ensuring efficient data storage and query performance.
• Collaborate with cross-functional teams to deliver data engineering solutions that support business needs.
• Work closely with stakeholders to understand data requirements and translate them into technical solutions.

Qualifications:

• 5+ years of experience as a Data Engineer, specifically with Azure cloud services.
• Strong experience with Snowflake for data warehousing and ETL pipelines.
• Hands-on experience in implementing and deploying machine learning models within data solutions.
• Proficient with Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.
• Experience in programming languages such as Python and SQL.
• Familiarity with data orchestration tools like Airflow or similar.
• Experience with version control tools such as Git.
• Strong problem-solving and communication skills, with the ability to collaborate effectively with technical and non-technical teams.

#SeniorLevel