Senior Data Engineer

N-iX is looking for a Senior Data Platform Engineer to join the team.

About the project

Our client is the leading retail chain in Uzbekistan, with about a million regular customers and more than 125 stores in 11 regions. The company operates supermarkets, neighborhood stores, convenience stores, a wholesale store, and an online supermarket. The client also runs two warehouses (dry and temperature-controlled) and a fruits/vegetables hub.

Project Objectives:

The client wants to replace the obsolete DWH solution based on SAP BW and deploy a robust, flexible, and scalable analytical cloud platform based on the cutting edge technology stack. This project will enhance data quality and governance practices and support significant company growth, laying the groundwork for advanced AI/ML solutions.

Responsibilities:

• Design and build scalable data pipelines to ingest, process, and transform large volumes of data from various sources.
• Implement ETL/ELT processes to integrate data using Azure Data Factory, Databricks, Synapse.
• Develop and optimize queries for performance and scalability.
• Maintain and support the Data Warehouse, ensuring high availability and reliability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Monitor and troubleshoot data pipeline issues, ensuring data integrity and quality.
• Implement best practices for data engineering, including code reviews, testing, and version control.
• Develop and implement data models, ETL processes, and data integration workflows.
• Develop and implement scripts in Python and SQL to detect and correct data anomalies
• Work in an Agile, collaborative environment to build, deploy, and maintain data systems.
• Ensure data solutions are compliant with security, privacy, and governance standards.
• Develop and maintain comprehensive documentation for all data engineering processes.

Requirements:

• Bachelor’s degree in Computer Science, Information Systems, or a related field.
• Proven experience (5+ years) as a Data Engineer, Data Architect, or similar role.
• Proficiency with ETL tools and frameworks and analytical platforms, specifically Azure Data Factory, Databricks, Synapse.
• Strong knowledge of Data Warehousing, Lakehousing concepts, Medallion architecture.
• Experience with Python and SQL for data processing.
• Familiarity with cloud storage solutions, particularly Azure Data Lake Storage (ADLS).
• Strong understanding of data governance, data quality, and data security best practices.
• Excellent problem-solving skills and attention to detail.
• Ability to work effectively within an Agile/Scrum environment.
• Upper-Intermediate level of English.
• Previous experience in the retail sector.

Nice to Have:

• Certification in Azure (e.g., Azure Data Engineer, Azure Solutions Architect).
• Experience with AI/ML integration within data pipelines.
• Familiarity with other BI tools beyond Power BI.