Lead Data Engineer (Databricks)

About Us:
N-iX is a software development service company with a 21-year history, leveraging Eastern European talent to serve Fortune 500 companies and tech startups. We operate in nine countries and employ over 2,000 professionals. Our Data and Analytics practice, within the Technology Office, specializes in data strategy, governance, and platforms, shaping the future for our clients.

Role Overview:
We are seeking a forward-thinking and highly skilled Lead Data Engineering, specialized in Databricks, to helm the engineering side of a significant data transformation program for our customer. This leader will not only execute standard data engineering tasks but will also leverage advanced techniques like generative AI and other automation methods to optimize data and pipeline migrations. A critical aspect of the role is to develop reusable solutions that can benefit other customers as well.

Key Responsibilities:

• Work closely with cross-functional teams to grasp business requirements and architect scalable, efficient data solutions.
• Define data architectures, data models, and data integration strategies aligned with business goals.
• Lead the design and implementation data pipelines and data lakehouse solutions.
• Establish scalable data pipelines for analytics use cases.
• Develop and optimize technical and physical data models.
• Automate processes and optimize infrastructure.
• Leverage generative AI to streamline workflows and automate pipeline and data migrations.
• Continuously seek methods to reduce delivery time using automation and generative AI techniques.
• Collaborate with technology partners to ensure high data quality.
• Build data solutions following best practices.
• Mentor the Data Engineering team for quality code production.
• Transform delivery work into reusable solutions.
• Participate in technical discussions, proposal processes, and serve as a subject matter consultant in pre-sales activities.

Skills and Requirements:

• Bachelor’s or Master's degree in Computer Science, Information Technology, or a related field.
• Over 6 years of experience in Data Engineering, with a strong emphasis on architecture.
• Proven expertise in Azure and Databricks technologies.
• In-depth knowledge of data lakehouse concepts, data management processes, and data integration techniques.
• Experience with performance tuning and optimization of data pipelines.
• Strong problem-solving skills and the ability to thrive in a fast-paced, collaborative environment.
• Excellent communication skills for conveying technical concepts to non-technical stakeholders.
• Certifications in relevant technologies (e.g., Azure, Databricks) are a plus.
• Innovative mindset with a constant eye on improving the productivity of data engineering work.
• Experience in leveraging generative AI to increase data engineering productivity is highly preferred.