Lead Databricks Engineer (relocation to Cyprus)
Company
EPAM Systems
Location
Kutná Hora, Czech Republic
Type
Full Time
Job Description
We are looking for a Lead Databricks Engineer with expertise in cloud infrastructure, big data processing, data integration and analytics, particularly with Azure.
In this role, you will play a crucial part in advancing our client's Data-Driven Company initiative within the insurance sector. Your role will involve designing and building robust data architecture to support various aspects of the client's business.
This position is integral to one of our projects in the client's Finance IT area, focusing on the integration component of their finance landscape. Proficiency in SQL and Azure Data Factory is essential for success in this role. Join us at our Cyprus office, which offers a flexible hybrid work setup. If you're ready to leverage your skills and perspective to make a significant impact, apply now and help us transform our data capabilities in the finance and insurance industries.
Want more jobs like this?
Get jobs in Kutnรก Hora, Czech Republic delivered to your inbox every week.
#LI-DNI
Responsibilities
- Data integration, transformation and modeling
- Serving large amounts of structured & semi-structured financial data
- Analyze existing process logic
- Implement best practices in data architecture, including security, governance, compliance and performance optimization
- Optimize the data storage across Delta Lake for data management
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization
- At least 5+ years of professional experience in the data engineering field
- Proficiency in Azure Databricks, Delta Lake, Python and PySpark for data manipulation
- Proficiency in designing and optimizing pipelines using Azure Data Factory, including performance tuning and optimizing data pipelines with Databricks Notebooks
- Experience with Azure data platforms and related services
- Good understanding of SQL and experience with relational database systems (e.g., MSSQL, PostgreSQL, Oracle DB)
- Understanding data structures, data modeling and data architecture patterns (Data Lake, DWH, Data mesh, etc.)
- Ability to work in an agile environment and eager to learn and develop new skills
- Good problem-solving skills and attention to detail
- Strong written and spoken English
- Certifications in Azure data or Cloud Services (e.g., Azure Data Engineer Associate)
- Business understanding of the insurance or financial domain
- Experience with BI Tools (Power BI)
- Private healthcare insurance
- Regular performance assessments
- Family friendly initiatives
- Corporate Programs including Employee Referral Program with rewards
- Learning and development opportunities including in-house training and coaching, professional certifications, over 22,000 courses on LinkedIn Learning Solutions and much more
- *All benefits and perks are subject to certain eligibility requirements
Date Posted
12/19/2024
Views
0
Similar Jobs
Human Resources Manager - Eaton
Views in the last 30 days - 0
Eatons ES AMER ARS division is recruiting for a Human Resources Manager The role involves serving as a business partner strategic solution provider an...
View DetailsEngineering Supervisor (Welding) - Eaton
Views in the last 30 days - 0
Eatons Administrative division is recruiting for an Engineering Supervisor Welding position The role involves designing and implementing welding proce...
View DetailsData Engineering Architect - Mastercard
Views in the last 30 days - 0
Mastercard is seeking a Data Engineering Architect to lead the AWS cloudbased data architecture for their Loyalty and Services group The role involves...
View DetailsStudent Engineer - Gaso - Garrett Advancing Motion
Views in the last 30 days - 0
The job involves supporting component engineers with administrative tasks and engineering activities conducting tests defined by the AS team creating ...
View DetailsStudent Engineer - ECOE - Garrett Advancing Motion
Views in the last 30 days - 0
Garrett a renowned brand in the automotive industry with over 65 years of history is seeking a skilled student for a longterm collaboration in their t...
View DetailsSenior Product Manager - SUSE
Views in the last 30 days - 0
SUSE a global leader in open source enterprise solutions is seeking a Senior Product Manager for its Enterprise Container Management ECM business The ...
View Details