Lead Data Software Engineer (Data Ingestion, Monitoring & Observability)

We are looking for a Data Software Engineering expert with a comprehensive background in Data Ingestion, Monitoring and Observability to work in a project for our customer founded in the Netherlands.
The ideal candidate will not only play a key role ithe n the current development team but also provide insightful guidelines on how to refurbish an E2E solution and be actively involved in the transformation. A candidate will be responsible for maintaining existing systems and implementing future changes as client's data consumption needs and ingestion evolve, becoming larger and more extensive.

Responsibilities

• Maintain and enhance existing data systems
• Develop enhancements for the existing Data Platform
• Implement future changes to accommodate growing consumption needs and ingestion
• Work with complex datasets, including the addition of new datasets from scratch
• Collaborate with senior team members on complex projects, particularly when adding new large datasets
• Grow with the technological landscape, adapting to new tools and methodologies as they emerge

Requirements

• 5+ years of relevant professional experience
• Very good knowledge of the Azure cloud stack, including proven hands-on experience with Azure Databricks, Azure Event Hubs and Azure SQL Database
• Proficiency in Python/PySpark
• Experience in working with large and complex datasets
• Ability to work in a team and collaborate with various stakeholders
• B2+ English level proficiency

Nice to have

• Experience in Azure Analytics Engineering
• Familiarity with DevOps practices and tools like Terraform and Grafana

We offer

• We gather like-minded people:
  • Engineering community of industry professionals
  • Friendly team and enjoyable working environment
  • Flexible schedule and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Relocation within our 50+ offices
• We provide growth opportunities:
  • Outstanding career roadmap
  • Leadership development, career advising, soft skills, and well-being programs
  • Certification (GCP, Azure, AWS)
  • Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
  • Language classes in English and Polish for foreigners
• We cover it all:
  • Stable income (Employment Contract or B2B)
  • Participation in the Employee Stock Purchase Plan
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
  • Referral bonuses
  • Corporate, social and well-being events
• Please, note:
  • The set of bonuses might vary based on the role you apply for - specifics will be discussed with our recruiter during the general interview
  • We will reach out to selected candidates exclusively

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.