Lead Big Data Engineer

We are looking for a Lead Big Data Engineer to join our team in Serbia.Our goal is to build a Data Practice similar to the one we have in Hungary, to work together and across boarders with many talented professionals. Learn more about it here:https://careers.epam.hu/careers/join-our-data-and-analytics-practice-in-hungary
#LI-DNI#Not found

Responsibilities

• Lead, design and implement innovative analytical solution using Hadoop, NoSQL and other Big Data related technologies, evaluating new features and architecture in Cloud/ on premise/ Hybrid solutions
• Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
• Build collaborative partnerships with architects and key individuals within other functional groups
• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
• Actively participate in code review and test solutions to ensure it meets best practice specifications
• Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation
• Write project documentation

Requirements

• Wide experience in analysis, design, implementation, deployment as well as troubleshooting and rebuilding distributed Linux based platforms and Big Data solutions on premises and in Cloud
• Experience in Big Data technologies - including Hadoop Core, Apache HBase, Airflow, MapReduce, Spark, SolR
• Solid Cloud experience with 2 or more leading cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)
• 5+ years' experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning) and Java/Scala or Python
• Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security
• Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
• Strong experience with data modeling; hands-on development experience with modern Big Data components
• Cloud: experience in designing, automation, provisioning, deploying and administering scalable, available and fault tolerant systems
• Good understanding of CI/CD principles and best practices
• Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
• Data-oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAA
• Motivated, independent, efficient and able to handle several projects; work under pressure with a solid sense for setting priorities
• Ability to work in a fast-paced (startup like) agile development environment
• Strong experience in high load and IoT Data Platform architectures and infrastructures
• Vast experience with Containers and Resource Management systems: Docker, Kubernetes, Yarn
• Experience in direct customer communications
• Experience in technology/team leading of data oriented projects
• English proficiency - B2 and higher

We offer

• Diverse multicultural, multi-functional, and multilingual work environment
• Global scope, international projects in different business domains: life sciences and healthcare, retail, and distribution, software and hi-tech, etc
• Outstanding career development opportunities with a transparent career path and a roadmap to accelerate your journey
• Numerous opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to LinkedIn Learning courses
• Knowledge-sharing with colleagues from EPAM's global tech communities
• English language courses
• 25 days holiday per annum
• 5 days of sick leave without medical certification
• Private health insurance for employees and discount for private health insurance for family members
• Discount for Fit Pass program
• Comfortable modern offices in Belgrade and Novi Sad or remote work from any location in Serbia
• Regular corporate and social events (parties, sport events, advanced CSR programs etc.)
• Learning programs for kids (eKids)

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, diverse community to help you discover your fullest potential.

No less important is our applicants' safety, well-being, and experience. Therefore, until further notice, all EPAM employment interviews will be conducted remotely. Our recruitment professionals and hiring managers are standing by to ensure a robust and engaging virtual candidate experience. We look forward to speaking with you!