Senior Data Engineer

We are looking for an experienced Senior Data Engineer to join our team and play a critical role in designing and optimizing scalable data solutions.
The ideal candidate has extensive experience with cloud platforms, data processing frameworks, and ETL/ELT pipelines and is passionate about solving complex data challenges.

#LI-DNI

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines for seamless data integration and transformation
• Build and maintain scalable data architectures to support analytics and business intelligence
• Work with large-scale data processing frameworks to ensure efficient and secure data handling
• Manage and process structured and unstructured data using various file formats
• Develop robust pipelines and workflows for high-performance data solutions
• Implement and maintain CI/CD pipelines to support efficient development and deployment
• Collaborate with stakeholders to align technical solutions with business goals and requirements
• Create datasets, reports, and dashboards to deliver actionable insights

Requirements

• Strong expertise in cloud platforms, specifically Azure (e.g., Synapse, Data Factory, Databricks, Data Lake)
• Proficiency in Python, SQL, and Apache Spark for data processing and pipeline development
• Experience with scalable data architectures, including file formats such as Parquet, Delta, and JSON
• Solid understanding of modern data processing frameworks and distributed systems
• Practical experience with CI/CD practices and version control tools like Git
• Excellent problem-solving skills and the ability to communicate technical concepts effectively

Nice to have

• Knowledge of Azure Fabric components, including Lakehouse, Workspace, and SQL Endpoint
• Experience in the development and management of Power BI datasets and reports
• Familiarity with DAX for sophisticated data analysis

We offer

• By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024 , Glassdoor's Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek , 2021 - 2023
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM
- We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.
- We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.
- You will work in an open and friendly work environment where your professional skills and experience can stand out.
How We Hire
• Here, we summarize the typical journey to finding a job within EPAM.
• Apply and tell us about yourself!
• Go through some standard interviews:

• - General interview with a recruiter
• - Technical interview with our technology experts
• - Manager interview or Offer interview with a hiring manager

• Get ready to join the team!
• Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!
• It takes 1 min of application to start the journey with us. Apply now!