Senior Python Data Engineer
Company
EPAM Systems
Location
Zhezqazghan, Kazakhstan
Type
Full Time
Job Description
We seek a skilled Python Data Engineer to join our team and help us build and maintain our data pipelines.
As a Python Data Engineer, you will be responsible for designing, developing, and testing Python-based data pipelines and performing data cleansing, transformation and quality assurance.
This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.
#LI-DNI#top-vacancies-10-KZ#Not found
Responsibilities
- Design, develop, test and maintain Python-based data pipelines
- Write high-quality and maintainable Python code to migrate data between different storage systems with modifications
- Create ETL jobs, airflow operators, and Spark jobs to enhance data processing capabilities
- Implement Data Intake processes for Data Sources (ETL/ELT, DWH Modelling and Optimization)
- Perform data cleansing, transformation and quality assurance to maintain data integrity
- Optimize data processing, storage and retrieval to improve performance
- Collaborate closely with cross-functional teams to ensure data accuracy and consistency
Want more jobs like this?
Get jobs in Zhezqazghan, Kazakhstan delivered to your inbox every week.
- In-depth learning of Python programming with the ability to write maintainable and scalable code
- Strong understanding of distributed computation and multiprocessing
- Knowledge of data warehouse concepts and ETL processes
- Proficiency in working state machines, web back-end development, networking and protocols
- Experience with cloud computing platforms, such as AWS or GCP, and tools like Step Functions, Batch
- Knowledge of Spark, Hive, Databricks and other data processing frameworks
- Familiarity with data orchestration tools like Airflow
- Expertise in with SQL, NoSQL and cloud-based data storage solutions
- We connect like-minded people: :
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
- We invest in your growth: :
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
- Free English classes with certified teachers
- Discounts in local language schools, including online courses for the Kazakh language
- We cover it all: :
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Benefits package (sports activities, a variety of stores and services)
Date Posted
10/30/2024
Views
0
Similar Jobs
Senior Java Full Stack Software Engineer - EPAM Systems
Views in the last 30 days - 0
EPAM is seeking a Senior Java Full Stack Software Engineer to join their team offering a dynamic role in enhancing the Purchasing system The ideal can...
View DetailsSenior Azure DevOps Engineer - EPAM Systems
Views in the last 30 days - 0
EPAM is seeking a Senior Azure DevOps Engineer to join their global team The role involves developing and managing CICD processes migrating workloads ...
View DetailsImplementation Consultant - Visa
Views in the last 30 days - 0
Visa a global leader in payments and technology is seeking a project management professional with extensive experience in financial services The role ...
View DetailsVCA Consulting Director, Acquiring - Visa
Views in the last 30 days - 0
Visa is seeking a Consulting Director for its Acquiring practice in CEMEA aiming for a 40 YOY growth The role involves deep expertise in Acquiring str...
View DetailsSenior Full Stack ABAP/UI5 Developer - EPAM Systems
Views in the last 30 days - 0
EPAM is seeking a Senior Full Stack ABAPUI5 Developer for a highimpact SAP CRM project The ideal candidate should have 5 years of SAP development expe...
View DetailsSenior SAP SD Consultant - EPAM Systems
Views in the last 30 days - 0
EPAM is seeking a Senior SAP SD Consultant to join their team offering a chance to work with toptier companies globally The role involves collaboratin...
View Details