Data Engineer (Databricks )
Job Description
- Assist in the development and optimization of ETL processes using PySpark and Databricks.
- Collaborate with team members to design and implement data models and architecture in AWS.
- Maintain and monitor data pipelines to ensure data quality and reliability.
- Utilize GitHub for version control and collaboration on codebases.
- Participate in code reviews and contribute to best practices in coding and data engineering.
- Support the team in implementing CI/CD practices for data workflows.
- Document processes and workflows for data engineering tasks.
- Familiarity with AWS services (e.g., S3, Redshift, Glue) and cloud computing concepts.
- Basic knowledge of Databricks and PySpark for data processing.
- Understanding of Git and experience with GitHub for version control.
- Awareness of DevOps principles and tools (e.g., CI/CD, Docker) is a plus.
- Databricks certification is a plus.
Date Posted
11/18/2024
Views
0
Similar Jobs
Software Architecture Engineering and Cloud Computing Engineer - The Aerospace Corporation
Views in the last 30 days - 0
The Aerospace Corporation is seeking a Senior Project Engineer with expertise in software architecture engineering and cloud computing The role involv...
View DetailsSenior Data Analyst - Customer Experience - WISE
Views in the last 30 days - 0
Wise is a global technology company aiming to revolutionize international money transfers by offering minimal fees maximum ease and full speed They ar...
View DetailsLead Data Analyst - Mitigation - WISE
Views in the last 30 days - 0
Wise is a global technology company seeking an Operations Analyst with 4 years of experience in analytics particularly in operational team analytics T...
View DetailsLead Technical Support Engineer - HERE Technologies
Views in the last 30 days - 0
This role Senior Technical Support Engineer at HERE Technologies involves supporting a diverse portfolio of products and services acting as a technica...
View DetailsPrincipal / Lead Software Engineer- RUST (Algorithmic and Mathematics) - m/w/d - HERE Technologies
Views in the last 30 days - 0
HERE Technologies is seeking a Principal Software Engineer to lead the development of extended services for their VRP solver Tour Planning The role in...
View DetailsSenior Software Engineer (Scala/Java) - HERE Technologies
Views in the last 30 days - 0
HERE Technologies is seeking an experienced backend engineer with strong Java or Scala skills to join the Map Processing Pipelines team The role invol...
View Details