Job Description
Description:
We are looking for a Data Engineer who is adept at building and maintaining data engineering frameworks such as DBT SQLMesh and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines ensuring they are efficient and aligned with the bank's data strategy.
Key Responsibilities:
ยทย ย ย ย ย ย Experience with AWS data services including AWS EMR Glue S3 Redshift and other related technologies.
ยทย ย ย ย ย ย Proven experience in building advanced data engineering frameworks on AWS EMR/Glue Apache Spark and other AWS Data services technology.
ยทย ย ย ย ย ย Strong understanding of writing efficient reliable and maintainable code to manage data workflows.
ยทย ย ย ย ย ย Solid foundation in software engineering including Object-Oriented Design (OOD) and design patterns.
ยทย ย ย ย ย ย Optimize data processing pipelines for performance and scalability.
ยทย ย ย ย ย ย Collaborate with data architects to implement best practices and improve data framework capabilities.
ยทย ย ย ย ย ย Assist in resolving technical challenges and provide support to the data engineering team.
Minimum Qualifications:
ยทย ย ย ย ย ย Bachelorโs degree in Computer Science Engineering or a related technical field.
ยทย ย ย ย ย ย 3+ years of hands-on experience with AWS services specifically EMR and Glue.
ยทย ย ย ย ย ย Proficiency in building data engineering frameworks like DBT SQLMesh or Coalesce.
ยทย ย ย ย ย ย Solid understanding of SQL data modeling and ETL processes.ย Preferred Qualifications:
ยทย ย ย ย ย ย Experience with version control systems and CI/CD pipelines.
ยทย ย ย ย ย ย Familiarity with additional AWS services and data analytics tools.
Date Posted
09/14/2024
Views
0
Similar Jobs
Big Data Manager - Professional Services - Databricks
Views in the last 30 days - 0
This job description outlines a Big Data Manager role focusing on client engagements with the Databricks platform requiring expertise in data engineer...
View DetailsSr. Big Data Engineer - Databricks
Views in the last 30 days - 0
This job description outlines a Sr Big Data Engineer role focusing on client engagements with big data challenges using Databricks Platform Responsibi...
View DetailsEngineering Manager - Release Engineering - Zapier
Views in the last 30 days - 0
Zapier is seeking an Engineering Manager to lead a Release Engineering team focused on improving software delivery pipelines testing frameworks and su...
View DetailsManager - Engineering - Bugcrowd
Views in the last 30 days - 0
This job posting seeks a Senior Manager Software Engineering with expertise in cloudnative architecture and AI tools to lead an integration team focus...
View DetailsWNS Global Services - WNS Global Services
Views in the last 30 days - 0
This text promotes a job posting platform for WNS Global Services emphasizing the use of SmartRecruiters and a beta feature to filter spam applicants ...
View DetailsGlobal Payments Operations Analyst - Blackbaud
Views in the last 30 days - 0
This job description outlines the role of a Global Payments Operations Analyst emphasizing responsibilities such as transaction processing operational...
View Details