Senior Data Engineer - PySpark, AWS, Big Data
Job Description
Duration:12 months
Pay rate: $79/hr
Location:Remote (PST hours)
Key Skills Required: PySpark, AWS, Big Data
Job Responsibilities:
- Description Design and build reusable components, frameworks and libraries at scale to support analytics products.
- Design and implement product features in collaboration with business and Technology stakeholders
- Anticipate, identify and solve issues concerning data management to improve data quality
- Clean, prepare and optimize data at scale for ingestion and consumption•
- Drive the implementation of new data management projects and re-structure of the current data architecture•
- Implement complex automated workflows and routines using workflow scheduling tools•
- Build continuous integration, test-driven development and production deployment frameworks•
- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards•
- Analyze and profile data for designing scalable solutions
- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
- Mentor and develop other data engineers in adopting best practices
Date Posted
12/31/2022
Views
10
Similar Jobs
Senior Structural Engineer - HDR
Views in the last 30 days - 5
HDR is a company that specializes in engineering architecture and construction services They believe in diversity and collaboration and offer employee...
View DetailsSenior Frontend Engineer - ICIS
Views in the last 30 days - 0
Cirium is a company that provides data and aviation analytics solutions to various industries They are looking for a senior frontend software engineer...
View DetailsSoftware Engineer - DAT
Views in the last 30 days - 1
DAT is looking for a Software Engineer to join their team in Beaverton OR or Denver CO The role involves working in a full stack TypeScript ecosystem ...
View DetailsIT Engineer - DAT
Views in the last 30 days - 0
DAT is seeking a strong IT Engineer to join their growing technical team and drive the evolution of their technology infrastructure and end user exper...
View DetailsIntermediate/ Senior GIS Analyst - Stantec
Views in the last 30 days - 7
The text describes an intermediatesenior GIS analyst position at Stantec offering the opportunity to work on diverse industry areas such as energy tra...
View DetailsSoftware Engineer (Mid-level) - Act-On Software
Views in the last 30 days - 7
ActOn is a leading marketing automation company looking for a Software Engineer to join their team The company offers a supportive and fun culture com...
View Details