Job Description
Position Summary:
The Data Engineer II designs and develops systems that collect transform store and manage data for end users. They perform coding debugging testing and troubleshooting throughout the development process. The Engineer mentors junior level Engineers. They collaborate with other functional groups to conduct software design reviews.
Meet the team and hear what they have to say about our Product & Engineering group: Meet the Team
Essential Responsibilities:
-
Builds pipelines to ingest new data sources
-
Transforms data to support varied use cases
-
Optimizes existing data pipelines and improves existing code quality
-
Includes testing in all aspects of the development process
-
Mentors junior level Engineers
-
Analyzes potential problems and finds solutions to pressing data issues
-
Participates in on-call rotation
Ideal Skills Experience and Competencies:
-
At least two (2) to six (6) years of relevant data engineering experience
-
Intermediate experience with Python
-
Advanced experience with SQL
-
Experience with Data Modeling
-
Moderate experience with a JVM language
-
Intermediate experience with Apache Spark or other distributed processing engines
-
Intermediate experience with Apache Kafka or other stream processing frameworks
-
Moderate experience with Terraform Docker Kubernetes or other similar infrastructure tooling
-
Intermediate experience with cloud data tools such as S3 Glue and Athena
-
Exposure to building CI/CD pipelines
-
Effective problem solving and troubleshooting abilities
-
Ability to consistently achieve results even under tough circumstances
Required Education & Certifications:
-
B.A./B.S. in related field or equivalent work experience
Compensation:
-
Qualified candidates can expect a salary beginning at $115000 or more depending on experience
#LI-Remote #LI-JF1 #dice-J #BI-Remote
Date Posted
03/22/2024
Views
0
Similar Jobs
Open Rank- Assistant, Associate, Professor – Pediatric Body Radiologist - University of Colorado
Views in the last 30 days - 0
View DetailsCustomer Success Manager (Sustainability Solutions) - Worldly
Views in the last 30 days - 0
View Details