Lead Data Engineer
Job Description
Design and build robust, scalable solutions and data pipelines to automate the ingestion, processing and delivery of all types of data: structured and unstructured, batch, and real-time streaming data. Break down complex data issues and resolve them. Use analytical, programming and technical skills to ensure that data ingestion pipelines are scalable, repeatable, secure, and can serve multiple users within. Acquire data from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that users can get that data quickly. Build robust systems with an eye on automation and the long-term maintenance and support of the application. Work directly with the product owner and end-users to constantly deliver products in a highly collaborative and agile environment.
Position allows for telecommuting from anywhere in the US but reports to HQs in Minneapolis, Minnesota.
Specific Skills and other requirements:
In addition, requires the following experience:
- At least 4 years of experience in data engineering working with Big Data Technologies: Apache Spark, Pyspark, Hadoop, and DataBricks with delta lake
- At least 3 years of experience working with JVM Languages including Java or Scala
- At least 2 years of experience building data pipelines, CICD pipelines; and
- At least 1 year of experience working with the following Cloud technologies: AWS, Azure, GitHub, Bamboo, Chef or Terraform.
Must also have demonstrable experience in each of the following:
- Experience with Apache Airflow, Hive, Snowflake, Kafka, Python
- Experience in ETL, SQL, Informatica, Power exchange, Databases like SQL server, DB2, Oracle
- Experience with Data warehouse model with STAR schema
- Experience with BI development and reports
- Experience with developing, executing test cases, UAT, and integration test
Education and experience requirements :
Requires a minimum of a bachelor's or foreign equivalent degree in Management Information Systems, Computer Science and Engineering, or a related field plus 4 years of experience as a software developer, data engineer, or related occupation.
Current Salary: $150,000
Employment Location:
600 Portland Ave, Ste. 100, Minneapolis, Hennepin, Minnesota, 55415
Position allows for telecommuting from anywhere in the US but reports to HQs in Minneapolis, Minnesota.
Other
Thrivent is unique in our commitment to helping people to be wise with money and live balanced and generous lives. That extends to our benefits.
The following benefits may be offered: various bonuses (including, for example, annual or long-term incentives); medical, dental, and vision insurance; health savings account; flexible spending account; 401k; pension; life and accidental death and dismemberment insurance; disability insurance; supplemental protection insurance; 20 days of Paid Time Off each year; Sick and Safe Time; 10 paid company holidays; Volunteer Time Off; paid parental leave; EAP; well-being benefits, and other employee benefits. Eligibility for receipt of these benefits is subject to the applicable plan/policy documents. Thrivent's plans/policies are subject to change at any time at Thrivent's discretion.
Thrivent provides Equal Employment Opportunity (EEO) without regard to race, religion, color, sex, gender identity, sexual orientation, pregnancy, national origin, age, disability, marital status, citizenship status, military or veteran status, genetic information, or any other status protected by applicable local, state, or federal law. This policy applies to all employees and job applicants.
Thrivent is committed to providing reasonable accommodation to individuals with disabilities. If you need a reasonable accommodation, please let us know by sending an email to [email protected] or call 800-847-4836 and request Human Resources.
Date Posted
07/01/2024
Views
6
Similar Jobs
Senior Quality Engineer - Bosch Group
Views in the last 30 days - 0
The Communications Systems Division of Bosch Security Systems is seeking a Senior Quality Engineer with a passion for creating new solutions The role ...
View DetailsTest Engineer - RAZR Marketing
Views in the last 30 days - 0
RAZR a fastgrowing marketing technology company based in Minnetonka MN is seeking a skilled QA Engineer The role involves developing and executing tes...
View DetailsDigital Platform Lead (Digital Product Lead) - Dairy Queen
Views in the last 30 days - 0
The company offers a comprehensive benefit package including medical dental 401K match paid time off parental leave and a commitment to fostering a cu...
View DetailsSoftware Testing Lead - TOSCA - Jack Link's Protein Snacks
Views in the last 30 days - 0
Jack Links a global leader in protein snacks seeks a Software Testing Lead to manage testing methodologies and tools for enterprise applications The r...
View DetailsSenior Engineer, MS&T - Novo Nordisk
Views in the last 30 days - 0
Novo Nordisk a global leader in diabetes care for over a century offers lifechanging careers with opportunities to improve millions of lives worldwide...
View DetailsSr. Manager Data Analytics - Target
Views in the last 30 days - 0
Target is offering a competitive pay range of 111200 to 200200 based on factors such as labor markets education work experience and certifications The...
View Details