Data Engineer (Apache Spark)

Sunscrapers · Other US Location

Company

Sunscrapers

Location

Other US Location

Type

Full Time

Job Description

Description

Are you ready to take the challenge?

We’re looking for a Data Engineer to join our team in Warsaw or remotely.

Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.

As a Data Engineer you’ll play a pivotal role in building a robust data platform that drives engagement solutions for leading healthcare brands. Your work will directly support the development of omnichannel digital health experiences, empowering consumers to access the programs, benefits, and care they need.

In this role, you’ll leverage cutting-edge technologies such as Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions. You’ll enable actionable insights by integrating diverse data sources, building efficient pipelines, and supporting data-driven decision-making.

Your responsibilities will include:

  • Design and manage batch data pipelines, including file ingestion, transformation (e.g., CSV to structured formats), and Delta Lake/table management,
  • Implement scalable architectures for batch and streaming workflows,
  • Leverage Microsoft equivalents of BigQuery for efficient querying and data storage.
Requirements

What's important for us?

  • At least 3 years of professional experience as a data engineer,
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar,
  • Excellent command in spoken and written English, at least C1,
  • Strong professional experience with Apache Spark,
  • Hands on experience on managing production spark clusters either in Databricks,
  • Experience in CI/CD of data jobs in spark,
  • Great analytical skills and attention to detail - asking questions and proactively searching for answers,
  • Creative problem-solving skills,
  • Great customer service and troubleshooting skills.

You'll score extra points for:

  • Experience with BigQuery,
  • Experience in managing data governance in the healthcare space.
Benefits

What do we offer?

  • Working alongside a talented team that’s changing the image of Poland abroad.
  • Flexible working hours and remote work possibility.
  • Comfortable office in a penthouse in central Warsaw equipped with all the necessary tools to conquer the universe (Macbook, external screen, ergonomic chairs).
  • Fully equipped kitchen with fruit, hot and cold drinks.
  • Multisport card & Private medical care.
  • Culture of good feedback: evaluation meetings, mentoring.
  • We value and appreciate our engineers eagerness to learn and improve so we strongly encourage and support their growth!

Sounds like a perfect place for you? Don’t hesitate to click apply and submit your application today!

Apply Now

Date Posted

11/21/2024

Views

0

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.8

Similar Jobs

Software Architecture Engineering and Cloud Computing Engineer - The Aerospace Corporation

Views in the last 30 days - 0

The Aerospace Corporation is seeking a Senior Project Engineer with expertise in software architecture engineering and cloud computing The role involv...

View Details

Senior Data Analyst - Customer Experience - WISE

Views in the last 30 days - 0

Wise is a global technology company aiming to revolutionize international money transfers by offering minimal fees maximum ease and full speed They ar...

View Details

Lead Data Analyst - Mitigation - WISE

Views in the last 30 days - 0

Wise is a global technology company seeking an Operations Analyst with 4 years of experience in analytics particularly in operational team analytics T...

View Details

Lead Technical Support Engineer - HERE Technologies

Views in the last 30 days - 0

This role Senior Technical Support Engineer at HERE Technologies involves supporting a diverse portfolio of products and services acting as a technica...

View Details

Principal / Lead Software Engineer- RUST (Algorithmic and Mathematics) - m/w/d - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking a Principal Software Engineer to lead the development of extended services for their VRP solver Tour Planning The role in...

View Details

Senior Software Engineer (Scala/Java) - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking an experienced backend engineer with strong Java or Scala skills to join the Map Processing Pipelines team The role invol...

View Details