Data Engineer II

Branching Minds · New York City, NY

Company

Branching Minds

Location

New York City, NY

Type

Full Time

Job Description

Who We Are & What We Do:

Branching Minds' mission is to empower all educators to effectively, efficiently and equitably support the holistic needs of their students; and to create a path to academic and personal success for every learner. Already supporting over 1,000,000 students across 100+ districts from 30 states, our vision is to be the most impactful national K12 school district solution for achieving high-fidelity RTI/MTSS; consistently demonstrating our ability to save teachers planning/documenting time, improve outcomes of our students, and eliminate achievement gaps.

As a startup, we don't have to play by the rules of traditional organizations. We get to be innovative in the solutions we develop for our partners and the way we conduct our business for ourselves. Branching Minds is also a Benefit corporation, we get to prioritize our mission > profit, and the means of getting there is just as important as the ends. We err towards self management, transparency, collaboration, initiative, and giving a damn.

If using innovation to reimagine education in service of equity energizes you -- join our team!

The Calling:

The Data Engineer II is responsible for maintaining the quality of customer data and data processes. This includes facilitating the data workflows within Branching Minds by accessing, validating, and organizing the data received from our customers. The Data Engineer II will collaborate with Implementation, Account, and Product Engineering teams to ensure a holistic support process for Branching Minds' client needs. The Data Engineering team reports into the VP of Engineering.

What You'll Do:

  • Ensure all valid customer data gets loaded into the BRM platform
    • Triage and validate inbound customer data leveraging manual and automated processes within AWS S3, Airtable, and OneSchema; communicate with Implementation, Account, and Support specialists regarding data issues discovered
    • Transform validated customer data using SQL and Python within Databricks
    • Load customer data into the BRM platform via proprietary ingestion jobs; collaborate with Product Engineering specialists to troubleshoot and resolve load issues discovered
  • Monitor the accuracy and integrity of all ingested data
  • Troubleshoot data ingestion and export issues and inaccuracies; assist Product Engineering team in troubleshooting data load failures
  • Ensure all valid customer export requests are processed in a timely manner
    • Validate customer export requests alongside data and engineering cohort
    • Write queries/scripts using SQL and Python producing requested customer output
    • Verify resulting output and make exported data available for customers to consume
  • Build and maintain documentation about BRM's data ingestion and export processes
  • Build and maintain systems that increase automation of manual BRM data processes:
    • Configure and maintain OneSchema templates to ease inbound customer data validation
    • Build and maintain Databricks Workflow orchestrations to support further automation of data ingestion and export processes

Requirements

Why We Want You:

  • Love manipulating data and using data to answer questions
  • SQL nerd and love it; primarily PostgreSQL and Databricks SQL
  • Love programming with Python
  • Enjoy using Databricks to transform data using both Python and SQL with two to three years of experience using Databricks, Python, and SQL in professional environments
  • Passionate about improving education and committed to equity of success for all learners
  • Able to problem solve in order to resolve complex data issues and data discrepancies
  • Take pleasure in automating manual processes leveraging tools like Airtable, Databricks, and OneSchema

Lucky Us If You:

(No biggie if you don't)

  • Have experience working in or alongside customer support or IT support
  • Previously worked in K-12 and/or EdTech

Interview Process:

If we are a match you can expect a total of 3 steps in the interview process after the initial application

  • An initial, 45 minute Phone Screening with our VP of Engineering
  • A 60 minute Technical Interview with our Data Engineering Lead and VP of Engineering

Benefits

What We Offer You:

  • Check out our Benefits & Perks (https://secure.justworks.com/benefits/company_bene)
  • Fully remote!
  • Base annual compensation for this role is $76,000 - $95,000 based on experience and level of expertise
  • An awesome, cross-disciplinary, mission-driven team solving meaningful problems that improves the lives of educators and students.

In Our Own Words We Are

Independent, Relaxed, Ownership, Flexibility, Always Learning, Casual, Adaptable, "Best Idea Wins," Passionate, Dedicated, Very Capable/Competent, Efficient, Communicative, Welcoming, Caring, Scrappy, Friendly, Co-operative, Agile, Supportive, Principle-Driven, Respectful, Practical, Attentive, Funny, Self-Motivated, Silly Parrots.

Our Commitment to Diversity, Equity & Inclusion

At Branching Minds, a diverse, inclusive, and equitable workplace is one where everyone, regardless of their gender, race, ethnicity, national origin, age, sexual orientation or identity, education, professional and life experiences, disabilities and abilities; feels valued and respected. We are proud to be an equal opportunity employer that is committed to continuing to create a diverse, inclusive and equitable environment.

Our Commitment to People with Disabilities

Branching Minds is committed to disability inclusion, and to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [email protected]

Date Posted

06/19/2023

Views

10

Back to Job Listings Add To Job List Company Profile View Company Reviews
Neutral
Subjectivity Score: 0.5

Similar Jobs

Senior Software Engineer, Devices Automation - Block

Views in the last 30 days - 0

Square a company that has evolved since its inception in 2009 is seeking a Software Engineer with extensive experience in embedded devices and test en...

View Details

IT Support Engineer (Contract) - Informa

Views in the last 30 days - 0

Curinos a company with decades of expertise in the financial services industry is seeking an IT Support Engineer for their New York office The role in...

View Details

Engineer, Quality Assurance – BBU (EQA1) - JMA Wireless

Views in the last 30 days - 0

JMA is a leading company in wireless technology particularly in 5G with its advanced softwarebased platform manufactured in Syracuse NY The companys t...

View Details

Staff Editor, Current Events - Dotdash Meredith

Views in the last 30 days - 0

The Staff Editor role involves coordinating crossplatform content across multiple verticals managing daily and breaking news and writingediting storie...

View Details

Software Engineering Lead - Dotdash Meredith

Views in the last 30 days - 0

Dotdash Meredith is seeking a skilled Engineering Lead for a missioncritical role in designing and scaling their nextgeneration publishing platform Th...

View Details

Business Account Executive - Spectrum

Views in the last 30 days - 0

The Business Account Executive role involves selling primary and ancillary communications solutions to small and mediumsized businesses within a speci...

View Details