Data Engineer

FreightPlus is an industry provider of data-driven transportation management, offering businesses customized and fully tailored managed transportation solutions in a boutique environment where clients get the individual attention they deserve. FreightPlus combines first class customer service with innovative technology and industry best practices to help mid-size and growing companies work efficiently in the $800B domestic transportation market. The Company is ranked #184 in the most recent Inc. 5000 list of fastest growing companies. Visit FreightPlus.io for more information.

Location: Quincy, MA

FreightPlus is seeking a Data Engineer to join our team. Our Data Engineer is responsible for working with our data science team to find trends in data sets and to develop algorithms to help make raw data more useful to the enterprise. This role requires a significant set of technical skills, including a deep knowledge of database design and multiple programming languages. Communication skills are critical when working with various departments across the organization.

Responsibilities

The Data Engineer is responsible for:

• Developing, constructing, testing, and maintaining data architectures
• Aligning data architecture with business requirements
• Architecting and developing core data definitions and migration processes
• Architecting and implementing data acquisition strategies including facade development
• Identifying ways to improve data reliability, efficiency and quality
• Planning and conducting research to answer industry and business questions
• Leveraging large data sets to address business issues
• Finding hidden patterns using data
• Deploying sophisticated analytics programs, machine learning and statistical methods
• Preparing data for predictive and prescriptive modeling
• Using data to discover tasks that can be automated
• Delivering analytics-based regular reporting updates to stakeholders

Archetypes, Progression, and Scaling

For this role we are looking for a Generalist.

• Generalist: Generalists are typically found on small teams or in small companies. In this setting, data engineers wear many hats as one of the few "data-focused" people in the company. Generalists are often responsible for every step of the data process, from managing data to analyzing it. This is a good role for anyone looking to transition from data science to data engineering, since smaller businesses won't need to worry as much about engineering "for scale."
• Pipeline-centric: Often found in midsize companies, pipeline-centric data engineers work alongside data scientists to help make use of the data they collect. Pipeline-centric data engineers need "in-depth knowledge of distributed systems and computer science," according to Dataquest.
• Database-centric: In larger organizations, where managing the flow of data is a full-time job, data engineers focus on analytics databases. Database-centric data engineers work with data warehouses across multiple databases and are responsible for developing table schemas.

Requirements

• Our Data Engineers will lead by example. Data Engineers must therefore possess and express all the qualities we expect in our developers, including curiosity, passion, self-accountability, and diligence. In addition, owning a project's execution will require them to be organized, disciplined, and autonomous; leading a team will require them to be patient, excellent verbal and written communicators, and able to move fluidly between macro and micro concerns

  Helpful Skill Sets & Experience

  • Fundamental understanding of:
  • Python / R / Scala / Java
  • Apache Spark / Hadoop
  • Snowflake / 5Trans
  • Data modeling and warehousing
  • Cloud technology platforms (GCP / Amazon / Azure)
  • Big data analytics
  • Database technology such as MySQL, Oracle, and MongoDB
  • Software development
  • Architecting SOA applications
  • Writing user stories
  • Collaborating with internal / external engineering teams

  Certifications (Preferred)

  • Cloudera Certified Professional (CCP): Data Engineer
  • Google Cloud Certified Professional Data Engineer
  • Certificate in Engineering Excellence Big Data Analytics Optimization (CPEE)
  • IBM Certified Data Engineer - Big Data
  • Amazon Data Engineer Certification

Benefits

The compensation package includes a competitive salary, performance bonuses, health & dental benefits, and unlimited PTO.