Data Engineer (Spark/Hive)

Dev Technology Group, Inc. · Other US Location

Company

Dev Technology Group, Inc.

Location

Other US Location

Type

Full Time

Job Description

Dev Technology is a growing IT company with an employee-centric culture that works on mission-critical projects for the federal government. We partner with our federal customers to deliver technology services and solutions, and to drive our client’s missions forward through innovation. We use Agile and DevSecOps principles to provide services including application development, biometrics and identity management, cloud and infrastructure optimization, IT and legacy modernization, and data management.   

As a Washington Post Top Workplace award winner for the past nine years in a row, the Top Workplaces USA for the past two years, and a recipient of the Companies As Responsive Employers (CARE) Award for the past four years, Dev Technology employees enjoy:   

  • Generous and flexible time-off policy
  • Flexible work schedules and telework options, including remote work availability for eligible projects
  • Career development opportunities including a mentorship program, technical and management training through Dev University, hands-on learning through DevLab, tuition reimbursement, and paid training opportunities
  • Industry-leading benefits including a choice of two health plans that include dental and vision, flexible spending account, commuter benefits, life insurance, and more
  • 401K matching with immediate vesting and end of year profit sharing  
  • Regular team and company social events including our annual party, happy hours, fitness challenges, and more  
  • A focus on community engagement including companywide support activities, employer match for donations, and time off for volunteer efforts
  • To learn more about working at Dev Technology visit, Learn About A Day At Dev Technology

Data Engineer (Spark/Hive) #581

What You'll Be Doing 

The Data Engineer will work with our analytics team on delivering data sets and tools for our government client to support their operational decision-making. The successful candidate will be flexible and forward-leaning, able to learn new tools and skills, and support our team’s effort to efficiently index, catalog and prepare raw data that feeds data science projects. 

Required Skills and Experience:

  • Bachelor’s degree plus at least 5 years in a data engineering role including databases, data integration, data mining, big data
  • Experience using Spark and Hive
  • Strong SQL experience on large complex data systems
  • Experience understanding information security controls related to data
  • Experience with Python
  • Ability to learn new tools quickly as needed to provide new ideas for solving problems
  • Ability and desire to work with other program staff and customers to reach design decisions within given constraints
  • Excellent diplomacy and communication skills with both clients and technical staff 

Preferred Skills and Experience:

  • Experience designing data structures for a microservices environment (to be state)
  • Proficiency in scripting languages
  • Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, SAP HANA, Databricks
  • Integration experience with AWS services such as Athena, Redshift and/or S3 buckets
  • Experience with AWS serverless data transformation experience (such as with Glue)
  • Experience working with federal government clients
  • Experience with ETL and business intelligence tools (Informatica)
  • Knowledge of Jupyter notebooks with Python code and Pandas

Clearance: CBP Public Trust or the ability to obtain  

Dev Technology Group operates in the following states: AL, AR, AZ, CO, DC, FL, GA, ID, IL, IN, MD, MA, ME, MN, NC, NJ, OR, PA, SC, TX, VA, WV.



EEO/AA/Disability/Vets Employer



Apply Now

Date Posted

02/14/2023

Views

1

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Software Architecture Engineering and Cloud Computing Engineer - The Aerospace Corporation

Views in the last 30 days - 0

The Aerospace Corporation is seeking a Senior Project Engineer with expertise in software architecture engineering and cloud computing The role involv...

View Details

Senior Data Analyst - Customer Experience - WISE

Views in the last 30 days - 0

Wise is a global technology company aiming to revolutionize international money transfers by offering minimal fees maximum ease and full speed They ar...

View Details

Lead Data Analyst - Mitigation - WISE

Views in the last 30 days - 0

Wise is a global technology company seeking an Operations Analyst with 4 years of experience in analytics particularly in operational team analytics T...

View Details

Lead Technical Support Engineer - HERE Technologies

Views in the last 30 days - 0

This role Senior Technical Support Engineer at HERE Technologies involves supporting a diverse portfolio of products and services acting as a technica...

View Details

Principal / Lead Software Engineer- RUST (Algorithmic and Mathematics) - m/w/d - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking a Principal Software Engineer to lead the development of extended services for their VRP solver Tour Planning The role in...

View Details

Senior Software Engineer (Scala/Java) - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking an experienced backend engineer with strong Java or Scala skills to join the Map Processing Pipelines team The role invol...

View Details