Databricks Data Engineer

Databricks Data Engineer #530

Clearance: Ability to obtain the required government security clearance (CBP Final)

Dev Technology is looking for a new Databricks Data Engineer to contribute to our government customer's new environment for providing data for analytics and reporting. This is a new area for our customer, and the successful candidate will bring their Databricks and data management experience to the table in a variety of ways, such as helping define how best to create data structures that our data scientists can use for their business cases. We are looking for a self-starter, independent, willing to pitch in wherever it is needed inside the data management focus.

What You'll Be Doing 

The Databricks Data Engineer will work with our data visualization and data science teams to design and execute Databricks development tasks in support of their business use cases. This will bring together your current knowledge along with future learning opportunities in this large data management area. There are plenty of new technologies to learn about in this role, and you will be at the front of that action. 

Required Education, Experience, and Skills:

• Bachelor’s degree required
• 10+ years in a data engineering role including databases, data integration, data mining, big data
• Experience working on a software development program with complex data management needs
• Experience with Databricks database development and administration
• Experience using Spark
• Experience with AWS-specific data management strategies
• Ability to learn new tools quickly as needed to provide new ideas for solving problems
• Ability and desire to work with other program staff and customers to reach design decisions within given constraints
• Excellent diplomacy and communication skills with both clients and technical staff

Preferred Education, Skills, and Experience:

• Experience defining data strategy, technology standards, best practices and data governance processes
• Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, S3, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, Informatica, Python, SAP HANA
• Experience working with federal government clients
• Experience with ETL and business intelligence tools (Informatica)