Data Engineer

• Role Overview: FTC is seeking a talented Data Engineer to support the Defense Intelligence Agency.

• Responsibilities:
  • Designs, implements, and operates data management systems for Intelligence needs.
  • Designs how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems.
  • Work with data users to determine, create, and polulate optimal data architecutres, structures, and systems.
  • Plans, designs, and optimizes data throughput and query performance.
  • Participates in the selection of backend database technologies (e.g. SQL, NoSQL, HPC, etc).
  • Advise on the configuration, utilization and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to support the intended queries and analysis to match expected responsiveness.
  • Build and automate data pipelines.
  • Work as a member of a team assigned to design and implement data collection, integration, and transformation solutions.
  • Understand and rapidly comprehend new functional and technical areas and apply detailed and critical thinking to customer solutions.
  • Propose design solutions and recommend best practices for large-scale data analysis.
  • Meet the data needs of data scientists
  • Help reduce code vulnerabilities exposed by static testing tools
  • Assist with teaching new software developers best practices in coding and development
  • Transform a variety of input data structures into a unified data structure that aligns with the established ontology

• Hands-on experience in ETL, Data warehouse, Data Marts, Visualization and/or building data pipelines, modeling and designing schema for data lakes or for data platforms.
• Experience with Agile implementation methodologies.
• Experience using common CI/CD tools
• Experience working with databases in both the extract and load aspects of the ETL process.
• Strong programming and scripting skills experience and expertise in two or more of the following: XML/XSLT, Python, Perl, Shell Scala, C.
• Proficient in big data/distributed computing frameworks
• Practice working with, processing, and managing large data sets

Professional Certification(s):

Formal Education:

Bachelor’s Degree in computer science, mathematics or other relevant technical fields.

Years of Professional Experience:

4-6 years of relevant subject matter experience, or specialized training and 4-8 years’ of subject matter experience.

• N/A

Professional Certification(s):

Formal Education:

Years of Professional Experience:

• N/A