Software/Data Engineer

• Leveraging expertise in data pipeline services and architectures to support mission-critical operations
• Recommending tools and capabilities  based on your research of the current environment and knowledge of various on-premise, cloud based, and hybrid resources
• Working with the client's migration teams to implement strategy and data pipeline design This is an opportunity to stay on top of the latest data architecture resources as you prototype using multiple data pipelines
• Transforming the client's critical data pipelines by taking advantage of emerging technologies  

• 5+ years of experience with demonstrated strength in data lake/warehouse technical architecture, infrastructure components, and ETL/ELT pipelines
• 5+ years of experience with workflow management engines (i.e Airflow, AWS Step Functions, Prefect)
• Experience with non-proprietary big data technologies (Presto, Hive, Spark, Flink etc.) - Presto/Trino is preferred
• Experience understanding requirements, analyzing data, discovering opportunities, addressing gaps and communicating them to multiple individuals and stakeholders
• 5+ years with hands-on experience in writing complex, highly-optimized SQL queries across large data sets
• 5+ years of experience with scripting languages like Python
• Experience in leading and delivering end-to-end data pipelines
• Bachelor’s degree in Software Engineering, Computer Science, Information Systems, or equivalent years of application development experience
  
• US Citizenship and an active TS/SCI with Polygraph security clearance
  

Desired Qualifications:

• Experience with deploying containerized microservices in kubernetes infrastructure
• Experience with working in defense or intelligence community cloud environments is a plus
• Experience with developing and managing machine images or templates to automate cloud deployments
• Experience with optimizing data pipelines, including leveraging native cloud capabilities, right-sizing servers, expanding storage, and tracking cost efficiencies at the  microservice level  
• Experience with configuring and aggregating logs for data analysis using Splunk or ELK solutions