AWS Cloud Data Engineer - Senior
Job Description
Overview
BigBear.ai is seeking a highly skilled and experienced Senior AWS Cloud Data Engineer to join our dynamic team. The ideal candidate will be responsible for building and optimizing our data ingestion processes using a variety of AWS services. A strong background in AWS environments, particularly in constructing data lakes, is highly desirable.
A remote schedule will initially be implemented through the end of August and will increase to hybrid, with 3 days onsite in Chantilly, VA as the project matures.
What you will do
- Design and implement data ingestion pipelines using AWS services such as DMS, DataSync, Glue, Athena, Lambda, S3, RDS, and Step Functions
- Develop and optimize data processing and storage strategies, ensuring efficient data flow within the AWS ecosystem
- Architect and build AWS-based data lakes, ensuring scalability, reliability, and security
- Collaborate with cross-functional teams to understand data needs and implement solutions that meet business objectives
- Ensure data solutions are compliant with security protocols and best practices
- Monitor, troubleshoot, and continuously improve data systems and processes
- Stay abreast of the latest AWS offerings and technologies, identifying opportunities for system enhancements.
What you need to have
- Bachelor's Degree in Computer Science, Engineering, Information Technology and 5+ years of experience, or;
- Associates Degree and 7+ years of experience, or;
- Master's Degree and 3+ years of experience, or;
- PhD and some professional experience
- (in lieu of Bachelor's degree, 9+ years of relevant experience)
- Clearance: able to obtain and maintain active Secret level clearance
- CompTIA Security+ certification
- Minimum of 5 years of experience in data engineering, with a strong focus on cloud-based solutions
- Demonstrated experience with AWS data services (DMS, DataSync, Glue, Athena, Lambda, S3, RDS, Step Functions)
- Proven expertise in designing and building data lakes in an AWS environment
- Strong knowledge of database design, data modeling, and data warehousing principles
- Proficiency in SQL and experience with programming/scripting languages (e.g., Python, Java)
- Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
What we'd like you to have
- AWS Certified Data Analytics - Specialty or AWS Certified Big Data - Specialty certification
- Experience in working with large, complex datasets and real-time data ingestion
- Familiarity with additional AWS services and Infrastructure as Code (IaC) tools, such as CloudFormation and GitLab
- Strong communication and collaboration skills, with an ability to convey complex technical concepts.
About BigBear.ai
BigBear.ai delivers AI-powered analytics and cyber engineering solutions to support mission-critical operations and decision-making in complex, real-world environments. BigBear.ai's customers, which include the US Intelligence Community, Department of Defense, the US Federal Government, as well as customers in manufacturing, healthcare, commercial space, and other sectors, rely on BigBear.ai's solutions to see and shape their world through reliable, predictive insights and goal-oriented advice. Headquartered in Columbia, Maryland, BigBear.ai is a global, public company traded on the NYSE under the symbol BBAI. For more information, please visit: http://bigbear.ai/ and follow BigBear.ai on Twitter: @BigBearai.
What you will do
- Design and implement data ingestion pipelines using AWS services such as DMS, DataSync, Glue, Athena, Lambda, S3, RDS, and Step Functions
- Develop and optimize data processing and storage strategies, ensuring efficient data flow within the AWS ecosystem
- Architect and build AWS-based data lakes, ensuring scalability, reliability, and security
- Collaborate with cross-functional teams to understand data needs and implement solutions that meet business objectives
- Ensure data solutions are compliant with security protocols and best practices
- Monitor, troubleshoot, and continuously improve data systems and processes
- Stay abreast of the latest AWS offerings and technologies, identifying opportunities for system enhancements.
What you need to have
- Bachelor's Degree in Computer Science, Engineering, Information Technology and 5+ years of experience, or;
- Associates Degree and 7+ years of experience, or;
- Master's Degree and 3+ years of experience, or;
- PhD and some professional experience
- (in lieu of Bachelor's degree, 9+ years of relevant experience)
- Clearance: able to obtain and maintain active Secret level clearance
- CompTIA Security+ certification
- Minimum of 5 years of experience in data engineering, with a strong focus on cloud-based solutions
- Demonstrated experience with AWS data services (DMS, DataSync, Glue, Athena, Lambda, S3, RDS, Step Functions)
- Proven expertise in designing and building data lakes in an AWS environment
- Strong knowledge of database design, data modeling, and data warehousing principles
- Proficiency in SQL and experience with programming/scripting languages (e.g., Python, Java)
- Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
Explore More
Date Posted
05/09/2024
Views
6
Similar Jobs
Senior Associate, Data Science - People Analytics - Capital One
Views in the last 30 days - 0
Capital One is seeking a Senior Associate Data Science specialist for their People Strategy Analytics team The role involves applying data science an...
View DetailsSenior Associate, Data Scientist - Customer Management - Capital One
Views in the last 30 days - 0
Capital One is seeking a Senior Associate Data Scientist for the Mainstreet Customer Management Data Science team The role involves partnering with cr...
View Details2025 Sensor Modeling and Simulation Analysis Engineer - The Aerospace Corporation
Views in the last 30 days - 0
The Aerospace Corporation is a trusted partner to the nations space programs providing technical expertise and innovative solutions across satellite l...
View DetailsInformation Security Consultant - Application Security Engineer - MassMutual
Views in the last 30 days - 0
MassMutual is seeking an experienced Application Security Engineer to join their dedicated team The role involves driving security best practices cond...
View DetailsSenior Named Account Executive, SLED - Cloudflare
Views in the last 30 days - 0
Cloudflare is seeking a seasoned sales professional with a technical background to build a Public Sector Sales team in Pennsylvania The ideal candidat...
View Details