AWS Big Data Architect

GAMA-1 Technologies, LLC is seeking a remote experienced and highly motivated Cloud Big Data Expert with experience in AWS and data lake technologies to join our team. . In this role, the successful candidate will be instrumental in driving GAMA-1's efforts to support cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and National Environmental Satellite, Data, and Information Service (NESDIS) with a focus on architecting and provisioning enterprise-level Cloud services, including Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS)

The ideal candidate will have a strong background in big data analytics, data engineering, and cloud computing, with a focus on building and optimizing data lakes on AWS. The Cloud Big Data Expert plays a crucial role in designing, implementing, and managing advanced data solutions using both AWS and Data Lakehouse platforms. This position requires a blend of skills in cloud computing, data engineering, and analytics. Responsible for optimizing performance, ensuring security and compliance, and providing support and troubleshooting. Collaboration with data scientists and analysts is also key, ensuring the platform meets analytics needs while staying updated with the latest technologies and practices in the field. 
 
Responsibilities: 

• Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services. Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics. Collaborate with cross-functional teams to understand business needs and translate them into technical solutions. Utilize Databricks for big data processing and streaming analytics. 
• Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility. Optimize data storage and processing for performance and cost efficiency. Automate data workflows and ensure high data quality and reliability. Monitor, troubleshoot, and resolve data pipeline issues. 
• Organizing and managing data within the environment, ensuring it is stored efficiently, securely, and in a manner that supports easy access and analysis. Monitor the performance of data processes and queries and optimize efficiency and speed. 
• Ensure high standards of data quality and implement data governance practices. Stay current with emerging trends and technologies in cloud computing, big data, and data engineering. 
• Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure. 
• Create documentation for the platform infrastructure and processes, and train other team members or users on the platform effectively.
• Setup configure, implement, and maintain the data lake and respective tools. 

Qualifications: 

• 5 years’ experience in big data analytics, data engineering, or related roles 
• Experience in designing, building, and maintaining data warehouses. Understanding of data modeling, data warehousing, and data lake concepts. 
• Proficiency in programming languages such as Python, Java, Scala, and scripting languages like Bash or PowerShell. 
• Experience with big data technologies, such as Apache Hadoop, Spark, Kafka, and others. 
• Hands-on experience with AWS services such as S3, Glue, Redshift, EMR, Athena, etc. 
• Proficiency in SQL and experience with relational databases. 
• Experience in building and optimizing big data pipelines, architectures, and data sets. 
• Familiarity with ETL tools, processes, and data integration techniques. 
• Excellent communication and team collaboration skills.
• AWS Certification
• Must be able to obtain a security clearance

 
Education and Experience:

• BS in Computer Science, IT, Software or Computer Engineering, Data Science or Analytics, Mathematics or related field