Sr. Data Engineer

Role: Sr. Data Engineer

Duration: 4- Months

Location: Hillsboro, OR

Note: Onsite preferred but open to remote

Key Skills: Data Lake, AWS, EMR, S3, Hive, Spark, Snowflake, Apache, Nifi

Top 3 Skills: Advanced experience building cloud scalable, real time and high-performance data lake solutions leveraging AWS, EMR, S3, Hive & Spark Experience with cloud warehouse tools like Snowflake Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi Job

Qualifications

• Masters' or Bachelors' degree in Computer Science or a related field
• 6+ years of experience in data engineering development
• 4+ years of experience implementing scalable data architectures
• 3+ years of experience in large-scale software development with emphasis on data analytics and high-volume data processing
• 3+ years of experience with AWS and related services (e.g., EC2, S3, DynamoDB, ElasticSearch (DSL Queries ) ,Kinesis Streams, SQS, SNS, Lambda, AppSync )
• Expert Experience in python is a hard requirement. Experience in other data-centric programming languages is a plus.
• 5+ years of experience in database development using relational and non-relational database is preferred. SQL experience is preferred.
• Experience with CI/CD tools like Jenkins / Terraform as IAAS ( infrastructure as a service )
• Experience with Docker. Deploying containerized solutions in AWS ( ECS / EKS )

Job Description:

• Provide engineering on modern, cloud-based data processing technology stack
• Build data pipelines, data validation frameworks, job schedules with emphasis on automation and scale
• Contribute to overall architecture, framework, and design patterns to store and process high data volumes
• Ensure product and technical features are delivered to spec and on-time
• Design and implement features in collaboration with product owners, reporting analysts / data analysts, and business partners within an Agile / Scrum methodology
• Proactively support product health by building solutions that are automated, scalable, and sustainable - be relentlessly focused on minimizing defects and technical debt
• Should be a good communicator, excellent team player, able to collaborate with remote team members over zoom, demonstrating great flexibility