Lead Data Engineer - BigData, Python, AWS, SQL at Mavensoft Technologies - Portland, OR

Lead Data Engineer - BigData, Python, AWS, SQL

Job Description

Role: Lead Data Engineer - BigData, Python, AWS, SQL

Duration: 12 Months

Location: Beaverton, OR (On-Site Preferred)

Key Skills: Data Engineering, Big Data/Hadoop, Spark, SQL, Python, NoSQL, RESTful, AWS, Snowflake, Airflow, Data Lake

Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
7+ years relevant work experience in the Data Engineering field
4+ years proven experience working with Hadoop and Big Data processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink, etc.)
2+ years experience building scalable, real-time and high-performance cloud data lake solutions
Strong experience with relational SQL and programming languages such as Python, Scala, or Java
Experience with source control tools such as GitHub and related CI/CD processes
Experience working with Big Data streaming services such as Kinesis, Kafka, etc.
Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
Experience provisioning RESTful API's to enable real-time data consumption
Experience working in AWS environment primarily EMR, S3, Kinesis, Redshift, Athena, etc
Experience with data warehouses/RDBMS like Snowflake & Teradata
Experience with workflow scheduling tools like Airflow
Strong understanding of algorithms, data structures, data architecture, and technical designs.
Proven ability to influence and communicate effectively with team members and business partners
Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions

Similar Jobs

Lead Data Engineer - BigData, Python, AWS, SQL