Sr. Data Engineer - Big Data, Python, SQL, Spark,
Job Description
Role: Sr. Data Engineer - Big Data, Python, SQL, Spark,
Duration: 12 Months (Contract)
Location: Beaverton, OR (On-Site/Hybrid)
Key Skills: Big Data/Hadoop, large-scale software development, Java/Scala, Python, PySpark, SQL, NOSQL, Apache, Spark, Flink, Kafka, Shell, Spark, Hive, MapReduce, RESTful APIs, DevOps,
Requirements:
- MS/BS degree in a computer science or related discipline
- 3+ years' experience in large-scale software development/Big Data technologies
- Programming skills in Java/Scala, Python, Shell scripting, and SQL
- Development skills around Spark, MapReduce, and Hive
- Strong skills around developing RESTful API's
Responsibilities:
- Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem. You will be given the opportunity to own the design and implementation. You will collaborate with Product managers, Data Scientists, Engineering folks to accomplish your tasks.
- Publish RESTful API's to enable real-time data consumption using OpenAPI specifications. This will enable many teams to consume the data that is being produced.
- Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Flink, Kafka stream.
- Take part in DevOps by building utilities, user defined functions and frameworks to better enable data flow patterns.
- Work with architecture/engineering leads and other teammates to ensure high quality solutions through code reviews, engineering best practices documentation.
- Experience in Business Rule management systems like Drools will also come in handy.
Email your resume to: [email protected]
To learn more about Mavensoft visit us online at http://www.mavensoft.com/
Date Posted
06/04/2023
Views
11
Positive
Subjectivity Score: 0.9
Similar Jobs
Senior Manager, Communications Business Partner, Technology - Autodesk
Views in the last 30 days - 0
View DetailsField Service Representative - Drives/Industry - Schneider Electric
Views in the last 30 days - 0
View Details