Sr. Data Engineering Manager - Hadoop/BigData, SQL, Spark, AWS
Job Description
Role: Sr. Data Engineering Manager - Hadoop/BigData, SQL, Spark, AWS
Duration: 12 Months
Location: Beaverton, OR (On-Site Preferred, Remote Ok)
Key Skills: Hadoop/BigData, Spark, SQL, Python, CI/CD, NoSQL, RESYFul, Kafka, AWS, RDBMS/Snowflake, Airflow, Data Lake
Requirements:
- Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
- 4+ years relevant work experience in the Data Engineering field
- Experience building scalable, real-time and high-performance cloud data lake solutions
- 2+ years experience working with Hadoop and Big Data processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink, etc.)
- Strong experience with relational SQL and programming languages such as Python, Scala, or Java
- Experience with source control tools such as GitHub and related CI/CD processes
- Experience working with Big Data streaming services such as Kinesis, Kafka, etc.
- Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
- Experience provisioning RESTful API's to enable real-time data consumption
- Experience working in AWS environment primarily EMR, S3, Kinesis, Redshift, Athena, etc.
- Experience with data warehouses/RDBMS like Snowflake & Teradata
- Experience with workflow scheduling tools like Airflow
- Strong understanding of algorithms, data structures, data architecture, and technical designs.
- Has a strong problem solving and analytical approach
- Proven ability to influence and communicate effectively with team members and business partners
- Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions
Who Are We Looking For:
- We are looking for an experienced Data Engineering Manager to lead and manage a team of data engineers and analysts working on building scalable data and analytics solutions.
- This person will participate in architecture and design discussions, own end-to-end solution delivery, stakeholder management, partner with platform engineering, collaborate with other engineering teams, and will guide and mentor data engineers.
- The ideal candidate will have outstanding communication skills, proven data design and implementation capabilities, strong business acumen, and an innate drive to deliver results.
- The person in this role will be technically proficient and excel at collaborating with engineers, analysts, and stakeholders.
- He/she will be a self-starter, comfortable with ambiguity, and will enjoy working in a fast-paced dynamic environment.
What Will You Work On:
- In this role, you will manage an engineering team focused on building and delivering scalable data and analytics solutions in Client's Direct, Supply Chain, and Commercial space.
- The team will design, implement and integrate new technologies and evolve data and analytics products.
- You will be contributing to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven development, reusable frameworks, automated workflows, and libraries at scale to support analytics products.
- You will also participate in architecture and design discussions to process and store high-volume data sets.
Who Will You Work With:
- This role is part of the North America Data & Analytics Organization and you will work with world-class talent in the field of Data Engineering with a goal of better business insights and driving data-driven decisions across the organization.
- You'll be working closely with Internal stakeholders, Product Owners, Engineering Leaders, Data Analysts, Big Data Leads, and Engineers.
- One of Client's maxims is "Win as a Team" and you will be working in a very collaborative environment and will find success in teamwork, a positive attitude, and hard work.
Explore More
Date Posted
04/30/2023
Views
14
Positive
Subjectivity Score: 0.8
Similar Jobs
Senior Manager, Communications Business Partner, Technology - Autodesk
Views in the last 30 days - 0
View Details