Sr. Data Engineering Manager - Hadoop/BigData, SQL, Spark, AWS

Mavensoft Technologies · Portland, OR

Company

Mavensoft Technologies

Location

Portland, OR

Type

Full Time

Job Description

Role: Sr. Data Engineering Manager - Hadoop/BigData, SQL, Spark, AWS

Duration: 12 Months

Location: Beaverton, OR (On-Site Preferred, Remote Ok)

Key Skills: Hadoop/BigData, Spark, SQL, Python, CI/CD, NoSQL, RESYFul, Kafka, AWS, RDBMS/Snowflake, Airflow, Data Lake

Requirements:
  • Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
  • 4+ years relevant work experience in the Data Engineering field
  • Experience building scalable, real-time and high-performance cloud data lake solutions
  • 2+ years experience working with Hadoop and Big Data processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink, etc.)
  • Strong experience with relational SQL and programming languages such as Python, Scala, or Java
  • Experience with source control tools such as GitHub and related CI/CD processes
  • Experience working with Big Data streaming services such as Kinesis, Kafka, etc.
  • Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
  • Experience provisioning RESTful API's to enable real-time data consumption
  • Experience working in AWS environment primarily EMR, S3, Kinesis, Redshift, Athena, etc.
  • Experience with data warehouses/RDBMS like Snowflake & Teradata
  • Experience with workflow scheduling tools like Airflow
  • Strong understanding of algorithms, data structures, data architecture, and technical designs.
  • Has a strong problem solving and analytical approach
  • Proven ability to influence and communicate effectively with team members and business partners
  • Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions

Who Are We Looking For:
  • We are looking for an experienced Data Engineering Manager to lead and manage a team of data engineers and analysts working on building scalable data and analytics solutions.
  • This person will participate in architecture and design discussions, own end-to-end solution delivery, stakeholder management, partner with platform engineering, collaborate with other engineering teams, and will guide and mentor data engineers.
  • The ideal candidate will have outstanding communication skills, proven data design and implementation capabilities, strong business acumen, and an innate drive to deliver results.
  • The person in this role will be technically proficient and excel at collaborating with engineers, analysts, and stakeholders.
  • He/she will be a self-starter, comfortable with ambiguity, and will enjoy working in a fast-paced dynamic environment.

What Will You Work On:
  • In this role, you will manage an engineering team focused on building and delivering scalable data and analytics solutions in Client's Direct, Supply Chain, and Commercial space.
  • The team will design, implement and integrate new technologies and evolve data and analytics products.
  • You will be contributing to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven development, reusable frameworks, automated workflows, and libraries at scale to support analytics products.
  • You will also participate in architecture and design discussions to process and store high-volume data sets.

Who Will You Work With:
  • This role is part of the North America Data & Analytics Organization and you will work with world-class talent in the field of Data Engineering with a goal of better business insights and driving data-driven decisions across the organization.
  • You'll be working closely with Internal stakeholders, Product Owners, Engineering Leaders, Data Analysts, Big Data Leads, and Engineers.
  • One of Client's maxims is "Win as a Team" and you will be working in a very collaborative environment and will find success in teamwork, a positive attitude, and hard work.

Date Posted

04/30/2023

Views

14

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.8

Similar Jobs