Senior Full Stack Engineer - Data Engineering

Description and Requirements
Role Value Proposition:
MetLife is the leading provider of Group Benefits. The Disability Evolution Delivery organization is a diverse team of technologists, working towards the common goal of ensuring the customer is at the center of everything we do. As an engineering in the Disability Evolution organization, you will be responsible for leading technical design and development of data solutions supporting our disability and absence products for customers who span most of the Fortune 1000. This role will be responsible for driving technical decisions, best practices, and development of systems. The solutions currently leverage HDFS architecture, Spark, and is continuously being modernized as we work with systems of record in AWS and Azure.
Key Responsibilities:

• Key member of agile team doing design, development and maintenance of scalable and efficient data pipelines to process large volumes of data using HDFS, Spark, Hive.
• Participate in Epic, Feature and Story definitions with Product Owners and Agile team to understand business needs, gather requirements, assist in user story breakdown, definition and estimation.
• Mentor and lead team in adopting best practices in documentation, development, and deployment.
• Hands on development with Spark, Hive, Hbase, NoSQL, JANUS, SOLR, & In-memory data processing.
• Hands on development with Spark, Hive, Yarn to create reports, data pipelines, data feeds.
• Develop data architecture and solution designs for classic batch, seed and serving layer.
• Improve/ re-engineer/ debug existing solutions. (for example: performance tuning, adding attributes, cloud migration)
• Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.

Essential Business Experience and Technical Skills:
Required:

• Advanced knowledge of the principles of computer application including software engineering, system analysis and design, design and analysis of algorithms, digital systems, computer system architecture, data structures, computer networks, database management system, and problem solving and computer programming, among others.
• Hands on development skills in the HDFS architecture/Bigdata ecosystem i.e. Spark Scala, SOLR, JANUS, Pig, Hive, HBase and Yarn.
• Experience with real-time data delivery utilizing one of the frameworks: Kafka, NiFi, Change data capture, Synapse, DataBricks.
• Optimize and tune queries, job flows on Hadoop environments to meet performance requirements.
• Hands on development of Shell script/Python to create automation scripts.
• Excellent grasp and understanding of usecases for SQL and NoSQL databases
• Optimize and tune queries in OLTP and Reporting marts using SQL
• Good understanding of code management, release management and CI/CD
• Work with Bigdata developers designing scalable supportable Application development.

• Understanding of Agile development, and design practices - vertical slicing, fit for purpose design.
• Strong communication skills to interact with on/offshore team members, and agile team.

Preferred:

• 4+ years experience in deploying Hadoop components, Hive, Spark, Scala, Yarn, Hbase, Janus and SOLR, XML, JSON.
• Cloud experience in Azure or AWS
• Good understanding of JAVA development, API development and how data pipeline's/integration fit into applications
• Working knowledge of CI/CD pipelines using Jenkins, Azure DevOps, Bamboo
• Working knowledge of Jira, Azure DevOps or similar
• Background working in Financial services Insurance and/or Banking
• Bachelor's Degree in Computer Science, Information Systems, Business Administration, Engineering or related field

At MetLife, we're leading the global transformation of an industry we've long defined. United in purpose, diverse in perspective, we're dedicated to making a difference in the lives of our customers.
#LI-WRAPJOB