Engineer, Data Engineering
Job Description
Let's talk about the team
The primary role of Engineering function within Product Development team is to create specifications and designs for new products or improvements and enhancements to existing products. Works closely with customers, developers, and other stakeholders to understand and define customer needs in these designs. Features are aligned to a timetable and areas of responsibility. Developers may solicit customers for feedback regarding product usability and desired future enhancements. Software Engineers who design, write and test code for the product should be matched in the either Software Engineering Applications or Systems. Product developers who specialize in hardware systems should be matched to Hardware Engineering.
Let's talk about the role
- Monitor daily Prod loads and responsible for incidents created in PagerDuty for load failures
- Root cause analysis for PROD Issues, Analyze Glue/EMR/Step-Function/SOS JS/Airflow job failures in PROD, design and implement fixes in DEV, migrate to TEST and PROD
- Weekend and on-call support as per mutually agreed terms and resourcing plan (to be covered in a separate addendum)
- Assist on Process for code-migrations through CI/CD to PROD, subject to pre-requisite TEST sign- off 2 days in advance to PROD deployment date
- The primary objective of Data Engineering specialization within Engineering (PD) Job Family is to build large-scale data processing systems.
- Key responsibilities include implementing data pipeline integrations and solutions, incorporating highly scalable cloud computing and large-scale data stores including data lakes, data warehouses, and data marts.
- Works closely with data architects to determine what data management systems are appropriate, and data scientists/analysts to determine which data are needed for analysis and provides required data analytics tools.
- Performs work in a specialized area of expertise that requires knowledge of fundamental themes, principles and concepts. Typically requires a university degree or equivalent work experience.
- Builds stable working relationships internally to exchange information.
Let's talk about You
- Bachelor's degree.
- Minimum of 3 years of related experience.
- Experience in technologies like AWS Glue, Terraform, PySpark, Snowflake, AWS EMR, Apache Airflow, AWS S3, Kafka, AWS Kinesis
- Experience in Snowflake, SQL and ETL process.
Joining us is more than saying "yes" to making the world a healthier place. It's discovering a career that's challenging, supportive and inspiring. Where a culture driven by excellence helps you not only meet your goals, but also create new ones. We focus on creating a diverse and inclusive culture, encouraging individual expression in the workplace and thrive on the innovative ideas this generates. If this sounds like the workplace for you, apply now!
Date Posted
11/10/2022
Views
6
Similar Jobs
Software Engineer - Mulligan Funding
Views in the last 30 days - 13
Mulligan Funding is a leading provider of working capital to small and mediumsized businesses They are seeking a Senior Software Engineer with full st...
View DetailsSenior Online Engineer - Visual Concepts
Views in the last 30 days - 6
Visual Concepts is a game development studio looking for an experienced Online Engineer to build impactful features and services for players and devel...
View DetailsSoftware Engineer, Gameplay and Camera - Visual Concepts
Views in the last 30 days - 8
Visual Concepts is a game development studio looking for a Gameplay Software Engineer to work on WWE 2K The role requires experience in game developme...
View DetailsSoftware Engineering Intern (Summer 2023) - Dexterity Capital
Views in the last 30 days - 11
Dexterity Capital is a quantitative trading firm that values growth autonomy and getting things done They offer competitive compensation equity option...
View DetailsSoftware Engineer, Tech Lead: Ads Attribution - 14+ Years of Experience - Snap Inc.
Views in the last 30 days - 9
Snap Inc is a technology company that contributes to human progress by empowering people to express themselves live in the moment learn about the worl...
View DetailsEnterprise Account Executive - Los Angeles - Arkose Labs
Views in the last 30 days - 10
Arkose Labs is a world leader in Account Security trusted by major digital brands like Microsoft PayPal and Snap With a 145 Net Retention Rate Arkose ...
View Details