Data Ingestion Engineer - Remote

McAfee Other US Location

Company

McAfee

Location

Other US Location

Type

Full Time

Job Description

Role Overview:

We are seeking a seasoned data professional to join our Enterprise Data Platform team as the Capability Specialist for Data Ingestion, reporting to the Enterprise Data Platform Lead. As a key contributor to McAfee’s enterprise data strategy, you will be responsible for managing and implementing data ingestion processes on the Databricks platform.
This is a Remote position located in India. We are only considering candidates located in India and are not providing relocation at this time.

About the role:

  • This role involves managing data ingestion processes on the Databricks platform, requiring expertise in Data Lake ingestion, ETL/ELT design, and CI/CD practices.
  • You will design, implement and manage data ingestion processes from a variety of source systems, ensuring best practices are followed and tailoring approaches to each system.
  • You will be responsible for developing, maintaining, and optimizing ETL/ELT pipelines while ensuring adherence to security, compliance, and PII management standards.
  • Additionally, this position requires knowledge of system integration tools and effective data pipeline management.
  • You'll implement automated monitoring to maintain pipeline infrastructure reliability.
  • This role also includes contributing to Agile sprints and ensuring adherence to SDLC best practices.
  • The ideal candidate will apply ingestion best practices across diverse source systems, tailoring approaches as needed.

About you:

  • You should have 5 to 8 years of experience in data engineering, ingestion pipelining, and ETL/ELT,
  • You should have proficiency in SQL and programming languages like Python or PySpark, as well as experience with Databricks and cloud platforms such as AWS.
  • Hands-on expertise with Spark/Scala, ETL/ELT development using tools like Apache Airflow, and ingestion tools such as Dell Boomi is required.
  • A solid understanding of data quality guidelines, CI/CD pipelines, and Agile sprint management is also necessary.
  • Familiarity with Git and version control systems is expected.
  • Experience in leading small, high-performing teams of data engineers is essential.
  • Product subscription business model domain is a plus.
  • Knowledge on Kong-API and Kinesis is a plus.

#LI-Remote


Company Overview

McAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to users’ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.

Company Benefits and Perks:

We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.

  • Bonus Program
  • Pension and Retirement Plans
  • Medical, Dental and Vision Coverage
  • Paid Time Off
  • Paid Parental Leave
  • Support for Community Involvement

We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.

Apply Now

Date Posted

12/08/2024

Views

0

Back to Job Listings ❤️Add To Job List Company Info View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Senior Engineering Manager, Micros Foundations - Atlassian

Views in the last 30 days - 0

Atlassian is seeking a Senior Engineering Manager to lead a team of Backend Software Engineers The role involves guiding technical decisions prioritiz...

View Details

Senior Frontend Engineer - Simply Business

Views in the last 30 days - 0

Simply Business is seeking a Senior Frontend Engineer to join their Front End Tooling team The role involves developing products using best practices ...

View Details

Development Underwriter - Simply Business

Views in the last 30 days - 0

Simply Business is seeking a Development Underwriter with an Underwriting background to support their new MGA brand Nupro which aims to disrupt the sm...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA a division of a global food retailer is seeking a Solution Architect for its US operations The role involves translating business r...

View Details