Data Ingestion Engineer - Remote
Job Description
Role Overview:
We are seeking a seasoned data professional to join our Enterprise Data Platform team as the Capability Specialist for Data Ingestion, reporting to the Enterprise Data Platform Lead. As a key contributor to McAfeeβs enterprise data strategy, you will be responsible for managing and implementing data ingestion processes on the Databricks platform.
This is a Remote position located in India. We are only considering candidates located in India and are not providing relocation at this time.
About the role:
- This role involves managing data ingestion processes on the Databricks platform, requiring expertise in Data Lake ingestion, ETL/ELT design, and CI/CD practices.
- You will design, implement and manage data ingestion processes from a variety of source systems, ensuring best practices are followed and tailoring approaches to each system.
- You will be responsible for developing, maintaining, and optimizing ETL/ELT pipelines while ensuring adherence to security, compliance, and PII management standards.
- Additionally, this position requires knowledge of system integration tools and effective data pipeline management.
- You'll implement automated monitoring to maintain pipeline infrastructure reliability.
- This role also includes contributing to Agile sprints and ensuring adherence to SDLC best practices.
- The ideal candidate will apply ingestion best practices across diverse source systems, tailoring approaches as needed.
About you:
- You should have 5 to 8 years of experience in data engineering, ingestion pipelining, and ETL/ELT,
- You should have proficiency in SQL and programming languages like Python or PySpark, as well as experience with Databricks and cloud platforms such as AWS.
- Hands-on expertise with Spark/Scala, ETL/ELT development using tools like Apache Airflow, and ingestion tools such as Dell Boomi is required.
- A solid understanding of data quality guidelines, CI/CD pipelines, and Agile sprint management is also necessary.
- Familiarity with Git and version control systems is expected.
- Experience in leading small, high-performing teams of data engineers is essential.
- Product subscription business model domain is a plus.
- Knowledge on Kong-API and Kinesis is a plus.
#LI-Remote
Company Overview
McAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to usersβ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.
Company Benefits and Perks:
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.
Date Posted
12/08/2024
Views
0
Similar Jobs
Software Architecture Engineering and Cloud Computing Engineer - The Aerospace Corporation
Views in the last 30 days - 0
The Aerospace Corporation is seeking a Senior Project Engineer with expertise in software architecture engineering and cloud computing The role involv...
View DetailsSales Development Representative - UK (Remote) - Dscout
Views in the last 30 days - 0
Dscout is a company that specializes in experience research solutions helping innovative companies like Salesforce Sonos Groupon and Best Buy to build...
View DetailsSenior Data Analyst - Customer Experience - WISE
Views in the last 30 days - 0
Wise is a global technology company aiming to revolutionize international money transfers by offering minimal fees maximum ease and full speed They ar...
View DetailsLead Data Analyst - Mitigation - WISE
Views in the last 30 days - 0
Wise is a global technology company seeking an Operations Analyst with 4 years of experience in analytics particularly in operational team analytics T...
View DetailsLead Technical Support Engineer - HERE Technologies
Views in the last 30 days - 0
This role Senior Technical Support Engineer at HERE Technologies involves supporting a diverse portfolio of products and services acting as a technica...
View DetailsPrincipal / Lead Software Engineer- RUST (Algorithmic and Mathematics) - m/w/d - HERE Technologies
Views in the last 30 days - 0
HERE Technologies is seeking a Principal Software Engineer to lead the development of extended services for their VRP solver Tour Planning The role in...
View Details