Lead Data Engineer

About NCR

NCR Corporation (NYSE: NCR) is a leading software- and services-led enterprise provider in the financial, retail and hospitality industries. NCR is headquartered in Atlanta, Georgia, with 36,000 employees globally. NCR is a trademark of NCR Corporation in the United States and other countries.

Lead Data Engineer - AWS/GCP Cloud

Locations: Atlanta, GA, Redwood, CA, Dallas, TX, Omaha, NE

NCR D3 is searching for a highly innovative, enthusiastic and results-driven Lead Data Engineer who has built data pipelines and data systems at scale using the AWS and GCP architectures. This individual should be from a development background in data engineering and not an infrastructure background. Someone who has a strong familiarity working in an AWS or GCP cloud environment to implement enterprise data workloads. Comfortable working with full stack engineers, product managers and product delivery teams.

Responsibilities

• Provide technical solution leadership in data engineering team, driving technology decisions, mentoring others, and contributing significantly on an individual level developing and maintaining a big data platform
• Build frameworks to handle data at high scale using Apache Spark and data cataloging tools like AWS Glue and DataProc on top of a multi-tiered data lake storage
• Use exploration and analytic tools like Jupyter Notebooks to probe and validate data
• Build robust data processing pipelines using AWS and GCP Services and integrate with multiple data sources
• Participate in and follow Agile methodology best practices
• Collaborate with product owners and stakeholders to plan and define requirements
• Ability to translate data needs into detailed functional and technical designs for development, testing and implementation
• Analyze user requirements and document software features/modifications serving as a liaison between technical, quality assurance and non-technical stakeholders throughout the development and deployment process
• Keep up to date with technology and apply new knowledge
• Experience with the following software/tools is required
  • Github, Jenkins, Gitflow, Github Projects
  • AWS Services:
    • RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Kinesis, Firehose
    • SQL and NoSQL databases like MySQL, Oracle, Postgres, Elasticsearch, MongoDB Atlas, Athena, DynamoDB
  • GCP Services:
    • DataProc, DataFlow, Cloud Composer, Apache Beam, Apache Spark, Kafka, PubSub
    • SQL and NoSQL databases like MySQL, Oracle, Postgres, Elasticsearch, MongoDB Atlas, BigQuery, BigTable
    • Spark programming paradigms (batch and stream-processing)
    • Beam programming paradigms (stream processing)
  • Strong programming skills in at least one of the following languages:
    • Java, Python as well as Unix/Linux shells

Ideal Qualifications

• Bachelor's degree in computer science, software engineering or proven work experience in related field
• 2+ years, preferred 4+ years production AWS and or GCP experience
• AWS development with a firm understanding of the use of AWS Glue, GCP DataProc, DataFlow, Kafka Firehose, Kinesis, AWS Lambda, S3, DynamoDB, BigQuery, BigTable, MongoDB Atlas, Kafka
• Solid understanding of Microservice and big data architectures for the use of security, machine learning and analytics
• Experience implementing and achieving PCI compliance in a cloud environment
• Solid Python and or Java programming language experience
• Relational and NoSQL database experience is required
• Strong complex problem solving and troubleshooting skills
• Ability to learn quickly and manage time effectively
• Proven written and oral communication skills
• Experience in the financial industry a plus

Offers of employment are conditional upon passage of screening criteria applicable to the job.

Full time employee benefits include:

• Medical Insurance
• Dental Insurance
• Life Insurance
• Vision Insurance
• Short/Long Term Disability
• Paid Vacation
• 401k

EEO Statement
Integrated into our shared values is NCR's commitment to diversity and equal employment opportunity. All qualified applicants will receive consideration for employment without regard to sex, age, race, color, creed, religion, national origin, disability, sexual orientation, gender identity, veteran status, military service, genetic information, or any other characteristic or conduct protected by law. NCR is committed to being a globally inclusive company where all people are treated fairly, recognized for their individuality, promoted based on performance and encouraged to strive to reach their full potential. We believe in understanding and respecting differences among all people. Every individual at NCR has an ongoing responsibility to respect and support a globally diverse environment.

Statement to Third Party Agencies
To ALL recruitment agencies: NCR only accepts resumes from agencies on the NCR preferred supplier list. Please do not forward resumes to our applicant tracking system, NCR employees, or any NCR facility. NCR is not responsible for any fees or charges associated with unsolicited resumes.