Senior Engineer - Data Engineering

AmEx Manifesto: You Lead the Way. We've Got Your Back. At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we're supporting our customers' financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what's possible - and we're proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day.

The Digital Workplace Data Platform aims to bring the data from all Unified Workplace & Collaboration Platforms together to provide real-time meaningful insights in areas such as user experience, health scoring, productivity, and overall IT visibility. As the Senior Engineer of Data Engineering Platform, you will have responsibility for leading the design, development, troubleshooting, and debugging work efforts for the data platform.

What is Amex's objective for a digital workplace?

Our winning aspiration is to deliver the best Colleague digital experience. We simplify work and raise productivity by empowering Colleagues with the best digital tools and services.

Opportunity for Impact

The Digital workplace at American Express is entering into a new phase of technology transformation driven by opportunities to improve Colleague experience, raise productivity and collaboration, and drive operational efficiency of all service and infrastructure operations. If you have the talent and desire to deliver innovative products and services at a rapid pace, with strong software engineering skills, in areas of productivity and collaboration software suites, endpoint computing and security, mobile platforms, data engineering, join our technology team to help with our transformation journey.

Role and Responsibilities

The Data Engineering platform is central to the future of how we work and improve colleague experience while identifying opportunities for improvement. As the Senior Engineer in this team, you will:

• Function as a leader on an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
• Architect, design and develop complex distributed data engineering pipeline at scale and manage its availability, throughputs, and security
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build data visualizations that utilize the data pipeline to provide actionable insights into areas such as user experience, health scoring, productivity, and overall IT visibility
• Lead the solutioning of AI/ML models on the data to build meaningful insights & predictive analysis
• Partner with Product Management to enhance the quality and outcomes of the data products including data analytics & visualization
• Keep the data separated and secure with right encryption and masking algorithms
• Run pilots to design the data architecture to scale with the increased data volume
• Manage delivery milestones, deployment cycles & delivery of the overall Data Platform's roadmap
• Foster and support the culture of innovation, ownership, accountability, and customer focus
• Participate actively and constructively in agile team meetings and application reviews
• Work directly with and learn from the business, product, and engineering leaders across the organization
• Drives the team's strategy and prioritizes initiatives
• Be a productivity multiplier for your team by analyzing the workflow and contributing to enable the team to be more effective, productive, and demonstrating faster and stronger results.
• Mentor and guide team members to success within the team
• Accountable for accurate completion and quality of all documentation produced by engineering team
• May have formal management responsibilities for 2-3 engineers

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers' digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology on #TeamAmex.

Professional Qualifications

• 6+ years of software development experience specifically in data engineering platforms. Bachelor's Degree in computer science, computer science engineering, or related experience required; advanced degree preferred
• Advanced experience writing software in Python, Scala, R, or similar. Experience with data structures, algorithms, and software design
• Experience architecting data products in Streaming, Serverless and Microservices based Architecture and platform
• Experience in cloud computing, including virtualization, hosted services, multi-tenant cloud infrastructures, storage systems, and content delivery networks
• Experience on various data architectures, latest tools, current and future trends in data engineering space especially Big Data, Streaming and Cloud technologies like AWS, Snowflake etc.
• Hands on experience with Big Data technologies (Spark, Kafka, Hive, etc.) and have at least 1 Big data implementation on platforms like Cornerstone, Teradata, etc.
• Experience in creating Large-scale data engineering pipelines, data-based decision-making, and quantitative analysis
• Experience with Visualization Tools like Tableau, Power BI, etc.
• Experience with complex, high volume, multi-dimensional data, as well as ML/AI models for unstructured, structured, and streaming datasets
• Advanced experience in writing and optimizing efficient SQL queries with Python, Spark, Hive, Scala handling Large Data Sets in Big-Data Environments
• Exposure in building cloud-native platforms on modern tech stack: AWS, Java, Spring Framework, RESTful API, and container-based application
• Strong analytic skills related to working with unstructured datasets
• Exposure in building Predictive models using machine learning through all phases of development, from design through training, evaluation, validation, and implementation.
• Ability to learn new tools and paradigms in data engineering and science
• Experience with DevOps, reliability engineering, and platform monitoring
• Experience supporting and working with cross-functional teams in a dynamic environment
• Demonstrate technical expertise to help team members overcome technical problems
• Well versed in AGILE, DevOps and Program Management methods

We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.

If the role you are applying for is designated as hybrid or onsite, you will be required to demonstrate that you have completed your primary COVID-19 vaccination series (i.e., 2 doses for Moderna/Pfizer and 1 dose for J&J) in order to work in or visit any of our offices. This requirement is subject to legally required accommodations.

Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, age, or any other status protected by law.