Data Engineering Lead

Data Engineering Lead

Whippany, NJ

As a Barclays Data Engineering Lead, you will be joining the Markets Post-Trade team, primarily focused on Data engineering activities along with some project management responsibilities. This role will lead our data engineering initiatives through a deep understanding of cloud technologies, extensive experience building and optimizing data pipelines at scale, and a proven track record of driving innovation in data engineering practices.

Barclays is one of the world's largest and most respected financial institutions, established in 1690, with a legacy of success, quality, and innovation. We've helped millions of individuals and businesses thrive, creating financial and digital solutions that the world now takes for granted. An important and growing presence in the USA, we offer careers providing endless opportunity.

At Barclays, we offer a hybrid working experience that blends the positives of working alongside colleagues at our onsite locations, together with working from home. We have a structured approach where colleagues work at an onsite location on fixed, 'anchor', days of the week, for a minimum of two days a week or more, as set by the business area (or nearest equivalent if working part-time hours). Please discuss the working pattern requirements for the role you are applying for with the hiring manager. Please note that as we continue to embed our hybrid working environment, we remain in a test and learn phase, which means that working arrangements may be subject to change on reasonable notice to ensure we meet the needs of our business.

What will you be doing?• Directing the design and implementation of advanced data architectures on cloud platforms, leveraging cutting-edge technologies and best practices• Mentoring and coaching junior data engineers, providing guidance on technical challenges, design principles, and industry trends• Driving innovation in data engineering by evaluating emerging technologies, conducting proof-of-concepts, and recommending strategic investments• Collaborating with cross-functional teams to define data requirements, prioritize projects, and deliver scalable solutions that meet business objectives• Architecting and optimizing data pipelines for performance, reliability, and cost-effectiveness, utilizing techniques such as partitioning, caching, and parallel processing• Implementing advanced data governance, security, and compliance measures to ensure the confidentiality, integrity, and availability of data• Leading efforts to automate and streamline data workflows, reducing manual intervention and improving operational efficiency• Collaborating with senior management to develop and execute strategic roadmaps for data engineering initiatives

What we're looking for:• Extensive experience with Data related technologies, including Big Data Architecture Patterns and Cloud services (AWS, Azure, GCP)• Proven experience architecting and optimizing data warehouses, data lakes, and streaming data pipelines• Knowledge and understanding of performance tuning, optimization and scaling solutions from a storage/processing standpoint• Proficiency in programming languages such as Java and Python

Skills that will help you in the role:• A basic understanding of how to manage and setup Monitoring and alerting for Data Lake, Data Warehouse (Cloud/On-premise)• Advanced certifications in cloud platforms (e.g., AWS Certified Solutions Architect - Professional, Azure Solutions Architect Expert)• Experience working in regulated industries such as healthcare, finance, or government, with a solid understanding of compliance requirements (e.g., HIPAA, GDPR, PCI-DSS)• Extensive experience with big data technologies such as Hadoop, Spark, Kafka, and Flink

Where will you be working?

Our next-generation workplace in Whippany allows talented, passionate, down-to-earth colleagues to connect daily. With state-of-the-art work facilities and many added features like pool tables, cafes and a gym - it's a place you can call home. Our office is minutes away from Morristown, known for its rich history and lively modern spirit. With bustling Manhattan easily accessible and a picturesque landscape here on the doorstep, Whippany really does offer the best of both worlds.

#LI-Hybrid

#data