At IBM work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so lets talk.
In this role you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers) where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
As a Lead Data Engineer you will design develop and maintain large-scale data pipelines and architectures leveraging AWS data integration and processing technologies. You will collaborate with cross-functional teams to analyze and optimize data workflows ensuring high-performance and scalability. Your expertise in data analysis pipeline development and testing will enable the delivery of high-quality data products.
- Strong knowledge of SQL and data modeling
- Proficiency in Spark and Python for data processing and analysis
- Experience with AWS data integration and processing technologies (Glue Athena Redshift)
- Data pipeline development and deployment expertise
- Functional and automated testing of data pipelines
- Experience with Lakehouse development and architecture
- Knowledge of performance tuning and debugging techniques for data pipelines
- Familiarity with cloud-based data warehousing and analytics platforms
- Understanding of data governance and security best practices
- Experience with DevOps tools and agile development methodologies