Senior Data Engineer
Company
IBM
Location
US Denver
Type
Full Time
Job Description
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You’ll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role you’ll be encouraged to challenge the norm investigate ideas outside of your role and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
Your Role and Responsibilities
THIS ROLE WILL BE ONSITE IN COLORADO SPRINGS COLORADO 3 DAYS A WEEK. SECRET CLEARANCE REQUIRED.
Your essential job functions will include but may not be limited to:
• Assembles large complex sets of data that meet non-functional and functional requirements
• Identifies designs and implements internal process improvements including re-designing infrastructure for greater scalability optimizing data delivery and automating manual processes
• Builds required infrastructure for optimal extraction transformation and loading of data from various data sources
• Curate and maintain data that is stored in support of metrics and evaluation.
• Working with developers to make sure key data points are stored in a Postgres database.
• Working with data providers and back-end API developers to normalize schemas and define data flows for persistence and analytics.
• Design build test maintain and automate data collection/pipelines
• Develop Dashboards for Data Analytics.
• Implement Artificial Intelligence/Machine Learning
• Using Agile methodologies to develop software.
agsfedta23
Required Technical and Professional Expertise
• Minimum three (3) years of relevant experience as a Data Engineer/Scientist.
• Experience developing data pipelines and normalizing data.
• Experience using AWS cloud services.
• Experience with PostgreSQL database.
• Ability to work efficiently on small distributed teams.
• Familiarity with Agile principles.
• DoD Secret clearance required
Preferred Technical and Professional Expertise
Experience developing Tableau Dashboards.
• ELK Stack Experience.
• Real-time event streaming.
• AWS S3 EC2 Lambda Kinesis.
• Apache Spark NiFi.
• Confluent Kafka.
• Experience with Containers (Docker Docker Compose).
• DevSecOps utilizing test-driven development.
• Gitlab experience.
• A Top Secret (TS) security clearance (with SCI and SAP eligibility
• Relevant DoD and/or Industry work experience in Space Systems Command
• Experience with Cyber Operations B
Date Posted
09/30/2024
Views
0
Similar Jobs
Senior Engineering Manager, Micros Foundations - Atlassian
Views in the last 30 days - 0
Atlassian is seeking a Senior Engineering Manager to lead a team of Backend Software Engineers The role involves guiding technical decisions prioritiz...
View DetailsSenior Frontend Engineer - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Senior Frontend Engineer to join their Front End Tooling team The role involves developing products using best practices ...
View DetailsDevelopment Underwriter - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Development Underwriter with an Underwriting background to support their new MGA brand Nupro which aims to disrupt the sm...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA a division of a global food retailer is seeking a Solution Architect for its US operations The role involves translating business r...
View Details