Data Engineer IBM Corporation Austin TX (Up to 40% telecommuting permitted):
- Apply engineering and business knowledge to help design data pipelines to feed analytics/AI solutions for Industrial sector clients.
- Develop code for sourcing/extracting data required for the business use case in an automated fashion.
- Launch high performance data pipelines in Python/Spark to process and transform extracted data.
- Establish mechanisms to feed the processed data for AI and Business Analytics applications.
- Update the finished data pipelines in production on public cloud platforms using modern orchestration and deployment tools.
- Design AI and Analytics solutions for industrial sector clients.
- Comprehend the business use case to be solved with AI/Analytics approaches and identify the potential data elements required to do so by performing ad-hoc data analysis as well as working with customer data stewards and business SMEs.
- Gather industry knowledge to understand typical business processes at industrial sector clients and how they usually generate and store data.
- Engage in transactional application that helps close vehicle sales to individual customers that generate data in a very different format and velocity compared to an application used for B2B (Business to Business) sales.
- Analyze data for quality reliability and any potential privacy/security considerations.
- Identify potential data elements and formulate it by using the main tools.
- Utilize: MySQL PostgreSQL Apache Cassandra Power BI Tableau.
Required: Master’s degree or equivalent in Computer Science Engineering or related (employer will accept a Bachelor's degree plus five (5) years of progressive experience in lieu of a Master’s degree) and one (1) year of experience as a Data Engineer Data Analyst or related. One (1) year of experience must include utilizing MySQL PostgreSQL Apache Cassandra Power BI Tableau. $174533 to $190000 per year. Full time. D165.
Master’s degree or equivalent in Computer Science Engineering or related (employer will accept a Bachelor's degree plus five (5) years of progressive experience in lieu of a Master’s degree) and one (1) year of experience as a Data Engineer Data Analyst or related. One (1) year of experience must include utilizing MySQL PostgreSQL Apache Cassandra Power BI Tableau