Data Engineer 2
Company
Illumina
Location
Other US Location
Type
Full Time
Job Description
What if the work you did every day could impact the lives of people you know? Or all of humanity?
At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients.
Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible.
Position Summary:
We are seeking an experienced Data Engineer Developer with 3-5 years of experience to join our talented team in Bangalore. In this role, you will be responsible for designing, implementing, and optimizing data pipelines, ETL processes, and data integration solutions using Python, Spark, SQL, Snowflake, dbt, and other relevant technologies.
If you have a passion for data engineering, hands-on experience with big data technologies, and a proven track record of delivering scalable and reliable data solutions, we want to hear from you.
Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines, ETL processes, and data integration solutions using Python, Spark, SQL, Snowflake, and other relevant technologies.
- Utilize big data processing frameworks such as Apache Spark to process and analyze large volumes of data efficiently.
- Implement data transformations, aggregations, and business logic to support analytics and reporting requirements.
- Leverage cloud-based data platforms such as Snowflake to store and manage structured and semi-structured data at scale.
- Utilize dbt (Data Build Tool) for data modeling, transformation, and documentation to ensure data consistency, quality, and integrity.
- Monitor and optimize data pipelines and ETL processes for performance, scalability, and reliability.
- Conduct data profiling, cleansing, and validation to ensure data quality and integrity across different data sets.
- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.
- Stay updated on emerging technologies and best practices in data engineering, contributing to continuous improvement and innovation within the team.
All listed requirements are deemed as essential functions to this position; however, business conditions may require reasonable accommodations for additional tasks and responsibilities.
Preferred Experience/Education/Skills:
- Global operations, manufacturing, supply chain data pipeline and KPI development domain knowledge is required
- Bachelor's degree in Computer Science, Engineering, or related field.
- 3-5 years of experience in data engineering, with proficiency in Python, Spark, SQL, Snowflake, dbt, and other relevant technologies.
- Strong understanding of distributed computing principles and big data processing frameworks such as Apache Spark.
- Hands-on experience with cloud-based data platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.
- Experience with data modeling, ETL development, and data integration using SQL and Python.
- Familiarity with dbt (Data Build Tool) for managing data transformation and modeling workflows.
- Excellent problem-solving skills, analytical thinking, and attention to detail.
- Strong communication and interpersonal skills, with the ability to collaborate effectively in a team environment.
- Eagerness to learn and adapt to new technologies and tools in a fast-paced environment.
Illumina believes that everyone has the ability to make an impact, and we are proud to be an equal opportunity employer committed to providing employment opportunity regardless of sex, race, creed, color, gender, religion, marital status, domestic partner status, age, national origin or ancestry, physical or mental disability, medical condition, sexual orientation, pregnancy, military or veteran status, citizenship status, and genetic information.
Date Posted
12/14/2024
Views
0
Similar Jobs
Senior Engineering Manager, Micros Foundations - Atlassian
Views in the last 30 days - 0
Atlassian is seeking a Senior Engineering Manager to lead a team of Backend Software Engineers The role involves guiding technical decisions prioritiz...
View DetailsSenior Frontend Engineer - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Senior Frontend Engineer to join their Front End Tooling team The role involves developing products using best practices ...
View DetailsDevelopment Underwriter - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Development Underwriter with an Underwriting background to support their new MGA brand Nupro which aims to disrupt the sm...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA a division of a global food retailer is seeking a Solution Architect for its US operations The role involves translating business r...
View Details