Data Engineer/ Data Integration Engineer

Company Description

Data Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of finding the next perfect fit for your team.

Job Description

About the role:

We are seeking a highly skilled Solutions Architect/Sr Data Engineer with a strong background in the Azure and Databricks ecosystem, along with a solid understanding of data extraction from Microsoft D365 applications. Additionally, if the candidate has awareness of F&O module of D365 and their tables it will be great.

Note: Need someone who has experience in creating pipeline to extract data from Dynamics 365 (D365) and then store in Databricks not in Azure Data factory

Key Responsibilities:

• Design and implement scalable data architectures within the Azure and Databricks environment, focusing on high performance and efficiency.
• Utilize Azure tools and services to build and maintain robust data pipelines.
• Implement Databricks for data processing, transformation, and analytics, ensuring that solutions are scalable and aligned with industry best practices.
• Develop solutions for extracting and transforming data from Microsoft D365 applications
• Knowledge of the F&O module within D365 to map out data structures, understand table relationships, and optimize data retrieval processes is nice to have.

Qualifications

Note: Need someone who has experience in creating pipeline to extract data from Dynamics 365 (D365) and then store in Databricks not in Azure Data factory

Additional Information

All your information will be kept confidential according to EEO guidelines.