Sr. Data Engineer

Enable Data Incorporated is seeking a highly skilled and experienced Sr. Data Engineer to join our team. As a Sr. Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to help our customers achieve their business goals. You will leverage cutting-edge technologies and data engineering methodologies to support data-intensive applications and initiatives, ensuring that data is properly cleaned, transformed, and stored to support analytics, data science, and other business intelligence activities.

At Enable Data, we are passionate about delivering advanced application, data, and cloud engineering services to our customers. We have extensive expertise across multiple industries, and our consultants work closely with our customers to leverage modern solutions and drive increased value across their business ecosystem. As a Sr. Data Engineer, you will have the opportunity to work with a team of talented developers, architects, and engineers who are dedicated to delivering the best possible solutions to our customers.

Responsibilities

• Design, develop, and maintain complex data pipelines and ETL processes to support data-intensive applications and initiatives
• Collaborate with architects, developers, and stakeholders to understand business requirements and translate them into scalable and efficient data solutions
• Develop and maintain data architectures, data models, and data dictionaries to ensure data is properly organized, stored, and accessible
• Implement best practices for data quality, data governance, and data security
• Build and maintain data warehouses and analytical databases to support reporting, analytics, and data science activities
• Design and implement strategies for data transformation, data enrichment, and data integration across multiple data sources and formats
• Manage and maintain cloud-based and on-premise data storage platforms, ensuring performance, scalability, and reliability

Requirements

Skillset

Azure Data factory, Databricks, SQL, Spark Scala, and couple internal frameworks

Responsibilities:

Good communication and proper accountability on assigned tasks.

Develop and deploy ADF pipelines.

Develop SQLs out of the requirement documentation.

Design and implement yaml configurations for Spark framework.

Working with Oracle Stored Procedures and Airflow scheduling.

Add-ons:

Reusable Spark framework development.

API development & integration from Spark Scala.

Java Script to enhance existing framework to integrate with Azure APIs.