Data Engineer

Role Data Engineer

Location Hartford CT

Mandatory Technical / Functional Skills Strong skills in Python Programming• Experience with Pyspark and Hive• Strong Experience in SQL• Experience with data pipeline and workflowmanagement tool: Airflow, Azure DataFlow etc. DataBricks Service (on any cloud,preferably Azure)• Experience with cloud services & DataAnalytics tools : Databricks,snowflake,Azure ADLS Gen2, Azure/GCP• Pandas Dataframes and UDF knowledge• Snowflake Experience (may not be expert)• To work on data engineering solutions toleverage best practices and industry-leading tools and technologies to profiledata, develop efficient ingestion, and build semantic data layers• Roles and responsibility Support analytics tools that utilize the data pipeline to provideactionable insights into customer acquisition, operational efficiency and otherkey business performance metrics.• Support and monitor the infrastructure requiredfor optimal extraction, transformation, and loading of data from a wide varietyof data sources using SQL, Pyspark and Azure big data technologies.• Work with data and analytics experts to strivefor greater functionality in our data systems.• Work with stakeholders including the Executive,Product, Data and Design teams to assist with data-related technical issues andsupport their data infrastructure needs.• Developing, supporting and monitoring big data data pipelines.• Work closely with client to discover needs,collect appropriate data, and deliver valuable data products.• Provide valuable insights from data setsquickly.• Communicate complex findings and ideas in plainlanguage and visualizations that is friendly to business and operationalaudiences.