Data Architect

Project Description

We are seeking a skilled Data Architect with expertise in Data Platforms to join our team. As a Data Architect, you will also be responsible for developing and architecting data strategies that will enable secure and performant use of the data platform for BI solutions, advanced analytics and querying engine

Project goal is to collect telemetry data from various applications in the car in order to analyze user behavior, application performance and other statistics. Application performance is improved through a feedback-loop.

Data is streamed using Kafka to the back-end data warehouse. Redshift or Snowflake are options. Once in this platform, it should provide a complete MLOps ecosystem able to process data from other sources as well.

What you bring:• Hands-on experience in developing data enterprise solutions using AWS services• Extensive hands-on experience with DWH, APIs, Data Lake environments• Strong understanding of cloud infrastructure and services like EMR, Athena, Scala, Databricks, Snowflake, Spark, RDS, glue, Redshift, apache airflow, SQS, SNS• Solid understanding of Kafka fundamentals to leverage kafka streams to provide near real time reporting solutions• Lead architecture of solutions to build self-service composite tools composed of microservices.• Excellent communication skills, with the ability to communicate technical concepts and solutions to both technical and non-technical stakeholders and management.• Experience in leading solutions around technology, data, Machine Learning, and Data Engineering, data governance and regulatory compliance, managing deliverables.

Responsibilities

What you will be doing:
1.End to End responsibility for data collection, transformation, storage, governance and consumption.
2.Manage and define processes of external and internal data integrations.
3.Work closely with software engineers and DevOps teams to ensure APIs, data models, connectors, microservices are efficient and performant.
4.Lead architecture build self-service data access capabilities and smart APIs to drive data decisions
5.Lead cost efficiency, cost optimization efforts to keep data warehouse/virtual warehouse costs low
6.Improve data quality, data validation layers to help the BI solutions highlight rich data
7.Collaborate with development teams and product owners to implement data strategies and plans that align with business objectives and performance goals.
8.Design and implement virtual warehouses for existing and new use cases

Skills

Must have

Core skills: very strong experience with Python, Scala.
Data warehousing (Redshift/Snowflake), Deployment using Terrraform or CDK.

Nice to have

Lead cost efficiency, cost optimization efforts to keep data warehouse/virtual warehouse costs low
Improve data quality, data validation layers to help the BI solutions highlight rich data
Collaborate with development teams and product owners to implement data strategies and plans that align with business objectives and performance goals.
Design and implement virtual warehouses for existing and new use cases

Languages

English: B2 Upper Intermediate

Seniority

Senior

Relocation package

If needed, we can help you with relocation process. Click here for more information.

Vacancy Specialization

Data Architecture

Ref Number

VR-100349