Senior Spark Data Engineer

At Kin + Carta, we’ve got opportunities to offer you — for growth, for leadership, for big, world-changing impact and for, dare we say it, fun. We are a global workforce that is committed to building a world that works better for everyone. And that starts with our Kin. That’s why we’re proud of: 

• The life we create within our virtual walls, every day
• Our B Corp certification
• Being Great Place to Work certified in all eligible countries
• The work we’ve done with some of the world’s most innovative companies

The role

Ideal candidates will have strong quantitative backgrounds and analytical discipline. While they will have demonstrated ability to write code, they will not have learned programming languages for the sake of building their resume, but rather as a means to express their intellectual curiosity and problem solving skills. Kin + Carta will provide a platform and training to help them reach their full potential.

Kin + Carta is looking to hire a Senior Spark Data Engineer to join our growing team. If you are innovative, passionate about data and AI technologies, and look to continually learn and share your expertise, read on!

Due to the sensitive nature of this client project, this role requires you to be onsite in our Buenos Aires office 5 days a week.

Role responsibilities

• Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
• Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
• Provide consultation and lead the implementation of complex programs
• Develop and maintain documentation relating to all assigned systems and projects
• Tune queries running over billions of rows of data running in a distributed query engine
• Perform root cause analysis to identify permanent resolutions to software or business process issues

Minimum qualifications

We want all new hires to succeed in their roles at Kin + Carta. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.

• Proven industry experience executing data engineering, analytics, and/or data science projects or Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities.
• More than 5 years of experience working with:
  1. Strong/expert Spark (PySpark) Using Databricks, Jupyter Notebooks, or Colab
  2. Hands-on data pipeline development, ingest patterns in Azure orchestration tools such as Azure Data Factory (ADF) or Airflow
  3. SQL
  4. Denormalized Data modeling for big data systems
• Collaborative, proactive, communicative, able to work remotely while remaining engaged as a  team member.
• Strong analytical and design skills.

Preferred qualifications

• Familiarity with visualization/reporting tools such as Tableau and PowerBI.
• Familiarity with semantic/metadata layer tools such as Databricks Unity Catalog and Azure Purview
• Proficiency scripting in UNIX environment
• Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc. 
• Proficiency with cloud architecture components (AWS, Azure, Google)
• Proficiency with data pipeline software such as Airflow, Azure Data Factory, or Prefect
• Familiarity with front and back-end web application stacks and frameworks (Javascript, HTML, CSS, React/Vue/AngularJS) and  API design and usage (REST/GraphQL) 
• Experience leading and managing technical data/analytics/machine learning projects

About Kin + Carta

Kin + Carta is a global digital transformation consultancy committed to working alongside our clients to build a world that works better #ForEveryone. We build digital solutions that connect people, data and technology for some of the world’s most influential companies. As a Certified B Corp, we are committed to Inclusion, Diversity, Equity and Awareness, and our triple bottom line focus of people, the planet and profit. 

After submitting your application, you will hear from a member of our Talent Acquisition team if your skills and experience are a match for the position. Be mindful of recruitment fraud by only replying and engaging with email contacts that end with the '@kinandcarta.com' domain.

We strive to create an inclusive environment for all candidates. If you have any specific requirements or need reasonable adjustments to participate in the application or interview process, please let us know at [email protected].