Senior Data Engineer - Databricks

Senior Data Engineer

About Blenheim Chalcot

Blenheim Chalcot is one of the leading venture builders in the world. We have been building exciting and disruptive businesses for over 26 years across sectors including FinTech, EdTech, GovTech, Media, Sport, Charity and more. These companies are all GenAI enabled and are some of the most innovative companies in the UK and increasingly around the world.  

The BC team in India has been instrumental to the growth and success of Blenheim Chalcot. Established in 2009, Blenheim Chalcot India serves as a pivotal launchpad for those aiming to make a difference in the realm of innovation and entrepreneurship.  

Blenheim Chalcot India is driven by a mission to empower visionaries to lead, innovate, and build disruptive solutions. We support our diverse portfolio of ventures and create impactful solutions that shape global trends. We provide a range of services to help new business get off the ground, including technology, growth (marketing and sales), talent, HR, finance, legal and tax, plus so much more!  

Responsibilities:

• PySpark Programming: You will be expected to hit the ground running with developing and maintaining transformation pipelines using PySpark on Databricks.
• Cloud Technology: You should have experience with cloud platforms, particularly Databricks and Google Cloud Platform (GCP). Experience with cloud migration projects, especially moving from SQL to Spark, will be advantageous.
• Data Orchestration: You will handle data orchestration using Azure Data Factory (ADF).
• SQL Expertise: You should have extensive experience with SQL-Server and SQL Server Integration Services (SSIS).
• Data Modelling: You will be responsible for data modelling to support our business needs.
• Agile Development: You will work within an agile development framework to deliver projects on time.
• ETL Processes: Your experience in ETL processes and working in a cloud environment will be crucial for this role. Familiarity with Fivetran will be a plus.
• Data Pipelines: You should have a strong background in creating data pipelines and writing Spark and PySpark code.
• Finance Data: As the key driver for this role, you must have a strong understanding of financial data.

Must Have:

• 5-7+ years of extensive experience in a Data Engineer role
• Solid experience with Python, PySpark, and SQL databases
• Experience with Azure, Databricks, and GCP
• Extensive knowledge of the full software development life cycle, incorporating industry best practices
• Experience with ETL, data inflow and outflow
• Demonstrated expertise in building and optimizing data pipelines to and from data warehouses
• Proven experience in supporting and working with cross-functional teams in a dynamic environment
• Experience in evaluating, prioritizing and developing product features
• Experience working in a start-up environment

Nice-to-have:

• Knowledge of cookies, tracking, and compliance
• Experience in a finance-based engineering role or a good understanding of the finance functions
• Understanding of Machine Learning algorithms and techniques

Qualification:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.

At Blenheim Chalcot, we strive to create an environment where differences are not only accepted but greatly valued, where everyone can make the most of their capabilities and potential. We promote meritocracy, competence and a sharing of ideas and opinions. We are driven by data and believe the diversity, agility, generosity, and curiosity of our people is what sets us apart as an organization and helps us thrive.