Lead Data Software Engineer

We are looking for a Lead Data Software Engineer to become an integral part of our energetic team.
In this position, you will create and enhance powerful data solutions to cater to our broad customer base. You will utilize your skills in Python, PySpark, and Azure technologies to drive our products towards enhanced performance and expanded scalability.

#LI-DNI

Responsibilities

• Develop and enhance scalable data products targeting a wide consumer audience
• Enhance and fine-tune data pipelines utilizing Python and PySpark
• Manage and streamline Azure Databricks environments
• Employ Azure DevOps pipelines and/or GitHub Actions for efficient data solutions deployment
• Work closely with interdisciplinary teams to convert business requirements into technical specifications
• Follow software engineering best practices throughout the project cycle
• Participate in the expansion and upkeep of the Databricks Unity Catalog
• Advance data processing and storage solutions in the Azure data ecosystem

Want more jobs like this?

Get jobs in Entroncamento, Portugal delivered to your inbox every week.

Get Jobs

Send me The Muse newsletters for the best in career advice and job search tips.

By signing up, you agree to our Terms of Service & Privacy Policy.

• Minimum of 5 years' experience in the field of data software engineering
• Over 1 year of proven leadership experience
• Proficiency in Python and PySpark, with a proven history of developing large-scale data products
• Competency in deploying and maintaining Azure Databricks solutions
• Qualifications in managing pipelines via Azure DevOps and/or GitHub Actions
• Understanding of the Azure data environment, including Azure Event Hubs and Terraform
• Fluent in English with B2+ level communication skills

• Capability to develop APIs using Python
• Experience with Google Cloud Platform (GCP)

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours