Senior Platform Engineer

Be part of the team that is poised to transform the fight against cancer. Backed by the strength of a Fortune 9 company, our entrepreneurial organization develops technologies used by the oncology community to deliver evidence-based, personalized care, as well as insights used by biopharma companies to accelerate drug development and support the entire treatment journey. Our work powers informed decision-making at every pivotal moment in oncology – from the treatment options presented to patients, to the operational considerations for oncology practices, to the design of clinical trials, to the commercial launch plans for new therapies.  

As a Data Platform Engineer at Ontada, you will play a crucial role in designing, implementing, and maintaining our data platform. You will work collaboratively with cross-functional teams to ensure seamless data integration, processing, and analysis. Your expertise in Azure cloud and experience in the healthcare industry will be invaluable as we continue to grow and innovate.  

Key Responsibilities

• Platform Management: Oversee the day-to-day operations of the Azure Databricks platform, ensuring optimal performance, security, and scalability. This includes cluster management, workload optimization, and monitoring for anomalies. 

• Cost Optimization: Monitor platform usage and costs, identifying opportunities for optimization and cost-saving measures. Implement strategies to optimize resource utilization and reduce unnecessary expenses. 

• Problem Solving: Diagnose and resolve complex technical issues related to the Databricks platform, including performance bottlenecks, data ingestion challenges, and cluster management problems. Leverage Azure Cloud tools and services (e.g., Azure Monitor, Azure Log Analytics) for effective troubleshooting. 

• Automation: Develop and implement automation scripts and workflows using Azure DevOps or similar tools to streamline platform management tasks, improve efficiency, and reduce errors. 

• Azure Cloud Expertise: Demonstrate a strong understanding of Azure cloud services and architecture. Leverage Azure resources (e.g., Azure Storage, Azure Data Factory) to integrate Databricks with other components of the cloud infrastructure. 

• Security and Compliance: Ensure that the Databricks environment adheres to security best practices and complies with relevant regulations (e.g., HIPAA, GDPR). Implement security measures, such as access controls, encryption, and vulnerability management. 

• Collaboration: Work closely with data scientists, analysts, and engineers to provide technical guidance and support for their data projects. Facilitate the efficient use of the databricks platform and address their specific needs. 

• Continuous Improvement: Stay up to date with the latest Azure and Databricks features and best practices, recommending and implementing platform enhancements to improve performance, scalability, and security.