Principal Data Engineer

Octus is seeking a Principal Data Engineer to roll up their sleeves and build scalable production-grade data pipelines and infrastructure. You'll be a hands-on technical leader — writing code daily solving hard engineering problems and helping elevate the team around you through doing. Spanning Snowflake Databricks and AWS you'll be deeply involved in the day-to-day development of the data platform that powers Octus's products data and automation initiatives. The ideal candidate is an expert in Python and SQL who thrives in an execution-focused environment and has deep experience building modern data pipelines and lakehouse solutions.

• Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs web data internal feeds etc.).
• Hands-on development of scalable production-grade pipelines within Databricks including Delta Lake table management Workflows and cluster optimization.
• Build and maintain data models schemas and transformation logic in Snowflake optimizing for performance and reliability.
• Develop and manage Databricks environments including Unity Catalog Delta Live Tables and integration patterns that support both internal data consumers and external sharing use cases.
• Build and manage orchestration workflows using AWS services (MWAA/Airflow Lambda ECS SQS MSK) and Databricks-native orchestration where appropriate.
• Implement and maintain infrastructure as code (IaC) using Terraform ensuring reproducibility and compliance with cloud standards.
• Establish and enforce best practices in data modeling schema design and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
• Ensure data quality lineage and observability through automated testing monitoring and alerting across all pipeline layers.
• Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
• Stay at the forefront of industry trends in data engineering lakehouse architecture and cloud-native data platforms.

• Strong foundation in software engineering principles including SOLID design modularity and scalability.
• Expert proficiency in Databricks including Delta Lake Unity Catalog Delta Live Tables MLflow and Databricks Workflows.
• Deep experience with Snowflake including data modeling performance optimization and integration with upstream/downstream pipeline tooling.
• Expert proficiency in Python for data pipeline and automation development.
• Advanced SQL skills with experience optimizing complex queries and data models at scale.
• Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g. MWAA/Airflow Lambda ECS SQS Glue S3 Redshift etc.).
• Experience implementing and managing Terraform or similar IaC frameworks.
• Strong understanding of lakehouse architecture patterns data ingestion transformation and orchestration including familiarity with ML/AI pipeline integration patterns.
• Familiarity with CI/CD pipelines automated testing and modern DevOps practices.
• 8+ years of experience in data engineering or backend development with a focus on scalable data solutions.
• Demonstrated experience leading data infrastructure projects end-to-end and mentoring senior engineers.
• Familiarity with containerization (Docker) and workflow orchestration best practices.
• Excellent communication collaboration and problem-solving skills.

• Experience with streaming data technologies (Kafka Kinesis Flink).
• Exposure to ML/AI pipeline patterns (feature stores experiment tracking model serving) and MLOps tooling particularly in a cross-functional team environment.
• Experience integrating data quality and observability tools.
• Experience with Databricks as a data sharing and collaboration platform (Delta Sharing Marketplace).
• Familiarity with Claude Code or similar AI-powered developer tools for accelerating pipeline development and code workflows.

At Octus we consider a range of factors in connection with compensation decisions including experience skills location and our business needs and limitations. As a result compensation may vary within and across similar roles and positions. Please note that the salary range information below is a good faith estimate for this position and actual compensation for any individual may fall outside this range if warranted by the circumstances applicable to that individual. If we identify a role that would be suitable for a broader range of skills and experience such that we would consider hiring at multiple levels then the range listed below may reflect that breadth.

The salary range estimate for this position is $175000 - $220000

The actual compensation will be at Octus' sole discretion and will be determined by the aforementioned and other relevant factors.

What We Do

Octus was founded in 2013 with a simple conviction: credit decisions deserve clarity not chaos. Markets were fragmented. Intelligence was gated. Data lived in silos. Professionals were forced to stitch together incomplete pictures while the clock kept running. We built Octus to change that. Octus is the essential credit platform that tracks the entire credit lifecycle. From origination and underwriting to secondary trading refinancing distress and restructuring we follow every development across leveraged loans high-yield bonds private credit and special situations. We structure millions of documents surface risks benchmark performance and deliver expert reporting and analysis in real time. What began as a newsroom fused with legal and financial expertise has evolved into a unified ecosystem. Octus brings together proprietary data expert-driven intelligence and integrated workflow tools so credit professionals can analyze situations uncover opportunities manage portfolios execute trades and stay compliant without ever leaving the platform. Insight and action finally live in one place. Today nearly 40000 professionals across the world’s leading banks asset managers CLO managers law firms and advisors rely on Octus to move smarter and faster. They turn to us for breadth depth and rigor forged over more than a decade and for the speed integration and precision that define the future of credit workflow. Our mission is direct and ambitious: end fragmentation collapse the distance between intelligence and execution and transform insight into impact. Because in credit clarity isn’t just an advantage. It’s everything. Octus: Where credit becomes clear.

Why Work With Us

Octus is where real experts work together to cut through chaos and build clarity in credit. You feel your impact here. What you create shapes real decisions in the market. The problems matter. The people are sharp. If you want work that counts this is the place.

Gallery