Data Engineer

Who you are:

We are seeking a skilled and motivated Data Engineer to join our data team. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining our data infrastructure, ensuring accurate and efficient data processing and analysis. Your expertise in SQL, Snowflake, Python, and cloud technologies will be instrumental in developing robust data pipelines and optimizing data workflows within the home equity investment domain. This is an exciting opportunity to contribute to the growth and success of our organization by leveraging your technical skills and financial acumen.

What you'll do:

• Data Infrastructure Development: Design, build, and maintain scalable, reliable data pipelines and infrastructure, emphasizing CI/CD practices.
• Data Modeling and Architecture: Collaborate with engineers and product managers to create efficient data models and integration strategies aligned with organizational financial objectives.
• ELT Processes: Develop, optimize, and monitor Extract, Load, and Transform processes to streamline data integration and transformation into the data warehouse.
• Data Validation and Cleansing: Apply data validation and cleansing methods to identify and resolve quality issues, ensuring accurate and consistent financial data.
• Performance Optimization: Enhance the efficiency of data workflows through query optimization, indexing strategies, and data partitioning techniques.
• Data Governance and Security: Maintain compliance with governance policies, industry regulations, and best practices for data privacy and security in the finance sector.
• Collaboration and Documentation: Partner with data analysts, scientists, and business stakeholders to gather requirements, provide support, and document processes and standards.
• Monitoring and Troubleshooting: Oversee data pipelines to detect and resolve issues, addressing system failures and performance bottlenecks proactively.
• Continuous Learning: Stay updated on industry trends, emerging technologies, and best practices in data engineering, finance, and regulatory compliance.

What you bring:

• Industry Experience: 3+ years as a Data Engineer in the finance industry or a similar domain.
• Cloud Technologies: 3+ years of experience with AWS or equivalent platforms (Azure, GCP). AWS certifications are a bonus.
• Education: Bachelor’s degree in computer science, Information Systems, or a related field. A master’s degree is preferred.
• Technical Expertise: Strong skills in building end-to-end data pipelines using Python and SQL, with experience in complex queries, stored procedures, and query optimization. Familiarity with DBT Cloud/Core is a plus.
• Database Design: Proficient in data modeling and database design, including star/snowflake schemas, normalization, and denormalization.
• Data Warehousing: Extensive experience with Snowflake or similar cloud-based platforms, including designing large-scale data structures and optimizing workflows.
• CI/CD and Git: Strong knowledge of Git and expertise in implementing CI/CD pipelines.
• Data Integration and Security: Proficient in data integration techniques, governance, and security practices in the finance sector.
• Workflow Automation: Experience with orchestration tools like Airflow. Open-source tool expertise is a plus.
• Visualization Tools: Familiarity with data visualization tools (e.g., Tableau, Power BI) and libraries (e.g., Pandas).
• Problem Solving: Strong analytical skills to interpret complex financial concepts and create efficient engineering solutions.
• Communication: Excellent verbal and written communication skills, capable of translating technical ideas for non-technical audiences.