Senior Data Engineer

Job Summary

As a Data Engineer, you will play a key role in developing and optimising data pipelines, ETL processes, and analytics solutions that handle large volumes of transaction data in real-time. You will collaborate closely with product, engineering, and compliance teams to ensure data reliability, accuracy, and security. This is an exciting opportunity to work on mission-critical systems in the financial industry and leverage your skills in big data, cloud infrastructure, and modern data engineering practices.

Key Responsibilities

Data Pipeline development:

Design, build, and maintain scalable and efficient ETL/ELT pipelines to process high volumes of financial transaction data from various sources including card networks, partner banks, and APIs2. 

Data Integration:

Ensure seamless integration of structured and unstructured data from multiple sources (issuer, card networks, payment platforms) into centralized data warehouses and data lakes.

Real-Time Data Processing:

Implement real-time data streaming and processing systems to handle large-scale transactions and events using tools like Kafka, Kinesis, Spark etc.

Data Warehousing:

Manage and optimize data storage solutions (e.g., Snowflake, Redshift) to ensure efficient querying and reporting.

Data Quality & Governance:

Implement robust data validation, error handling, and auditing mechanisms to ensure the accuracy and integrity of financial data. Collaborate with compliance and security teams to ensure data governance standards are met.

Monitoring: 

Implement monitoring, alerting, and logging for data pipelines and systems to ensure high availability and performance.

Security & Compliance: 

Ensure all data handling meets stringent security and compliance standards (PCI DSS, GDPR, etc.) required in our business.

Our stack

• Cloud platform - AWS

• Execution engine – Glue (Spark)

• Real-time solution – MSK/Kinesis

• Data discovery/observability – DBT

• Data Orchestration – Apache Airflow 

• Data Warehouse – TBC

• IasC – Terraform/Terramate

• CI/CD – Bitbucket pipelines

Qualifications

• 3-5+ years of proven experience as a Data Engineer preferably in fintech, or payment industry (though domain is not a deal-breaker).

• Advanced knowledge of Python and (No)SQL.

• Experience with modern data warehousing technologies (Snowflake, Redshift, or similar).

• A solid understanding and hands-on experience(preferably) with real-time and event-driven systems such as Kafka, Kinesis or similar.

• Strong experience with ETL/ELT pipeline development using tools such as AWS Glue, Apache Airflow, DBT, etc. 

• Working knowledge of Terraform for Infrastructure as Code.

• Experience with distributed computing and big data technologies like Spark.

• Experience with cloud platforms such as AWS, GCP or Azure (preferably AWS) and services.

• Working knowledge of containerization (Docker).

• Strong communication skills to collaborate with cross-functional teams and translate business needs into technical solutions.

• Ability to troubleshoot and resolve complex data issues in high-pressure environments.

• Ability to work with large data sets and support insight developments that drive business decisions.

• Bachelor's or Master’s degree in computer science, Information Systems, Data Science, Engineering or a related field.

What we offer

• Competitive salary with an attractive benefits package;

• Working on wide-ranging and interesting areas with highly skilled professionals, international clients, and the latest technologies;

• A culture of collaboration and continuous learning in a work environment invested both in nurturing your skills and shaping our common technological future;

• Meal tickets & Office lunch;

• Healthcare package;

• 7card subscription;

• L&D package – standard Blankfactor package of 500 USD/employee/year with the Blankfactor Group rules attached;

• 25 days of annual leave;

• Hybrid work conditions: remote working from your designated place and office work from Blankfactor office

We believe that diversity of experience and background contributes to more robust ideas and a stronger team. All qualified applicants will receive consideration for employment without regard to religion, race, sex, sexual orientation, gender identity, national origin, or disability.