Senior Data Engineer

Viral Nation is looking for a highly-skilled and experienced Senior Data Engineer to join our dynamic organization. This role will play a pivotal role in shaping the technical direction of our data engineering and analytics team. As a senior member of the tech org, this role will collaborate within a cross-functional team, but also with technical and non-technical teams across the business, providing technical leadership, architectural guidance, and ensuring the successful delivery of high-quality, scalable, and maintainable solutions.

What You'll Do Here:

• Data Pipeline Development: Design, develop, and maintain robust, scalable data pipelines to collect, process, and store structured and unstructured data from several data sources for the purposes of reporting and analytics.
• Data Modeling and Architecture: Design and implement efficient data models and architectures to support analytical and reporting needs, ensuring data integrity, reliability, and performance.
• Data Integration: Integrate data from various internal and external sources to ingest first, second and third-party data, including databases, APIs, and third-party platforms, while ensuring data quality and consistency.
• Performance Optimization: Continuously optimize data pipelines and infrastructure for improved performance, scalability, and cost-effectiveness, leveraging cloud-based technologies and other frameworks.
• Data Governance and Security: Implement and enforce data governance policies and security measures to protect sensitive data and ensure compliance with regulatory requirements.
• Monitoring and Maintenance: Monitor data pipelines and systems for performance issues and errors. Proactively identify and resolve issues to ensure the reliability and availability of data infrastructure.
• Documentation and Knowledge Sharing: Document data pipelines, architectures, and processes comprehensively. Share knowledge and best practices with team members to promote continuous learning and improvement.
• Collaboration and Communication: Collaborate closely with cross-functional teams, including, BI, Product and other stakeholders, to understand reporting and analytics requirements and deliver technical solutions. Communicate technical concepts and solutions effectively to non-technical stakeholders.

You'll Need To Have:

• A minimum of 5+ years of experience as a Data Engineer or similar role, with a focus on designing and building scalable data pipelines and infrastructure.
• Deep understanding of database systems and data modeling techniques. Experience with both relational and NoSQL databases is preferred.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud, and proficiency in cloud-based data technologies such as Google BigQuery, AWS Redshift and others.
• Strong proficiency in programming languages such as Python and ELT/ETL tooling such as DBT.
• Experience with data governance, security best practices, and compliance standards is desirable.
• Strong analytical and problem-solving skills, with the ability to translate complex business requirements into scalable technical solutions.
• Clear and concise cross-functional communication and collaboration skills.
• Bachelor's or Master’s degree in Computer Science, Software Engineering, or a related field, or relevant experience is nice-to-have.