Job Description
The Role You Will Have:
- Designing and developing data processing infrastructure.
- Developing new and improving existing data pipelines, extracting from external API sources or internal events.
- Developing self-serve data solutions, self-correcting robust ETL pipelines.
- Continuously improving monitoring and alerting coverage.
- As a Sr. Engineer, this role will provide mentorship to colleagues in/outside of the immediate team.
- Self-driving proof of concept for new technologies, new patterns and writing technical specifications for data architecture projects.
- Identifying complex scaling bottlenecks and how to prevent them, and communicating updates to stakeholders.
- Performing maintenance of existing infrastructure, investigating issues and failures.
- Conducting SQL data investigations, and optimizations.
- Participate in peer code reviews and produce high quality documentation
What You Will Bring:
- Bachelors or Masters degree in Computer Science/Engineering.
- Programming expertise in Python is required. JVM lang like Scala, Kotlin are preferred.
- 6+ years’ experience in Cloud ecosystems like AWS is required. GCP, Azure are preferred.
- SQL expertise, and preferably SQL query optimization experience.
- Database design skills, both relational and non-relational, SQL and NoSQL.
- Experience with Cloud data warehouses like BigQuery, Snowflake, Redshift preferred.
- High level of proficiency with modern orchestration platforms such as Airflow.
- Deep understanding of data engineering fundamentals, ETL experience and analytics skills required in order to solve complex challenges across the System1 environment.
- Knowledge of data engineering mechanics, flow, distribution, optimization.
- Data organization, distribution, latency, observability.
- Distributed big data processing and storage systems.
- Kubernetes, docker, containerization strategies, Linux/UNIX would be required.
- Experience with Kafka is preferred.
What We Have to Offer:
- Competitive salary + bonus + equity
- Generous PTO + 11 company holidays
- Open sick time
- 100% covered Medical, Dental, Vision for employees
- 401k with match
- Health & Dependent Care Flex Spending AccountÂ
- Paid professional development
- Leadership & growth opportunities
- Virtual company and team building events
Date Posted
11/09/2023
Views
14
Similar Jobs
Senior Design Manager (Infrastructure) - Canonical
Views in the last 30 days - 0
Canonical a leading opensource provider seeks a Senior Design Manager to drive innovation in cloud and AI technologies The role offers remote work glo...
View DetailsSenior Product Designer - Org & Security - Typeform
Views in the last 30 days - 0
This job description outlines a role in developing an intelligent contact management system with AI capabilities The position involves designing user ...
View DetailsSenior Business Analyst - Xpansiv
Views in the last 30 days - 0
Xpansiv promotes its role as an energy market innovator with a global platform for environmental commodities The job posting seeks a Business Analyst ...
View DetailsSenior Specialist Senior Accountant Shared Financial Services - Make-A-Wish America
Views in the last 30 days - 0
The text describes Make a Wish Foundations mission to grant childrens wishes and their community efforts It outlines job positions with remotehybrid o...
View DetailsSoftware Engineer Networking Software and Services - xAI
Views in the last 30 days - 0
The text describes xAIs mission to develop AI systems for understanding the universe and advancing human knowledge It outlines a role involving networ...
View DetailsData Scientist - KoBold Metals
Views in the last 30 days - 0
KoBold a leading mineral exploration company using AI seeks a Data Scientist to advance their exploration tech They highlight successful discoveries i...
View Details