Data Engineer- Data Platform

Twitch is the world's biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day.

We're about community, inside and out. You'll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We're on a quest to empower live communities, so if this sounds good to you, see what we're up to on LinkedIn and Twitter, and discover the projects we're solving on our Blog. Be sure to explore our Interviewing Guide and Instagram channel to learn how to ace our interview process.

Twitch is building the future of interactive entertainment. The Data Platform team develops and operates the platform that enables Twitch's data-informed decision-making. Our data pipeline receives over 220 billion events a day, and we forward live data to hundreds of systems as well as powering decisions at all levels of Twitch. We provide tools to ingest, store, transform, move, and understand data.

Data is central to Twitch’s decision-making process and data engineers operate at the forefront of this by creating datasets and data tooling that drive analysis across all of Twitch. You will shape the way that business performance is measured, defining how we transform our data, and scaling analytics methods and tools to support our growing business, leading the way for high quality, high velocity decisions. Your responsibilities will range from developing and enhancing our data warehouse which acts as a source of truth across the company, driving data quality across product verticals and business areas, building self-service business intelligence infrastructure for analysts, as well as connecting into data interfaces that enable everyone in Twitch to discover and analyze the data. In the process, you will have the opportunity to interact with technical and non-technical staff members throughout the company, and will report to the Engineering Manager of Data Platform - Insights.

This role is remote.

• Define and own team level data architecture for the trusted, governed, dimensionally-modeled repository of data that enables Twitch staff to quickly and reliably answer their business questions.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Keep existing data sources fresh against data quality issues, design, develop and maintain data quality assurance framework and continuously improve the processes for developing new ones raising the level of quality expected from our work
• Conduct unit, integration, and system tests on our data sources in order to validate data against source systems, and continuously optimize performance in order to improve query speed and reduce cost.
• Improve search, discovery and literacy: Create exploration and visualization interfaces in our BI tools and evangelize the adoption of these sources across the company through education and training programs.
• Improve business and engineering team processes via data architecture, engineering, test, and operational excellence best practices. Make enhancements that improve data processes.

• 3+ years of experience in data engineering, software engineering, or other related roles.
• 3+ years in relational database concepts with a solid knowledge of star schema, SQL, SQL Tuning, OLAP, Big Data technologies
• 3+ years of experience in generating and maintaining data pipelines from various data sources, in collaboration with diverse stakeholders.
• Experience with best practices for development including query optimization, version control, code reviews, and documentation.
• Experience working with Amazon Webservices, S3, EMR, Redshift etc.
• Experience with coding languages like Python/Java/Scala

• You've made petabytes of data usable.
• You’ve worked with Amazon Web Services and Apache Druid.
• You have a passion for games and the gaming industry.

• Medical, Dental, Vision & Disability Insurance
• 401(k)
• Maternity & Parental Leave
• Flexible PTO
• Amazon Employee Discount
• Monthly Contribution & Discounts for Wellness Related Activities & Programs (e.g., gym memberships, off-site massages)

We are an equal opportunity employer and value diversity at Twitch. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Pursuant to the Los Angeles Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Twitch values your privacy. Please consult our Candidate Privacy Notice, for information about how we collect, use, and disclose personal information of our candidates.

Job ID: TW8130

#LI-Remote #RemoteFriendly