Data Engineer- Streaming Applications

About The Role
Udemy is looking for a mid level data engineer to join our Recommendations Team. Udemy's personalized recommendations system is composed of batch (e.g., feature and machine learning pipelines), streaming (i.e., feature computation in real-time), and online (i.e., microservices to serve personalized recommendations) components. The team is responsible for mainly batch and streaming components as well as the underlying algorithms and evaluation methodologies.
In this role, you will build and integrate scalable systems, platforms, and tools to provide better recommendations and personalization data with low latency. You will work in a wide stack including big data and streaming technologies as a part of a cross-functional agile team of engineers, data scientists, and product managers.
We are passionate about learning, making an impact, and building with quality. We love taking on new technical challenges. We are interested in building a diverse, collaborative, and fun environment. Come help us improve lives through learning!
Here's what you'll be doing:

• Design, develop, test, deploy, and maintain recommendation and personalization related systems, platforms, and tools at scale.
• Partner with data scientists to troubleshoot and optimize complex ML applications.
• Contribute to re-architecting Udemy's next-generation recommendations and personalization systems.
• Collaborate with data scientists, engineers, and product managers to identify opportunities to improve our platform.

We're excited about you because you have:

• 2 years of full-time experience with software engineering or data engineering or equivalent
• Knowledge of algorithms and data structures
• Proficiency with Scala and Python
• Exposure to Kafka and Spark Streaming
• Exposure to big data storage and processing frameworks such as Hadoop, Hive, and Spark
• Working knowledge of the design, development, and maintenance of large-scale systems
• Self-driven, highly motivated, and able to learn quickly
• Ability to communicate effectively with non-technical stakeholders

We understand that not everyone will match the above qualifications 100%. If your background isn't perfectly aligned but you feel you would be a great addition to the team, we'd love to hear from you.
About Udemy
At Udemy, we're all about improving lives through the power of learning. We are a leading global learning company and one of the world's largest education platforms with more than 54 million learners. Our goal is to provide flexible, effective skill development to empower organizations and individuals. Talented people are everywhere, but opportunities can be hard to come by. That's why we're focused on revolutionizing learning, using our skills and expertise to help others develop theirs and reach their full potential. Individually, we bring our unique perspective to reimagine the way we share knowledge. Together, we can improve lives by empowering our learners, our instructors, and businesses around the world.
We are proud to be recognized for our world-class employee experience. Learn more about our Great Place to Work certification here and find out what it's like to work at Udemy on our blog .
Udemy is headquartered in San Francisco with global offices in the US, Turkey, Ireland, Australia, India, and Brazil. Learn more on our company page .
Information regarding data privacy is available within the Udemy Careers Privacy Notice . Candidates from Colorado can find EPEWA information here .
At Udemy, we value diversity and inclusion and consider qualified applicants without regard to race, color, religion, sex, national origin, ancestry, age, genetic information, sexual orientation, gender identity, marital or family status, veteran status, medical condition or disability. We will consider for employment qualified applicants with arrest and conviction records.
Udemy Benefits:

• Eligibility: Regular, full-time employees are eligible for Udemy's benefit programs.
• Health Plans: Medical, dental, and vision coverage (100% coverage for employee-only).
• HSA/FSA/Commuter: Pre-tax savings/spending plans available; generous HSA employer contributions for those enrolled in the HDHP medical plan.
• Life/Disability: Employer-paid life insurance (supplemental available), in addition to short-term and long-term disability.
• Retirement: Access to 401(k) with annual employer contribution.
• Wellbeing: Corporate memberships for meditation and mindfulness, therapy and coaching, financial planning, primary care, tele-health, health advocacy, parent/newborn support, and employee discounts.
• Education: Free access to the entire course library on the Udemy and Udemy for Business platforms; annual stipend for external learning beginning at six months of employment.
• Charitable Matching Program: Employer match of monetary contributions to eligible nonprofits and charities that carry a 501(c)(3) tax status.
• Vacation: 15 days per year of Paid Time Off for hourly; flexible Discretionary Time Off for salaried.
• Parental Leave: 8 weeks of leave at 100% pay for parents who take time off from work following the date of birth, adoption, or foster placement beginning at six months of employment; this amount is in addition to pregnancy-disability benefits at 100% pay, if applicable.
• Holidays: 11 paid holidays throughout the year

#LI-KE1