Streaming Big Data Developer

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business-and the world. Want in?
We build, improve, and maintain one of the highest scaling platforms in the world. Our amazing team of Engineers work on next generation Big Data Platforms that transform how users connect with each other every single day. Yahoo's Big Data Platform drives some of the most demanding applications in the industry. The system handles billions of requests a day and runs on some of the largest Hadoop clusters ever built! 50,000 nodes strong and several multi-thousand node clusters bring scalable computing to a whole new level. We work on problems that cover a wide spectrum - from web services to operating systems and networking layers. Our biggest challenges ahead are designing cloud native big data platforms.
Responsibilities:
Responsibilities will include understanding the stream aspects of our big data platforms and engineering support of one or more of the following open source projects: Hadoop Core, Storm, Spark, or Flink. You will also own improvements on existing code, debugging and investigation of user issues, participation in code reviews, designing and shipping the product. Contribute to standard methodologies and culture of the team. Participate in agile development with weekly sprints, planning & estimating work, daily standup, & retrospectives.
Qualifications:
B.S. or higher in Computer Science or equivalent work experience
5+ years experience in software development and deployment on public cloud platforms such as AWS
Experience with OOP: Java, C++, or similar
Experience with Apache Hadoop, Storm, Spark, or Flink, preferably on public cloud platforms
Experience working with large distributed systems and data
Understanding of the fundamentals including Data Structures, Algorithms, OS and Networking.
Experience with system & application architecture
Experience with design and implementation skills in Java or C++. Experience with large-scale production code development is a plus.
Working knowledge of scripting languages such as PHP, Perl, Python, and/or Ruby
Familiar with HTTP and TCP/IP protocol
Linux/Unix knowledge necessary
Excellent verbal, written, and communication/presentation skills
Excellent debugging/testing skills, and excellent analytical and problem solving skills
Experience with continuous integration (CI) frameworks such as Jenkins and Hudson
Experience with SCRUM or similar agile methodology
#LI-SO1
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( www.yahooinc.com/careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( www.yahooinc.com/diversity/ ) page to learn more.
US Only: Please be aware that Yahoo requires all employees entering a U.S. Yahoo office and/or attending a company event (including client events) are required to be vaccinated for COVID-19. This position will require the successful candidate to obtain and show proof of a vaccination to enter a U.S. Yahoo office and/or attending a company event (including client events). Yahoo is an equal opportunity employer, and will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.
Currently work for Yahoo? Please apply on our internal career site.