Big Data Systems - Sr Production Engineer
Job Description
About the Team:
Yahoo is looking for DevOops engineers to join the Yahoo Big Data Production Engineering team. Yahoo is the birthplace of Hadoop and has the largest Hadoop install in the world. The server count has grown from a few hundred nodes, to over 40,000 in the past few years. We have over 400,000 cores that process nearly 300PB of data spread over 25 clusters running a mix of Hadoop, Storm, and Spark.
About the Role:
If you want to learn about Yahoo's Big Data platform, manage a large scale system and explore migration into the Cloud; this is the job for you. We are looking for experienced and motivated operations engineers to help build and enhance solutions to ensure the availability & reliability of the systems managed. If you have a strong distributed systems background, love to solve complex and challenging problems, can work independently and want to participate in some of the most exciting open source projects, we want to hear from you!
Responsibilities:
- Work on a combination of tasks & projects such as analyzing and assisting in the resolution of production software and infrastructure issues, reporting, deployments, monitoring, automation, and designing for redundancy/business-continuity planning.
- Understand all aspects of Yahoo's Big Data Stack and learn select components in depth.
- Work closely with engineering, operations, and Hadoop users to engineer cutting-edge solutions that allow Yahoo to answer today's most challenging big data questions.
- Work in tight collaboration with Yahoo's Big Data development team during the development lifecycle to ensure operability and reliability of new products, feature enhancements & research experiments.
- Scripting, Networking, Capacity planning and performance tuning
- Taking part in 24/7 on-call rotations
Qualifications
- BS in Computer Science or equivalent
- Minimum 5+ years of industry experience, preferably at large scale
- Prior experience supporting 24x7, highly-available, systems
- Solid understanding of best practices around operations, software development, release engineering & continuous delivery.
- Deep expertise administering, supporting, debugging and tuning systems and technologies
Familiarity with:
- Hadoop/HBase/Storm architecture & infrastructure system administration.
- Experience with EMR, S3, EC2, EKS, IAAC, Cloud security, Serverless architectures
- Familiarity with Web servers & proxies, Apache, Squid, Trafficserver
- Experience with performance management/capacity analysis and planning
- Familiarity with configuration management (Chef, Puppet, Ansible, Salt)
- Familiarity with relational databases (MySQL, PostgreSQL) administration and usage
- Skills and knowledge running Infrastructure Automation Tools at scale (git, airflow, screwdriver, Jenkins)
- Strong programming skills in Perl/Python/Ruby/Golang
- Experience in a Red Hat/CentOS environment
- Information security best practices: trust management, certificates
- Strong working knowledge of TCP/IP networking & load-balancers
- Strong working knowledge of Linux operating system internals
- Strong analytical skills & ability to work in a production serving environment
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( www.yahooinc.com/careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( www.yahooinc.com/diversity/ ) page to learn more.
US Only: Please be aware that Yahoo requires all employees entering a U.S. Yahoo office and/or attending a company event (including client events) are required to be vaccinated for COVID-19. This position will require the successful candidate to obtain and show proof of a vaccination to enter a U.S. Yahoo office and/or attending a company event (including client events). Yahoo is an equal opportunity employer, and will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.
If hired for this position in Colorado, the compensation range for this position is between $117,000.00 - $195,000.00. The compensation may vary depending on your location, skills and experience. The compensation package may also include additional incentive compensation opportunities in the form of discretionary annual bonus or commissions, plus equity incentives. Yahoo provides industry-leading benefits including healthcare, retirement, company holidays, vacation, sick time, parental leave and an employee assistance program. This information is provided per the Colorado Equal Pay Act.
Currently work for Yahoo? Please apply on our internal career site.
Date Posted
09/23/2022
Views
6
Similar Jobs
Software Engineer Networking Software and Services - xAI
Views in the last 30 days - 0
The text describes xAIs mission to develop AI systems for understanding the universe and advancing human knowledge It outlines a role involving networ...
View DetailsData Scientist - KoBold Metals
Views in the last 30 days - 0
KoBold a leading mineral exploration company using AI seeks a Data Scientist to advance their exploration tech They highlight successful discoveries i...
View DetailsAssociate Technical Support Engineer - Recharge
Views in the last 30 days - 0
Recharge is a subscription platform for innovative brands offering customer retention solutions They seek Technical Support roles with 247 coverage em...
View DetailsFull Stack Product Engineer - Jiga
Views in the last 30 days - 0
Jiga is a remotefriendly company focused on empowering engineers with trust autonomy and flexibility They emphasize simplicity ownership and impactful...
View DetailsSenior Design Manager (Infrastructure) - Canonical
Views in the last 30 days - 0
Canonical a leading opensource provider seeks a Senior Design Manager to drive innovation in cloud and AI technologies The role offers remote work glo...
View DetailsSenior Product Designer - Org & Security - Typeform
Views in the last 30 days - 0
This job description outlines a role in developing an intelligent contact management system with AI capabilities The position involves designing user ...
View Details