Sr. Big Data DevOps Engineer (AWS EMR) - (Remote)
Job Description
Please send your top qualified candidate w/ EXCELLENT COMMUNICATION SKILLS that possesses the skills outlined in the JD below.
Please also include c2c rate, contact details, and LinkedIn profile link (if they have one).
Client: Lending Club
Role: Sr. Big Data DevOps Engineer (AWS EMR)
Location: Remote
Length: 12 months + possible extension
Rate: $70/hrly c2c
The AWS EMR experience is key!!
Senior Big Data DevOps Engineer (min. 10 yrs. exp.):
Must have experience designing, building, scaling and maintaining the infrastructure in datacenter and AWS Big Data analysis tools and machine learning applications.
- accountability for the end-to-end availability, efficiency, reliability and security of our Big Data infrastructure in AWS.
- ensure that our developers & analysts are central to the experience of our platform.
- build custom tools that automate day-to-day operational tasks on the new AWS platform.
- Provide input and accountability for setting the standards of our production environment.
- agile and flexible when managing multiple and changing priorities.
- participate in 24X7 on-call rotation investigating and responding to issues
Requirements:
- Must have deep understanding of Hadoop ecosystem like HDFS, Yarn, Hive, Spark, Oozie, Presto and Ranger
- Excellent knowledge in AWS including EMR, RDS and good understanding on IaaS, PaaS
- Experience in infrastructure automation using Terraform
- Demonstrated proficiency in Bash & Python, Java
- Good understanding of all aspects of JRE/JVMand GC tuning
- experience providing and implementing observability solutions based on "Logs, Metrics &Graphs AWS Cloud watch, Splunk, Elastic stack, Prometheus, Grafana etc.
- Hands-on experience with RDBMS (Oracle, Mysql) and NoSql (Cassandra, MongoDB)
- Good grasp of the basics of SQL (joins, etc.)
- Conduct post-incident reviews and follow-up RCA resulting from platform issues.
- Experience with configuration management and remote execution tools such as Chef, Puppet, SaltStack, etc.
- Experience with Airflow, Qubole and Hortonworks is a plus
- Experience with cloud native Bigdata platforms like Databricks, Snowflake etc., is a plus.
Date Posted
09/14/2022
Views
5
Similar Jobs
Software Engineer Networking Software and Services - xAI
Views in the last 30 days - 0
The text describes xAIs mission to develop AI systems for understanding the universe and advancing human knowledge It outlines a role involving networ...
View DetailsData Scientist - KoBold Metals
Views in the last 30 days - 0
KoBold a leading mineral exploration company using AI seeks a Data Scientist to advance their exploration tech They highlight successful discoveries i...
View DetailsAssociate Technical Support Engineer - Recharge
Views in the last 30 days - 0
Recharge is a subscription platform for innovative brands offering customer retention solutions They seek Technical Support roles with 247 coverage em...
View DetailsFull Stack Product Engineer - Jiga
Views in the last 30 days - 0
Jiga is a remotefriendly company focused on empowering engineers with trust autonomy and flexibility They emphasize simplicity ownership and impactful...
View DetailsSenior Design Manager (Infrastructure) - Canonical
Views in the last 30 days - 0
Canonical a leading opensource provider seeks a Senior Design Manager to drive innovation in cloud and AI technologies The role offers remote work glo...
View DetailsSenior Product Designer - Org & Security - Typeform
Views in the last 30 days - 0
This job description outlines a role in developing an intelligent contact management system with AI capabilities The position involves designing user ...
View Details