Sr. Big Data DevOps Engineer (AWS EMR) - (Remote)
Company
Okaya Power Group
Location
Remote
Type
Full Time
Job Description
Please send your top qualified candidate w/ EXCELLENT COMMUNICATION SKILLS that possesses the skills outlined in the JD below.
Please also include c2c rate, contact details, and LinkedIn profile link (if they have one).
Client: Lending Club
Role: Sr. Big Data DevOps Engineer (AWS EMR)
Location: Remote
Length: 12 months + possible extension
Rate: $70/hrly c2c
The AWS EMR experience is key!!
Senior Big Data DevOps Engineer (min. 10 yrs. exp.):
Must have experience designing, building, scaling and maintaining the infrastructure in datacenter and AWS Big Data analysis tools and machine learning applications.
- accountability for the end-to-end availability, efficiency, reliability and security of our Big Data infrastructure in AWS.
- ensure that our developers & analysts are central to the experience of our platform.
- build custom tools that automate day-to-day operational tasks on the new AWS platform.
- Provide input and accountability for setting the standards of our production environment.
- agile and flexible when managing multiple and changing priorities.
- participate in 24X7 on-call rotation investigating and responding to issues
Requirements:
- Must have deep understanding of Hadoop ecosystem like HDFS, Yarn, Hive, Spark, Oozie, Presto and Ranger
- Excellent knowledge in AWS including EMR, RDS and good understanding on IaaS, PaaS
- Experience in infrastructure automation using Terraform
- Demonstrated proficiency in Bash & Python, Java
- Good understanding of all aspects of JRE/JVMand GC tuning
- experience providing and implementing observability solutions based on "Logs, Metrics &Graphs AWS Cloud watch, Splunk, Elastic stack, Prometheus, Grafana etc.
- Hands-on experience with RDBMS (Oracle, Mysql) and NoSql (Cassandra, MongoDB)
- Good grasp of the basics of SQL (joins, etc.)
- Conduct post-incident reviews and follow-up RCA resulting from platform issues.
- Experience with configuration management and remote execution tools such as Chef, Puppet, SaltStack, etc.
- Experience with Airflow, Qubole and Hortonworks is a plus
- Experience with cloud native Bigdata platforms like Databricks, Snowflake etc., is a plus.
Date Posted
09/14/2022
Views
5
Similar Jobs
Account Manager, Care Partnerships - Headway
Views in the last 30 days - 0
Headway a mental health care company founded in 2019 aims to revolutionize mental healthcare by building a national network of providers accepting ins...
View DetailsDirector of Pricing - Garner Health
Views in the last 30 days - 0
Garner Health is a rapidly growing company backed by toptier venture capital firms Their mission is to transform the healthcare economy by delivering ...
View DetailsDirector, Product, Customer, and Lifecycle Marketing - Garner Health
Views in the last 30 days - 0
Garner Health is seeking an experienced Product Marketing Leader to join their team The ideal candidate will lead the product marketing efforts focusi...
View DetailsLinux Support Engineer - Voltage Park
Views in the last 30 days - 0
Voltage Park is seeking a Linux Support Engineer for a fulltime remote position The ideal candidate will have command line level Linux sys administrat...
View DetailsData Analyst - Agero
Views in the last 30 days - 0
Agero a leading B2B whitelabel provider of digital driver assistance services is revolutionizing the vehicle ownership experience through datadriven t...
View DetailsDirector, Product (Remote) - Dscout
Views in the last 30 days - 0
Dscout is a leading company in experience research technology offering a platform for major companies to gain insights into user needs and behaviors T...
View Details