Sr Big Data Engineer

We are looking for a Senior Big Data Developer that loves solving complex problems across a full spectrum of technologies. You will help ensure our technological infrastructure operates seamlessly in support of our business objectives.

Objectives of this Role

• Develop and implement data pipelines that extracts, transforms, and loads data into an information product that helps to inform the organization in reaching strategic goals
• Work on ingesting, storing, processing, and analyzing large data sets
• Create scalable and high-performance web services for tracking data
• Translate complex technical and functional requirements into detailed designs
• Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
• Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs

Daily and Monthly Responsibilities

• Develop and maintain data pipelines implementing ETL processes
• Take responsibility for Hadoop development and implementation
• Work closely with a data science team implementing data analytic pipelines
• Support production application and Incident management.
• Help define data governance policies and support data versioning processes
• Maintain security and data privacy working closely with Data Protection Officer internally
• Analyze a vast number of data stores and uncover insights

Skills and Qualifications

• Over all 6-8 years of experience in Hadoop & Big Data along with 2-3 year of experience in AWS Cloud.
• Demonstrated experience with Agile or other rapid application development methods
• Minimum 4 years of experience with Big Data Components/Frameworks (Hadoop, HBase, MapReduce, HDFS, Pig, Hive, Sqoop, Flume, Ozie, etc.) and java programming languages.
• Hands on working experience on Hive, Spark, Python, Shell scripting.
• Understanding of data warehousing and data modeling techniques
• Strong data engineering skills on the AWS Cloud Platform is essential
• Hands-on expertise with application design, software development, and automated testing
• Must have 3+ years of demonstrated experience leading teams of engineers
• Experience with RESTful web services, open API development, and SOA concepts
• Experience with parallel and distributed (multi-tiered) systems, algorithms, message queuing, and relational databases

Preferred Qualifications

Degree in computer sciences or engineering

Location
United States - Arizona - Phoenix

It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.

GBT Recruitment Privacy Statement