Senior Data Engineer - SQL, Python, DBMS

Job title: Senior Data Engineer - SQL, Python, DBMS

Duration:5-6 months (Contract)

Pay rate: $72/hr on W2 with benefits

Location:Remote (PST preferred)

Key Skills Required: SQL, Python, DBMS, Cloudera, Apache Hadoop, HortonworksJava, Apache Cassandra, Apache Hive, Hadoop Distributed File System (HDFS), Cloudera Impala, Apache Kafka, NoSQL Database, MapReduce

Job Responsibilities:

• Description Design and build reusable components, frameworks and libraries at scale to support analytics products.
• Design and implement product features in collaboration with business and Technology stakeholders.
• Anticipate, identify and solve issues concerning data management to improve data quality.
• Clean, prepare and optimize data at scale for ingestion and consumption.
• Drive the implementation of new data management projects and re-structure of the current data architecture.
• Implement complex automated workflows and routines using workflow scheduling tools.
• Build continuous integration, test-driven development and production deployment frameworks.
• Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
• Analyze and profile data for designing scalable solutions.
• Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.
• Mentor and develop other data engineers in adopting best practices.
• Responsible for understanding and utilizing tools such as Rational Rose, Eclipse, ClearCase, and memory/performance analysis tools (like NetBeans).
• Includes experience with Cloudera, Apache Hadoop, Hortonworks, MongoDB, Java, Apache Cassandra, Apache Hive, Hadoop Distributed File System (HDFS), Cloudera Impala, Apache Kafka, NoSQL Database, MapReduce, etc.

Educational Qualifications

• Bachelor's degree in Business, CS, or equivalent and 6+ years tech exp or business exp that includes working closely with IT.