Senior Big Data Engineer

We are looking for a Senior Big Data Engineer who will work on building and managing Big Data Pipelines for us to deal with the huge, structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.
Responsibilities

• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution
• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale
• Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark
• Understand and critically review existing data pipelines, and come up with ideas in collaboration with Technical Leaders and Architects to improve upon current bottlenecks
• Take initiatives and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.

Required qualifications

• 5+ years of experience in developing highly scalable Big Data pipelines.
• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Hadoop or Flink, and the file types they deal with.
• Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.
• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.
• Experience with Git and build tools like Gradle/Maven/SBT.
• Experience with data warehouse and BI solutions is preferable
• Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
• Have elegant, readable, maintainable, and extensible code style.

Benefits

• Flexible PTO
• Excellent Medical, Dental and Vision Insurance
• 401k Match
• Stock Options
• Parental Leave
• Be part of creating our clean energy future

About GridX
GridX is the catalyst of our clean energy future. Utilities and energy technology providers rely on our analytics solutions to tell people exactly what they can expect to pay when making clean energy decisions, like changing to a time-of-use rate plan, buying an electric vehicle, installing solar and more. The result is less strain on the electric grid, happier customers, and increased consumer investment in sustainable technologies. Working at GridX puts you at the center of realizing our clean energy future.
At GridX, we value the diversity of our employees and partners. We believe that our company thrives when we support and celebrate our differences.