Software Engineer, Big Data

What You’ll Do: 

As the Software Engineer, Data/Data Engineer you are passionate about developing products that are simple, intuitive, and beautiful. You will be making an impact on HG’s core data platform/processing engine using modern Big Data techniques particularly working with enterprise applications for B2B. We are a small engineering focused team who are delivering innovative features in a fast-growing market. We build Big Data systems utilizing cutting edge technologies and solutions that allow our developers to learn and develop while shipping amazing products.

You will be involved in building data pipelines at a large scale to enable business teams to work with data and analyze metrics that support and drive the business. You will partner with cross functional teams to identify opportunities and continuously develop and improve processes for 

What You'll Be Responsible For:

• Collaborating with Product Development Teams to build the most effective solutions
• Developing and enhancing features in our databases, backend apps, front end UI, and Data as a Service (DAAS) product
• Building data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications
• Authoring and scheduling workflows monitored by Airflow
• The design and architecture of data collection
• Collaborating with cross-functional teams to design and implement impactful solutions to department and business problems
• Supporting end users and teammates on code-related questions and issues
• Attending daily stand-up meetings, planning sessions, encourage others, and collaborate at a rapid pace

What You’ll Need: 

• BS, MS, or Ph.D. in Computer Science or related technical discipline
• 2+ years of experience in data engineering, or an equivalent combination of education and experience
• Expertise using Scala/Java, Spark, Airflow and Hadoop are essential for success in this position
• 2 or more years of designing and programming in a work setting
• Expert in SQL of any flavor (MySQL, Postgres, Snowflake, SQL server etc.)
• Proficient in Java or Scala (understand and have real-world experience with design patterns)
• Experience with Amazon Web Services (EC2, S3, RDS, EMR, ELB etc.) or similar cloud platforms
• Experience with web services using REST
• Comfortable working with CI/CD and automation environments such as Docker, Kubernetes, Terraform or similar
• Understand pragmatic agile development practices
• Coding experience in large, distributed environments with multiple endpoints and complex interactions
• Basic DevOps skills (automate everything, infrastructure as code)
• Experience working with interesting and successful projects
• The ability to thrive in a fast-growing environment

About Us:

Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest growing companies accelerate their sales, marketing, and strategy efforts. 

We offer a competitive salary, 401K, growth potential, great benefits, and an accomplished diverse remote team. As a remote worker, you are invited to work in any U.S. city where you’re happiest and most productive, while also participating in company-wide events, where we strive to ensure our remote team members feel included. We run the gamut in geography, lifestyle, and interests, but we’re united by a common set of core values: we ask for and give help, we embrace challenges, we are all part of the solution, and we care about our work, our customers and each other.  

We are following all local and state guidelines while in office. Employee safety is of utmost importance, and we are taking all necessary precautions. For more information on how we are doing this, please speak with one of our HR team members. Full vaccination against COVID-19 is required unless you qualify for a federally protected exemption.

HG Insights Company is an Equal Opportunity Employer 

Please note that HG Insights does not accept unsolicited resumes from recruiters or employment agencies. In the event of a recruiter or agency submitting a resume or candidate without a signed agreement being in place, we explicitly reserve the right to pursue and hire such candidates without any financial obligation to the recruiter or agency. Any unsolicited resumes, including those submitted directly to hiring managers, are deemed to be the property of HG Insights

#LI-BV1