Associate Software Engineer, Big Data

As the Associate Software Engineer, Data/Data Engineer you are passionate about developing products that are simple, intuitive, and beautiful. You will be making an impact on HG’s core data platform/processing engine using modern Big Data techniques particularly working with enterprise applications for B2B. We are a small engineering focused team who are delivering innovative features in a fast-growing market. We build Big Data systems utilizing cutting edge technologies and solutions that allow our developers to learn and develop while shipping amazing products.

You will be involved in building data pipelines at a large scale to enable business teams to work with data and analyze metrics that support and drive the business. You will partner with cross functional teams to identify opportunities and continuously develop and improve processes for

What You’ll Do:
You will work on our Big Data Insights Platform which is responsible for processing billions of unstructured documents, and a large data lake to extract/syndicate our intelligence for customer consumption.
Working closely with devops to define/implement and maintain data engineering infrastructure in best shape
Brainstorm and contribute towards building next gen data engineering architecture.
You will be working on solving hard data problems using cutting edge technologies.

What You’ll Be Responsible For:
You will collaborate with Product Development Teams to build the most effective solutions
You will develop features in our databases, backend apps, and Data as a Service (DAAS) product
You will help collaborate & help senior engineers to design large scale enterprise big-data systems
You will work on ideas from different team members as well as your own
Fix data & pipeline bugs as and when we detect them
Attend daily stand-up meetings, planning sessions, encourage others, and collaborate at a rapid pace

What You’ll Need:
BS, MS, or Ph.D. in Computer Science or related technical discipline
2+ years of experience in data engineering, or an equivalent combination of education and experience
Competency in using Scala/Java, Spark, Airflow and Hadoop are essential for success in this position
2 or more years of designing and programming in a work setting
Proficient in Java or Scala (understand and have real-world experience with design patterns)
Intermediate/expert level knowledge in SQL of any flavor (MySQL, Postgres, Snowflake, SQL server etc.)
Experience with Amazon Web Services (EC2, S3, RDS, EMR, ELB etc.) or Databricks or similar cloud platforms
Experience with web services using REST
Comfortable working with CI/CD and automation environments such as Docker, Kubernetes, Terraform or similar
Understand pragmatic agile development practices

Nice-to-haves:
Actual coding experience in large distributed environments with multiple endpoints and complex interactions
Basic DevOps skills (automate everything, infrastructure as code)
Loves startup culture where everyone's contributions are felt and loved.
Self-learner, hacker, technology advocate who can work on anything
Amazing engineering skills, you’re on your way to being one of the best engineers you know
Experience working with interesting and successful projects
Thrive in a fast growing environment
Excellent written and spoken English communication

About Us:

Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest growing companies accelerate their sales, marketing, and strategy efforts. 

We offer a competitive salary, 401K, growth potential, great benefits, and an accomplished diverse remote team. As a remote worker, you are invited to work in any U.S. city where you’re happiest and most productive, while also participating in company-wide events, where we strive to ensure our remote team members feel included. We run the gamut in geography, lifestyle and interests, but we’re united by a common set of core values: we ask for and give help, we embrace challenges, we are all part of the solution, and we care about our work, our customers and each other. 

HG Insights determines pay for positions using local, national, and industry-specific survey data. We strive to make competitive offers allowing the new employee room for future growth. Individual compensation packages are based on a various factors unique to each candidate. All offers are determined by a number of factors, including, but not limited to, the applicant's experience, knowledge, skills, and abilities, as well as internal factors.

The salary range for this position is $110,000 - $120,000. Some of our roles are eligible for variable compensation that is not reflected in these figures and is role specific. The Talent Acquisition team will communicate all compensation components.

HG Insights Company is an Equal Opportunity Employer 

Please note that HG Insights does not accept unsolicited resumes from recruiters or employment agencies. In the event of a recruiter or agency submitting a resume or candidate without a signed agreement being in place, we explicitly reserve the right to pursue and hire such candidates without any financial obligation to the recruiter or agency. Any unsolicited resumes, including those submitted directly to hiring managers, are deemed to be the property of HG Insights