Senior Software Engineer, Data

Want more jobs like this?

Get Software Engineering jobs in San Francisco, CA delivered to your inbox every week.

Get Jobs

Send me The Muse newsletters for the best in career advice and job search tips.

By signing up, you agree to our Terms of Service & Privacy Policy.

As a Senior Data Engineer, you will:

• Work on pipelines ingesting greater than 1gb per second
• Design, implement, and own software solutions for ingesting and exposing high volume data feeds
• Coordinate with engineering, analytics, and other teams to assess the cost and value of existing and potential projects
• Research and evaluate new technologies in the big data space to guide our continuous improvement
• Collaborate with multifunctional engineers across the company to help tune the performance of large data applications to drive cost savings

We’re looking for:

• 3+ years of experience working with a distributed framework like Spark, Flink, Kafka Streams, Dask, or Hadoop
• 1+ years of experience with ETL job orchestration, preferably with a feature-rich tool such as Airflow, Argo, or Rundeck
• 3+ years of experience working with Scala, Python, Java, or C#
• 5+ years ensuring the reliability of software and the integrity of large data stores in a production environment
• Exposure to a variety of databases and no-SQL appliances (Redshift, Snowflake, Druid, Dynamo, Cassandra, Kafka, Elastic Search, Hive, etc.)

Bonus points if you have:

• +1 years working with a streaming framework
• Competent building new data visualizations using an appliance (Grafana, Looker, Superset) or a lower-level framework (matplot, plotly, D3)
• Exposure to some predictive models and ML algorithms
• Experience managing a spark cluster
• Familiarity with Kubernetes and building Docker images
• DBA experience