Data & Software Engineer BIM

Autodesk · San Francisco, CA

Company

Autodesk

Location

San Francisco, CA

Type

Full Time

Job Description

Job Requisition ID #

23WD70075

Position Overview

A Data Engineer is primarily focused on building the data foundations that enable data driven analytics, insights and decision making at Autodesk.

Responsibilities

  • Oversee the entire lifecycle of mission critical data services from design to runtime reliability, scaling and security. Require a mixture of solutions and software engineering in order create systems and services intended to collect, manage, store and utilize structured and unstructured data from internal and external sources
  • Create and establish architectural standards, best practices and assurance processes for all data related software, systems and applications
  • Develop reliable tools and systems for data ingestion pipelines collecting data from disparate data sources with the intent of integrating with existing data sets and exposing the data for consumption by other data services
  • Develop and maintain data pipelines and data processing workflows for various data services as needed by Autodesk internal, customer or partner projects
  • Build and maintain data quality and durability tracking mechanisms in order to provide visibility into and address inevitable disruptions in data ingestion, processing, and storage
  • Assist in building a comprehensive data catalog and implement data governance strategies as required by the business
  • Lead and/or participate in the design of data schemas at rest as well as in transit to ensure common protocols and storage mechanisms are in use across all data services
  • Collaborate with TPMs and direct business users to define and prioritize backlog
  • Address questions and concerns from downstream data consumers
  • Architect and build mission critical cloud infrastructure that provides the foundation to data collection, transport, storage, management, analysis, access, and visualization capabilities
  • Review internal and external business and product requirements for data operations and activity, suggesting changes and upgrades to systems and storage in order to accommodate ongoing needs
  • Partner with data and software architects to design the data models, API contracts or other architectural elements as needed
  • Stay abreast of industry best practices, patterns, and reference architectures, evaluate and analyze new technologies, capabilities, open source software, third party services and competitors in context of our data strategy to ensure we are adapting, extending or replacing our own core technologies to stay ahead of the industry

Minimum Qualifications

  • Strong technical aptitude and strong interest to learn best of class technologies around data warehousing, data wrangling, data quality, data governance and data ethics
  • Problem solving and analysis skills
  • Ability to translate deeply technical designs into business appropriate representations as well as analyze business needs and requirements ensuring implementation of data services directly correlates to the strategy and growth of the business
  • Experience building products in a cloud-based environments, preferably AWS and its services like EC2, Lambda, API Gateway, S3, EMR, RDS, Cloudwatch, Dynamodb, etc.
  • Programming skills in Python, Node.js, or Ruby
  • Intermediate to advanced SQL skills working with relational databases, query authoring as well as working familiarity with a variety of databases
  • Understanding of BASE and ACID consistency models in order to ensure the right data stores are being selected for the right purposes
  • Experience in cloud ETL, ELT and near-realtime data collection, transport and processing technologies

Preferred Qualifications

  • Expertise in PostgreSQL
  • Experience with AWS DMS tasks
  • Knowledge of Relational as well as NoSQL technologies such as Key-Value, Document, Wide Column, Graph, and Time Series data stores
  • Experience working with big data stack environment, like Hadoop, Hive, Spark and Presto
  • Experience working with infrastructure automation tools such as; Terraform and Cloudformation
  • Familiar with workflow management tools, like Airflow and Azkaban
  • Experience working with GitHub, Jira, Perforce, and Jenkins
  • Familiar with data governance frameworks, SDLC, and Agile methodology

#LI-SD2

Click below to learn more about our benefits in the US.

https://benefits.autodesk.com/

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.

Salary is one part of Autodesk's competitive package. For U.S.-based roles, we expect a starting base salary between $139,100 and $224,950. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Date Posted

05/22/2023

Views

7

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.8