Staff Data Engineer

What You'll Do

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of SQL/NoSQL databases and data stores like MSSQL , Dynamodb.
• Building and optimizing 'big data' data pipelines, architectures and data sets using AWS cloud services and SnowFlake
• Design & support a multi-tenant SnowFlake data warehouse
• Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management using DBT and Airflow or similar tools.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores using Hadoop, Spark, Kafka, etc.
• Creating a strong test suite, alerting, monitoring and documentation for all the pipelines

Who You Are

• BS degree in Computer Science or relevant work experience
• 8+ years of experience in developing data pipelines and databases
• Proficient in Python and SQL
• Experience with Data Engineering best practices including Test Automation, Quality Controls, Reconciliation, Documenting data flows, etc.
• Have thorough knowledge of data structures and algorithms
• Have experience working with customers to understand and capture requirements
• Experience building highly scalable and reliable data pipelines using technologies like Spark, Hive, Trino/Presto, Airflow, Kafka, and/or Flink.
• Experience with data stores like Snowflake, Postgres, Feast

Pluses

• Experience with cloud service providers, including AWS, Azure, or Google
• Experience supporting multi-tenant data warehouses
• Familiarity with Analytical tools like Tableau
• Knowledge of data service and deployment frameworks, including Docker, and Kubernetes
• Experience with data compliance and governance tools like OneTrust or DataGrail
• Experience with the Kafka

The anticipated salary range for candidates who will work in our Playa Vista, California location is $158,000 to $180,000. The final salary offered to a successful candidate will depend on several factors, which may include, but are not limited to, the type and length of experience applicable to the role and within the industry, education, geographic location, etc. Commercial Real Estate Exchange, Inc (“Crexi”) is a multi-state employer, and this salary range may not reflect positions that work in other states.