Lead Data Engineer

Required Experience:

• 8+ years as a hands-on Data Engineer designing and implementing data solutions

• Team lead and/or mentorship of other engineers

• Ability to develop end-to-end technical solutions into production — and to help ensure performance security scalability and robust data integration.

• Programming expertise in Java Python and/or Scala

• Core cloud data platforms including Snowflake AWS Azure Databricks and GCP

• SQL and the ability to write debug and optimize SQL queries

• Client-facing written and verbal communication skills and experience

• Create and deliver detailed presentations

• Detailed solution documentation (e.g. including POCS and roadmaps sequence diagrams class hierarchies logical system views etc.)

• 4-year Bachelor's degree in Computer Science or a related field

Prefer any of the following:

• Production experience in core data platforms: Snowflake AWS Azure GCP Hadoop Databricks

• Cloud and Distributed Data Storage: S3 ADLS HDFS GCS Kudu ElasticSearch/Solr Cassandra or other NoSQL storage systems

• Data integration technologies: Spark Kafka event/streaming Streamsets Matillion Fivetran NiFi AWS Data Migration Services Azure DataFactory Informatica Intelligent Cloud Services (IICS) Google DataProc or other data integration technologies

• Multiple data sources (e.g. queues relational databases files search API)

• Complete software development lifecycle experience including design documentation implementation testing and deployment

• Automated data transformation and data curation: dbt Spark Spark streaming automated pipelines

• Workflow Management and Orchestration : Airflow AWS Managed Airflow Luigi NiFi

Why phData? We Offer:

• Remote-First Workplace

• Medical Insurance for Self & Family

• Medical Insurance for Parents

• Term Life & Personal Accident

• Wellness Allowance

• Broadband Reimbursement

• Continuous learning and growth opportunities to enhance your skills and expertise

• Other benefits include paid certifications professional development allowance and bonuses for creating for company-approved content

#LI-DNI