Lead Data Engineer
Job Description
Who We Are:
At adMarketplace, we are passionate about improving the search experience for consumers, publishers, and advertisers without sacrificing user privacy. We are the largest people-led, privacy-safe consumer search marketplace.
Our mantra is to let our winners run. From your first day at AMP, you will have the opportunity to make a valuable contribution to the company. We’re excited about building and innovating new products. We embody our five core values (known as our 5C’s) with everything we do- Curiosity, Collaboration, Creative Conflict, Commitment, and Competitiveness. We believe in continuous professional growth, and offer all our employees career path mapping to ensure no one ever stops learning.
Growing Company. Small, Dynamic Teams. Real Impact.
The Role
At adMarketplace, we create best of breed consumer search technology using cutting-edge architectures with millisecond response time and crunch through terabytes of data every day. The ideal candidate is motivated to design for massive scale and push the boundaries of using ingested data in automated decisions. Our team uses a modern tech stack including Kafka, Spark, Java/ Scala/ Python, Kubernetes, Docker, AWS, Azkaban/ Airflow and modern Data Warehouses.
What You Will Do:
- Lead the development of ad-tech related data systems and system components using Python/Java and other software technologies
- ETL/ELT Pipelines
- Data-driven applications
- Clients integration automation components (Google, Amazon, LiveRamp)
- Work with Product and Tech teams for implementation of Data Engineering projects. Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
Requirements:
- BS in Engineering, Computer Science or related discipline with minimum 5 years of industry experience
- Must have 3+ years strong hands-on development experience using Python
- Experience developing, delivering and maintaining scalable data aggregation pipelines in a Senior Engineering position
- Experience with relational SQL and NoSQL databases
- Experience with AWS/ GCP/ Azure
- Experience working in a Linux environment/ Shell Scripting
- Experience with data pipeline and workflow management tools like Airflow, Luigi, Azkaban
- Experience with Apache Kafka, Spark and SparkSQL
- Experience with Data Warehouse (Redshift/ Snowflake/ BigQuery etc)
- Familiarity with Docker, CI/CD and Microservices
- Ability to collaborate with multiple teams and understanding testing and deployment methodologies
- Experience building software in continuous integration and delivery fashion in an automated way
- Experience working in an agile software development team using Jira
- Excellent documentation, communication, and troubleshooting skills
Is a plus:
- Experience in Java, Scala
- Digital advertising industry experience
*Compensation Range: $160,000 - $220,000
#LI-Hybrid
Join Us:
adMarketplace has been named as one of the best places to work in New York City by Built In and Crain’s- the latter of which have recognized us the past three years straight! AMP is currently experiencing triple digit growth, and it’s never been a better time to join our team!
We offer a robust continuing education program, management training, regular company-wide lunch and learns, and well-defined career paths to ensure all our employees have an opportunity to grow.
At adMarketplace, we play to win, but we learn from our setbacks. Our commitment to a collaborative environment means no one succeeds alone, and no one fails alone either.
We know you’ve come to expect comprehensive healthcare, wellness programs, paid time off, commuter benefits, and 401k matching from any company, so it’s a good thing we offer all of that and so much more. adMarketplace offers a dog friendly office, Summer Fridays, catered lunches, a fully stocked kitchen, ZogSports teams, happy hours and corporate retreats to encourage a strong work/life balance.
*This range represents the low and high end of the base salary someone in this role may earn as an employee of adMarketplace in the New York office. Salaries will vary based on various factors including but not limited to professional and academic experience; training; associated responsibilities; and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.
Date Posted
01/18/2023
Views
0
Similar Jobs
Software Engineering Lead - Dotdash Meredith
Views in the last 30 days - 0
Dotdash Meredith is seeking a skilled Engineering Lead for a missioncritical role in designing and scaling their nextgeneration publishing platform Th...
View DetailsSenior Software Engineer, Devices Automation - Block
Views in the last 30 days - 0
Square a company that has evolved since its inception in 2009 is seeking a Software Engineer with extensive experience in embedded devices and test en...
View DetailsIT Support Engineer (Contract) - Informa
Views in the last 30 days - 0
Curinos a company with decades of expertise in the financial services industry is seeking an IT Support Engineer for their New York office The role in...
View DetailsEngineer, Quality Assurance – BBU (EQA1) - JMA Wireless
Views in the last 30 days - 0
JMA is a leading company in wireless technology particularly in 5G with its advanced softwarebased platform manufactured in Syracuse NY The companys t...
View DetailsStaff Editor, Current Events - Dotdash Meredith
Views in the last 30 days - 0
The Staff Editor role involves coordinating crossplatform content across multiple verticals managing daily and breaking news and writingediting storie...
View DetailsBusiness Account Executive - Spectrum
Views in the last 30 days - 0
The Business Account Executive role involves selling primary and ancillary communications solutions to small and mediumsized businesses within a speci...
View Details