Web Automation Engineer (Anti-Scraping)

Apify · Other US Location

Company

Apify

Location

Other US Location

Type

Full Time

Job Description

Apify's mission is to make the web more programmable ๐Ÿ’ป.

Why? Because we believe that humans have better things to do than fill in internet forms, compile Excel sheets of copy-pasted data, or watch thousands of videos to determine whether they include a specific brand logo. Those are jobs for a machine. And just as we have tools that make our lives easier in the real world, we should also have tools to make our lives easier on the web.

We use web automation to robotize unsubscribe flows to save people money, and we collect billions of rows of data from all over the world for science, market research, or finding lost children.

Fortune 500 companies and small startups alike need this power to make great business decisions ๐Ÿš€.

To automate human activities on the web and proceed with our mission, we need robots that behave and act like real users, and this is where we need your help!

You will be part of one of our 5 product teamsโ€”the team that works on Apifyโ€™s open-source tooling loved by the community.

The team is led by Martin Adamek, co-author, and maintainer of Apifyโ€™s Crawlee and his own MikroORM framework.

You will research existing anti-scraping services and implement new open-source libraries or internal services to overcome them by utilizing various proxy services, browser fingerprinting methods, human-like browser interaction, session management, and others.

Our tech stack:

  • Frontend: React.js, styled-components, Storybook, Cypress
  • Backend: TypeScript/Node.js, Next.js, Nest.js, Docusaurus, Jest
  • Infra: AWS, Kubernetes, Helm, MongoDB, Redis, DynamoDB, S3, GitHub Actions...
  • Monitoring: New Relic, LogDNA, Sentry, PagerDuty
  • Tools: GitHub, ZenHub, Notion, GSuite
  • AI Tools: Langchain, LlamaIndex, Pinecone, OpenAI API, Web agents
  • Process: two-week sprints, code reviews, tests, automating whatever we can, deploying multiple times per day

You'll be a perfect match ๐Ÿ’œโž•๐Ÿ’œ if you have:

  • 3+ years of industry experience in Python or Node.js/TypeScript development
  • You have prior experience in web scraping or web automation
  • You are a hacker being able to solve unique, unprecedented challenges
  • You know how the web works, from HTTP protocol up to modern browser APIs to draw an SVG
  • Experience in open-source development is a plus
  • Experiment-driven and collaborative mindset
  • Good communication skills in English

Why should you work for Apify?

  • Space, support, and autonomy for personal growth, with a direct impact on our success
  • Full-time position in Prague at our amazing office located in Lucerna Palace, Prague, Czech Republic ๐Ÿฐ
  • Option to work remotely ๐Ÿ›‹๏ธ
  • Flexible working hours (perfect for both night owls ๐Ÿฆ‰ and early birds ๐Ÿฅ)
  • Zero bullshit policy โ€“ No Jira, no Okta, no Confluence, no Certifiedโ„ขScrumMastersยฎ, no quarterly estimates. Just GitHub, GSuite, Notion, Slack, and shipping stuff to production
  • Nobody counts holidays as long as the work gets done ๐Ÿ’ช
  • Stock options and profit sharing ๐Ÿ’ฐ
  • We welcome pets, kids, and bikes at the office ๐Ÿ•๐Ÿ‘จโ€๐Ÿ‘ง๐Ÿšฒ
  • Epic team buildings and offsites ๐Ÿšข with biking, canoeing, and other adventures ๐Ÿช‚
  • Solid education and training budget, conference tickets, internal โ€œEat & Learnโ€ sessions, and the possibility to work across teams ๐Ÿ‘ฉ๐Ÿผโ€๐Ÿ’ป๐Ÿ‘จ๐Ÿฝโ€๐Ÿ’ป
  • Generous hardware budget ๐Ÿ’ป
  • Free lunches every day ๐ŸŒฎ๐Ÿฑ๐Ÿœ๐Ÿ•๐Ÿฅก
  • Unlimited supply of โ˜• & ๐Ÿบ and snacks
  • Free entry to the wonderful Prague Zoo ๐Ÿ˜
  • Ping-pong, chess, PS5, lightsabers, foosball league after lunch, free Multisport card, and so on

Hiring process

Intro call โ˜Ž๏ธ โ†’ Home assignment ๐Ÿง‘๐Ÿผโ€๐Ÿ’ป โ†’ Interview โœ๏ธ โ†’ Meeting with the team ๐Ÿ• โ†’ Offer ๐Ÿ“„

Apply Now

Date Posted

07/01/2024

Views

8

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Software Architecture Engineering and Cloud Computing Engineer - The Aerospace Corporation

Views in the last 30 days - 0

The Aerospace Corporation is seeking a Senior Project Engineer with expertise in software architecture engineering and cloud computing The role involv...

View Details

Lead Technical Support Engineer - HERE Technologies

Views in the last 30 days - 0

This role Senior Technical Support Engineer at HERE Technologies involves supporting a diverse portfolio of products and services acting as a technica...

View Details

Principal / Lead Software Engineer- RUST (Algorithmic and Mathematics) - m/w/d - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking a Principal Software Engineer to lead the development of extended services for their VRP solver Tour Planning The role in...

View Details

Senior Software Engineer (Scala/Java) - HERE Technologies

Views in the last 30 days - 0

HERE Technologies is seeking an experienced backend engineer with strong Java or Scala skills to join the Map Processing Pipelines team The role invol...

View Details

Software Engineering Manager - Cargill

Views in the last 30 days - 0

The Software Engineering Manager job involves setting goals for a team responsible for software project development and delivery ensuring quality stan...

View Details

Sales Development Representative - UK (Remote) - Dscout

Views in the last 30 days - 0

Dscout is a company that specializes in experience research solutions helping innovative companies like Salesforce Sonos Groupon and Best Buy to build...

View Details