Freelance Data Scraping Engineer (Python)

About the role

Mindrift seeks an experienced Python Data Scraping Engineer to support the Tendem project. This part‑time remote freelance position focuses on building reliable web‑scraping workflows for real‑world data needs.

Key responsibilities

• Design and own end‑to‑end data extraction pipelines for complex websites, delivering structured datasets.
• Utilise and extend tools such as Apify and OpenRouter, alongside custom scripts, to accelerate collection and validation.
• Handle dynamic, JavaScript‑rendered content, adapting methods for infinite scroll, AJAX and changing site behaviour.
• Enforce data quality through validation checks, cross‑source consistency and formatting standards.
• Scale large‑volume scraping operations using batching or parallelisation, monitor failures and maintain stability.

Required profile

• Minimum 3 years of experience in data engineering, web scraping or automation.
• Strong technical foundation with a methodical, detail‑oriented approach.
• Ability to work independently and solve non‑trivial extraction problems.
• Bachelor’s or Master’s degree in Computer Science, Engineering or related field is a plus.

Required skills

• Python programming.
• Web‑scraping libraries such as BeautifulSoup and Selenium (or equivalents).
• Experience with dynamic content handling (JS, AJAX, infinite scroll).
• Use of proxies and API interaction.
• Familiarity with platforms like Apify and OpenRouter.
• Data validation, batching and parallel processing techniques.