Freelance Python Data Scraping Engineer

About the role

Mindrift is seeking experienced Python developers to join the Tendem project as freelance Data Scraping Engineers. In this remote, part‑time role you will act as an AI Pilot, collaborating with AI‑driven agents to design, execute, and validate complex web‑scraping workflows that feed real‑world data into generative AI systems.

Key responsibilities

• Design and own end‑to‑end data extraction pipelines for dynamic websites, ensuring full coverage and high accuracy.
• Utilize internal tools such as Apify and OpenRouter together with custom Python scripts to collect, validate, and deliver structured datasets.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll, and API interactions, adapting to site changes quickly.
• Implement data quality checks, cross‑source consistency controls, and formatting validation before hand‑off.
• Scale scraping operations using batching, parallelisation, and proxy management while monitoring failures and maintaining stability.

Required profile

• Minimum three years of professional experience in data engineering, web scraping, automation, or software development.
• Strong problem‑solving ability and attention to detail for quality‑focused delivery.
• Comfortable working independently on a remote schedule and communicating progress effectively.

Required skills

• Python
• BeautifulSoup
• Selenium (or similar browser automation)
• Apify
• OpenRouter
• Web scraping of dynamic content (JavaScript, AJAX, infinite scroll)
• API integration and proxy handling

What we offer

• Flexible freelance contract with the ability to set your own working hours.
• Compensation up to $20 per hour, based on contribution level and pace.
• Opportunity to work on cutting‑edge AI‑enhanced data projects with a global team.