Freelance Python Data Scraping Engineer

About the role

Mindrift is seeking experienced Python engineers to join the Tendem project as freelance data‑scraping specialists. You will work remotely, designing and executing end‑to‑end web extraction workflows that feed our hybrid AI‑human platform.

Key responsibilities

• Develop and maintain full‑cycle data extraction pipelines for complex, dynamic websites.
• Utilise internal tools such as Apify and OpenRouter, as well as custom Python scripts, to collect and validate data.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll and proxy management to ensure reliable scraping.
• Implement data quality checks, cross‑source consistency controls and formatting validation before delivery.
• Scale operations using batching, parallelisation and monitoring to minimise failures and adapt to minor site changes.

Required profile

• Minimum 3 years of experience in data engineering, web scraping or software development.
• Strong problem‑solving skills and ability to work independently on a remote schedule.
• Familiarity with agile or freelance project environments.

Required skills

• Python
• BeautifulSoup
• Selenium (or similar browser automation)
• Apify
• OpenRouter
• Proxies and API integration
• JavaScript, AJAX handling
• Data validation and quality assurance
• Batch processing and parallelisation techniques

What we offer

• Flexible remote work schedule.
• Compensation up to $20 USD per hour, based on contribution level.
• Opportunity to collaborate with AI‑driven projects and expand your technical portfolio.