Freelance Data Scraping Engineer (Python)

About the role

Mindrift is seeking experienced Python developers to join the Tendem project as Freelance Data Scraping Engineers. In this remote, part‑time role you will design and operate end‑to‑end web‑scraping workflows that feed our hybrid AI‑human platform with high‑quality structured data.

Key responsibilities

• Develop and maintain complete data extraction pipelines for complex, dynamic websites.
• Utilise internal tools such as Apify and OpenRouter together with custom Python scripts.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll and proxy management.
• Validate and verify extracted data against quality standards before delivery.
• Scale scraping operations using batching, parallelisation and monitoring to ensure stability.

Required profile

• Minimum 3 years of experience in data engineering, web scraping or software development.
• Bachelor’s or Master’s degree in Computer Science, Engineering, Applied Mathematics or a related field is a plus.
• Proven ability to work independently and deliver accurate results on schedule.

Required skills

• Python programming
• Web‑scraping libraries (BeautifulSoup, Selenium or equivalents)
• Experience with dynamic content handling (JavaScript, AJAX, infinite scroll)
• API integration and proxy usage
• Familiarity with Apify and OpenRouter platforms
• Data validation, batching and parallel processing techniques

What we offer

• Flexible remote work schedule
• Compensation up to $20 USD per hour, based on contribution level
• Opportunity to collaborate on cutting‑edge AI‑augmented projects