Freelance Data Scraping Engineer (Python)

Mindrift operates the Tendem project, which integrates AI with human expertise to perform specialized data scraping workflows. This role contributes to AI projects from major tech innovators.

• At least 3 years of relevant experience in data engineering, web scraping, automation, or software development.
• Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
• Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools, including handling dynamic content (JS, AJAX, infinite scroll) and APIs via proxies.
• Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
• Solid background in data cleaning, normalization, validation, and delivering structured datasets (CSV, JSON, Google Sheets).
• Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving.
• Strong attention to detail and commitment to data accuracy.
• Self-directed work ethic with the ability to troubleshoot independently.
• English proficiency at upper-intermediate (B2) level or above (required).

Nice to have:

• A link to GitHub portfolio.

• Own end-to-end data extraction workflows across complex websites ensuring accuracy and structured dataset delivery.
• Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection and validation.
• Adapt scraping approaches to extract data from dynamic, JavaScript-rendered, and interactive web sources.
• Enforce data quality standards through validation checks and cross-source consistency controls.
• Scale scraping operations using efficient batching or parallelization while monitoring failures and maintaining stability.