Freelance Data Scraping Engineer (Python)

Mindrift connects specialists with AI projects, focusing on unlocking potential of Generative AI through real-world expertise. This role is part of the Tendem project, combining AI and human collaboration for data scraping workflows.

• At least 3 years of experience in data engineering, web scraping, automation, or software development.
• Strong experience with Python web scraping tools such as BeautifulSoup, Selenium, handling dynamic content (JavaScript, AJAX, infinite scroll), and APIs via proxies.
• Proven ability to extract data from complex web structures.
• Background in data cleaning, normalization, and validation; delivering structured datasets (CSV, JSON, Google Sheets).
• Hands-on experience with large language models and AI frameworks.
• Strong attention to detail and self-directed troubleshooting ability.
• English proficiency at upper-intermediate (B2) or above.

Nice to have:

• Bachelor's or Master's degree in Engineering, Applied Mathematics, Computer Science, or related fields.
• A link to a GitHub profile.

• Own end-to-end data extraction workflows across complex websites ensuring accuracy and reliable delivery of structured datasets.
• Leverage internal tools (Apify, OpenRouter) with custom workflows to accelerate data collection and validation.
• Adapt extraction methods for dynamic and JavaScript-rendered content.
• Enforce data quality through validation checks and systematic verification.
• Scale scraping operations using batching or parallelization and monitor stability against site changes.