Senior Python Data Scraping Engineer (Freelance)

Mindrift connects specialists with innovative technology projects, aiming to develop high-quality AI technologies by combining global real-world expertise with advanced AI development efforts. This role is part of the Tendem project focusing on specialized data scraping workflows.

• At least 5+ years of experience in data engineering, web scraping, automation, or software development.
• Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related fields is a plus.
• Strong technical foundation with scripting, automation, and data extraction workflows.
• Experience with Python web scraping libraries such as BeautifulSoup and Selenium, including dynamic content and APIs via proxies.
• Ability to extract data from complex and inconsistent HTML structures.
• Experience in data cleaning, normalization, validation, and delivering structured datasets (CSV, JSON, Google Sheets).
• Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
• Experience with cloud infrastructure like AWS and containerization using Docker.
• Hands-on experience with LLM frameworks like LangChain and OpenRouter applied to automation.
• Strong attention to detail and ability to troubleshoot independently.
• English proficiency upper-intermediate (B2) or above is required.

Nice to have:

• A link to GitHub repository showcasing projects or code samples.

• Own end-to-end data extraction workflows across complex websites, ensuring complete coverage and accuracy.
• Leverage tools and custom workflows to accelerate data collection and validation.
• Adapt extraction methods for dynamic and interactive web sources including JavaScript-rendered content.
• Enforce data quality standards through validation and consistency controls.
• Scale scraping operations using batching or parallelization and maintain stability against site changes.