Senior Python Data Scraping Engineer (Freelance)

Mindrift connects specialists with innovative technology projects, aiming to develop high-quality AI technologies by combining real-world expertise with advanced AI development. The role is part of the Tendem project dedicated to specialized data scraping workflows.

• Minimum 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or related fields is a plus.
• Strong experience with Python web scraping tools such as BeautifulSoup and Selenium, handling dynamic content including JS, AJAX, and infinite scroll.
• Proven skills extracting data from complex HTML structures and archived pages.
• Solid background in data cleaning, normalization, validation, and delivering structured datasets (CSV, JSON, Google Sheets).
• Experience dealing with anti-bot mechanisms and dynamic site structures at scale.
• Familiarity with cloud infrastructure like AWS and containerization using Docker.
• Hands-on experience with LLM frameworks such as LangChain and OpenRouter.
• Strong attention to detail, data accuracy, and ability to work independently.
• English proficiency at upper-intermediate level (B2) or above.

Nice to have:

• Link to GitHub portfolio.

• Own end-to-end data extraction workflows across complex websites, ensuring completeness and accuracy.
• Use tools and custom workflows to expedite data collection, validation, and task execution.
• Adapt scraping strategies to handle dynamic and interactive web content including JavaScript-rendered sites.
• Enforce data quality standards via validation checks and consistency controls before delivery.
• Scale scraping operations using batching or parallelization, monitor failures, and maintain stability against site changes.