As a Python Developer within the scraping team, you will be among our talented and passionate team helping us optimize data collection!
Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
Conduct comprehensive code review and data validation to maintain the highest standards of code and data quality.
Leverage in-depth knowledge of the HTTP protocol, the mechanisms of modern web browsers, and our own internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot countermeasures.
Architect and contribute to significant new developments across multiple codebases, providing clear technical documentation and conducting training sessions for relevant teams when necessary.