tcpscrapyscrapy-splashscrapy-shellrequest-timed-out

scrapy response : twisted.internet.error.TCPTimedOutError: TCP connection timed out: 10060


I'm scraping data from a website since 3 months ago, but today I can't access the website anymore, neither with my web-browser. The site is still accessible via mobile phone. I have this message when I test a link in Scrapy shell :

twisted.internet.error.TCPTimedOutError: TCP connection timed out: 10060

Do you think I'm blacklisted? Or is it a technical problem?

I'm using python3 + scrapy + splash via docker all under Windows 10.


Solution

  • I think my IP was banned because I can't access the website via my web-browser or even on other computer with the same connection. And the website works fine when using another IP address. I fixed this by adding Scrapoxy in my project.