phpgoogle-app-enginecurlweb-scrapinggoogle-shopping

Getting different results when scraping google shopping


Hi I'm scraping google shopping results with php (using curl and simple html dom library). Everything was ok I was getting the result of the stores in my country, then I uploaded the code to google cloud(google app engine), and the result of the scraping got different (stores that are not located in my country) as if the result was fetched from another google domine (another country)

This is the link I used https://www.google.com.sa/search?q=coffee&safe=images&tbm=shop I tried to edit the hl,gl but it did not work.

Someone said to change the http header 'accepted-language' but that also did not work

So my question is how do I get the same result when I run the code from google cloud


Solution

  • Looking through the support for Google Shopping, it seems that this is not supported anymore according to this link.

    What you may be able to try is to create a different project with an App Engine in a region closer to your location. You can find the list of locations here.

    Hope you find this useful.