pythonscrapyscrapinghub

Download project's source-code from Scrapinghub


I have a project deployed on Scrapinghub, I do not have any copy of that code at all.

How can I download the whole project's code on my localhost from Scrapinghub?


Solution

  • I was able to download project code using

    shub fetch-eggs project_id_here
    

    Where project_id_here can be grabbed from browser URL when project is opened.

    The resultant file will be a *.egg just extract it like a ZIP file using WinRAR or any other tool you use.

    Additional notes: - SHUB does not have user-friendly errors, once I was logged into shub using a different account and was trying to download project of a another different account, so please make sure you are logged into the same scrapinghub account in which the project exists you are trying to download.