html-content-extractionreferrals

To bypass referral check


Is there any way to bypass the referral check applied by some site in order to avoid there data from being extracted. Like if you follow this link!

You will get Access Denied Error. However , if you just go this link!, it takes you to home page and on filling on any quote say ABAN , it follows exactly the same GET request as the link used above.

Can anyone please suggest me some solution ??


Solution

  • Set your referrer to the correct value. You can spoof the value to anything you want programatically or by visiting the correct url before visiting the target url.