I'm developing a website , and I want to host the development work for the client so he can approve , but I don't want the website to be found by search engines.
How can I hide it ?
I heard about adding robot.txt ?
any advice ?
If you don't put public links to the website, search engines will not easily find it. However, at some point, there is bound to be a link there if many people discuss the site.
Robots.txt will help for all legitimate search engines, such as Google. It will however not help if someone accidentally finds the url or it is left in browser history.
The most sure way is to put a password on the site: http://www.elated.com/articles/password-protecting-your-pages-with-htaccess/