How can i block my testing domain for search engine

2

1

How can I block this site, that I administer (http://test.puttinout.com/), for search engines?

As I have noticed, Google has indexed most of our pages, but we don't need that Google indexes those pages for us.

Check Google index details here.

user291424

Posted 2014-01-27T14:05:04.080

Reputation: 21

Please any one tell me how can i blocked this through robots.txt ? what whould be write on robots.txt file? – user291424 – 2014-01-28T14:55:35.297

Answers

3

Add a robots.txt file to your root directory. So, create a text file, called Robots.txt with the following information inside (this will block everything):

User-agent: *
Disallow: /

Then, upload this file to the website's root directory on your server

Search Google for 'robots.txt file' for more details (such as blocking certain pages, or even certain bots)

Or use NOINDEX in the meta tag

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

Since the site has been indexed, you may need to request they un-index the pages: https://support.google.com/webmasters/answer/164734?hl=en

So, in notepad add the following

User-agent: * 
Disallow: test.puttinout.com

Name it robots.txt and upload it to your root directory.


The problem with the above is, it only works for engines that obey the robots file. So, another way, is if you have a static IP address. Simply forward all connections to your website (other than your IP address) away from your testing pages.


Another option, is to force a login on your testing. This could even be a javascript password since it doesn't have to be secure. Then, after logged in, authenticate the user with a cookie or similar.

Dave

Posted 2014-01-27T14:05:04.080

Reputation: 24 199

Thanks @Dave rook will you please guide me what should i add in robots.txt file for block this ? – user291424 – 2014-01-27T14:27:58.643

Please tell me how to add test.puttinout.com in robots.txt file like ?

User-agent: * Disallow: test.puttinout.com – user291424 – 2014-01-27T14:32:19.017

See the SuperUser website for example http://superuser.com/robots.txt

– Dave – 2014-04-01T09:01:45.880