How to Block Google Bot

Step-by-Step Guide

1. 1

   Step 1: Understand what robots.txt is.The other methods use html code

   What it is, is a text file that contains instructions for search engine crawlers, or "robots"
   
   to follow. , It will be disregarded if incorrectly labeled. , User-agent:
   GoogleBot ,, the User-Agent identifies what search program you're working with, which is Google in this case.
   
   The Disallow section tells the spider what to not allow to show up in that search engine.
   
   Disallowing "/" disabled the entire site. , It should work now.
2. 2

   Step 2: whereas this one uses "robots.txt"

3. 3

   Step 3: a search engine control method used the most commonly today.

4. 4

   Step 4: Create a text file

5. 5

   Step 5: named "robots.txt" and nothing else.

6. 6

   Step 6: Type the following.

7. 7

   Step 7: And then on a new line below that

8. 8

   Step 8: type the following Disallow: /

9. 9

   Step 9: Understand what it does.

10. 10

    Step 10: Upload robots.txt to your website server.

Detailed Guide

About the Author