Meta Tag that prompts robots....

#1 () 11-14-2005, 11:20 PM

I was reading a post over at CAP and someone had mentioned adding a meta-tag that prompts SE robots to come back to his site every X amount of days. I'm just curious if anyone else uses this. I'm a little green on this subject. Thanks

adioking · #2 () 11-14-2005, 11:47 PM

You can do this with the google sitemap by making a special .xml file for google.

otherwise you can use the meta tag "index,follow" to prompt an SE to simply follow your links.

dAn

PPP · #3 () 11-15-2005, 01:21 AM

It's a useless tag. The bots come back when they want.

stillshadow · #4 () 11-15-2005, 01:30 AM

Right, gotta go with PPP on this one. It would be great if we could tell them what to do, though.

#5 () 11-15-2005, 10:23 AM

Thats what I pretty much figured as in all my SEO research over the last three months I have never seen a simple tag that instructs the bot to come back every other day or whatever. Silly posters over at CAP.

GregK · #6 () 11-16-2005, 12:20 PM

The tag exists, its just worthless AFAIK lol

Code:

<meta name="robots" content="all" />
<meta name="revisit-after" content="7 days" />

best to use a robots.txt file...

Open a new file in notepad, paste the code below in it & upload it to your 'root' directory!
(TIP* Your 'root' directory is where your homepage index.html file resides & where all spiders look for a robots.txt file!)

Code:

User-agent: *
Disallow:

What the above code is saying to the crawlers is...
User-agent: * - User-agent Wildcard means ALL SPIDERS!
Disallow: - Disallow Nothing or Spider the whole site!

cheers