New robots.txt...

[Marlowe]

Is so restrictive BARF's metadata doesn't even show up on a Google search for the forum itself:

 

[JackTheTripper]

Looks like it was updated in November 2012.

Was:

User-agent: Googlebot
Disallow: 
User-agent: googlebot-image
Disallow: 
User-agent: googlebot-mobile
Disallow: 
User-agent: Ask Jeeves
Disallow:
User-agent: *
Disallow: /
Crawl-delay: 20
Disallow: /cgi-bin/

Now:

User-agent: Googlebot
Disallow: /

User-agent: googlebot-image
Disallow: /

User-agent: googlebot-mobile
Disallow: /

User-agent: Ask Jeeves
Disallow: /

User-agent: *
Disallow: 
Crawl-delay: 20

Disallow: /cgi-bin/

The description isn't really set to anything exciting anyway, although the keywords does have some bike related stuff...

<meta name="keywords" content="vbulletin,jelsoft,forum,bbs,discussion,bulletin board,motorcycle,sportbike,motard,supermoto" />
<meta name="description" content="This is a discussion forum powered by vBulletin. To find out about vBulletin, go to http://www.vbulletin.com/ ." />

 

[mike23w]

you can't even use google to search barf anymore. boo.

 

[JackTheTripper]

You could use Yahoo or Bing!

http://www.bing.com/search?q=site:b...earidersforum.com+sportbile&sc=8-37&sp=-1&sk=

 

[Cincinnatus]

And here I was, thinking that Google is 'not evil'... :rofl