Jerom, what should i put under roobts

Thanks again for this pluging

If you'd googled, you'd found this withim 30 secs ;-)

The Robots META Tag is meant to provide users who cannot upload or control the /robots.txt file at their websites, with a last chance to keep their content out of search engine indexes and services.

<meta name="robots" content="robots-terms">

Examples of the Robots META Tag

The content="robots-terms" is a comma separated list used in the Robots META Tag that may contain one or more of the following keywords without regard to case: noindex, nofollow, all, index and follow.

noindex
Page may not be indexed by a search service.

<meta name="robots" content="noindex">

nofollow
Robots are not to follow links from this page.

<meta name="robots" content="nofollow">

Admin Note: The robots directives of index, follow or all are not required as it is the default behavior of indexing spiders.

<meta name="robots" content="index, follow">
<meta name="robots" content="all">

index
Robots are welcome to include this page in search services.

<meta name="robots" content="index">

follow
Robots are welcome to follow links from this page to find other pages.

<meta name="robots" content="follow">

If this meta tag is missing, or if there is no content, or the robot terms are not specified, then the robot terms will be assumed to be "index, follow" (e.g. "all"). If the keyword all is found in the robots terms list it overrides all other values. That is, a robots terms that is "nofollow, all, noindex, nofollow", would effectively be "all".

If the robots terms contains contradictory information (e.g. "follow, nofollow, follow") then the robot is free to do whatever it wishes with regard to the behavior being addressed (in this case the follow behavior).

Back to Previous

Common Usage for the Robots META Tag

The Robots META Tag is used for excluding content. We've included three (03) examples below of using the robots meta tag correctly to exclude information from search engine indexes and services.

1. A robots term of noindex allows the links on that page to be followed, even though the page is not to be indexed.

   <meta name="robots" content="noindex">

2. A robots term of nofollow allows the page to be indexed, but no links from the page are followed.

   <meta name="robots" content="nofollow">

3. A robots terms of noindex, nofollow neither the page or the links on that page will be followed or indexed.

   <meta name="robots" content="noindex, nofollow">

a very clean, simple and functional plugin, thanks for this

How is this different from;

http://community.elgg.org/pg/plugins/jonathanrico/read/25046/meta-tags

@imcobarn it will add the metatags to all of your pages

@edlove that plugin only adds the keywords metatag and they are generated based on the content of the page. My plugin provides a means to enter static metatags that will appear on all pages of your site. These plugins are complementary.

@jeroen

What should i put in robot, Drhup gave an example above dut did not help much. can you give me a quick example .

Thanks

@Jeroen Thank you complementary was what I was looking for.

*same set of defined metatags for *all pages.

try this one + rico's plugin together

unfortunately ;-( i have not yet fully coded my super-duper seo oriented meta tags keywords generator yet lolz

Hi,

Is it possible to use different keywords/descriptions on each page with this plugin? I realise it is possible to use this plugin with other plugins as mentioned in an earlier post.  However,I am concerned about having multiple metatags for Keywords and Description on my pages as I believe this can be detramental.

 Thanks

Google don't like same metatags for all pages.

Hi,
Is this pluggin still valid, for version 1.7.1?
I'm looking for a way to stop robots from accessing my site.

Thanks

Answer is robots.txt.

Can someone just writeup a basic help on this please!

@TahoeBilly,

Just from an anti-spam perspective ...

robots.txt is a file that tells robots what to do. Rather, it "asks" them; it cannot keep out bad bots.

Here is my robots.txt:

User-agent: *
Disallow: /pg/register/
Disallow: /pg/admin/
Disallow: /account/forgotten_password.php

All that will do is prevent the good bots (Google, Yahoo, WindowsLive, Ask.com, etc.) from indexing those pages. It will not prevent the bad bots from accessing them.

Then, why bother? ... I've seen a few searches on  my site for phrases like "inurl register" which means someone/something is using an ordinary search engine to find my pages that have the word "register" in the URL. No real user would do such a search. So, I thought to make it a little less convenient for whoever/whatever is using that technique to find my site.

It's only one small part of a partial solution to the spamdexing problem, but it can't hurt.

I guess there are other (non-spam-fighting) reasons that people might not want Google to index certain pages. Maybe User Profiles that contain some identifying information about your members?

So, should type robots.txt into robots box in plugin administration? As i understand i should sreate also robot.txt file and send it to main directory? Anyone could explain that as i see many people here has doubts how to use this module...Thanks.

Hello?

robots.txt

http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

robots metatag

http://www.google.com/support/webmasters/bin/answer.py?answer=93710

Is there any update for 1.8？

@yingfan no there currently is no 1.8 version available