Robots META Tag Explained
Posted by admin | Under SEO Thursday Apr 14, 2011The Robots META tag is a simple mechanism to indicate to visiting Robots (Search Engines/Crawlers) if a page should be indexed, or the links on the page should be followed. The meta tags are placed in the <HEAD> section of an HTML page.
<html>
<head>
<title>Web Page Title</title>
<meta name=”robots” content=”index,follow”>
</head>
Robots Meta Tag Syntax
The META tag contents parameter contains one or more directives separated by commas. The currently defined directives are “[no]index” and “[no]follow}. The “index” directive specifies whether the robot should index the page. The “follow” directive specifies whether the robot should follow links on the page. The defaults are “index” and “follow”. The values “all” and “none” set all directives on or off: “all=index,follow” and “none=noindex,nofollow”. The META tag (as with all HTML tags) is case-insensitive.
Examples:
<meta name=”robots” content=”index,follow”>
<meta name=”robots” content=”noindex,follow”>
<meta name=”robots” content=”all index,follow”>
<meta name=”robots” content=”all noindex,nofollow”>
Syntax:
<meta name=”robots” content=”all | none | {directives}”>
where
{directives} = {directive} ["," {directives}]
{directive} = {index} | {follow}
{index} = index | noindex
{follow} = follow | nofollow
