You are here: Technology, Web & Business Forum
: Web Development
: Search Engines & Directories
:
robots.txt
|
Welcome to the Technology, Web & Business Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact contact us. |
| Search Engines & Directories Discuss topics about Search Engines and website directories
|
 |
|
|
LinkBack | Thread Tools | Display Modes |
01-23-2012
|
|||
|
|||
robots.txt
robots.txt is a very important part of seo, by this file we can stop crawlers to crawl any important pages of the website which is we don't want that crawler see them.
|
|
03-23-2012
|
|||
|
|||
|
Ya of course, this file is important for website because we tell google crawler that which file do crawl and which don't through this file.
|
|
4 Weeks Ago
|
|||
|
|||
|
Robots.txt is a notepad file which is very important for our website because it is stop the crawler to crawl a particular page of the website .
|
|
4 Weeks Ago
|
|||
|
|||
|
Robots.txt is a notepad file which is very important for our website because it is stop the crawler to crawl a particular page of the website .
|
Linear Mode
