HostNamaste Web Hosting Services

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


HostNamaste Web Hosting Services

About Robots.txt Generator

Robot.txt is a document that is kept in the website’s root folder to enable search engines to effectively index the website efficiently. Prominent search engines make use of robots, and web crawlers to review the website content. The tool Robots.txt Generator creates the robot file easily, and it is free to use.




    50+ Best Free SEO Tools for Lifetime

   Â  1: Alexa Rank Checker

   Â  2: Article Rewriter

   Â  3: Backlink Checker

   Â  4: Backlink Maker

   Â  5: Blacklist Lookup

   Â  6: Broken Links Finder

   Â  7: Bulk GEO IP Locator

   Â  8: Class C Ip Checker

   Â  9: Code to Text Ratio Checker

   Â  10: Color Picker

   Â  11: Domain Age Checker

   Â  12: Bulk Domain Authority Checker (DA)

   Â  13: Domain Hosting Checker

   Â  14: Domain into IP

   Â  15: Email Privacy

   Â  16: Find DNS Records

   Â  17: Get Source Code of Webpage

   Â  18: Google Cache Checker

   Â  19: Google Index Checker

   Â  20: Google Malware Checker

   Â  21: Htaccess Redirect Generator

   Â  22: Keyword Density Checker

   Â  23: Keyword Position Checker

   Â  24: Keywords Suggestion Tool

   Â  25: Link Analyzer

   Â  26: Link Price Calculator

   Â  27: Meta Tag Generator

   Â  28: Meta Tags Analyzer

   Â  29: Mozrank Checker

   Â  30: What is My IP Address?

   Â  31: Online Md5 Generator

   Â  32: Online Ping Website Tool

   Â  33: Bulk Page Authority Checker (PA)

   Â  34: Page Size Checker

   Â  35: Page Speed Checker

   Â  36: Google Pagespeed Insights Checker

   Â  37: Plagiarism Checker

   Â  38: Reverse IP Domain Checker

   Â  39: RGB to Hex

   Â  40: Robots.txt Generator

   Â  41: Search Engine Spider Simulator

   Â  42: Server Status Checker

   Â  43: Suspicious Domain Checker

   Â  44: Online URL Encoder / Decoder

   Â  45: URL Rewriting Tool

   Â  46: Webpage Screen Resolution Simulator

   Â  47: Website Links Count Checker

   Â  48: Website Screenshot Generator

   Â  49: What is my Browser

   Â  50: Whois Checker

   Â  51: Word Counter

   Â  52: WWW Redirect Checker

   Â  53: XML Sitemap Generator


YourLastHost Web Hosting Services

YourLastHost Web Hosting Services