• info[@]magicseosolutions[dot]com
  • Sign In
  • Sign Up
  • Robots.txt Generator


    Default - All Robots are:  
        
    Crawl-Delay:
        
    Sitemap: (leave blank if you don't have) 
         
    Search Robots: Google
      Google Image
      Google Mobile
      MSN Search
      Yahoo
      Yahoo MM
      Yahoo Blogs
      Ask/Teoma
      GigaBlast
      DMOZ Checker
      Nutch
      Alexa/Wayback
      Baidu
      Naver
      MSN PicSearch
       
    Restricted Directories: The path is relative to root and must contain a trailing slash "/"
     
     
     
     
     
     
       



    Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


    About Robots.txt Generator

    Robots.txt Generator Tool, a tool that would clearly demonstrate extremely helpful to webmasters in making their sites Googlebot friendly. Basically, what this free tool does is to create the robot.txt document.

    Our Robots.txt Generator Tool has made the lives of webmasters simple by completing a muddled undertaking individually and with only a couple of snaps of the mouse, this tool will produce a Googlebot friendly robots.txt document.

    This tool has an easy to understand interface, and you have the choice to choose which things ought to be incorporated into the robots.txt document and which not. Here's the way you can make utilization of this SEO tool:

    • Choose whether you want all robots or just some robots to have access to your site's files. All robots are allowed by default.
    • Choose how much delay there should be in the crawls. You can select your preferred option from 5 seconds to 120 seconds. By default, we have set it 'no delay'.
    • If you have your site's sitemap, then paste it here. Otherwise, you can proceed.
    • Select which bots can crawl your web and choose any bot which you don't want to crawl your site's files.
    • The last step is to restrict directories. The path is relative to root and must contain a trailing slash "/".
    • After you have generated Googlebot friendly robots.txt file using our Robots.txt Generator Tool, it's the time to upload it to the root directory of your site.

    Utilizing MagicSeoSolutions Robots.txt generator, webmasters can educate any robots which records or documents in your website's root list ought to be slithered crawled by the Googlebot. You can even pick which specific robot you need passage to your site's record and limit diverse robots from doing in like manner. You can likewise teach what robot ought to gain admittance to records your site's root index and which robot ought to gain admittance to another document.

    Robots.txt is a marvelous tool for site proprietors, and it will make their lives considerably simpler than previously.

     

    Try these new tools: