Robots.txt Free Download

Version: 2.0   (version history)
Date: September 19, 2005

Free To Try

OS: Win 98/ME/NT/2000/XP
Rating: Not rated
Popularity: Popularity 0/10
Author: NetPromoter

Download Sites:

Robots.txt Description

Robots.txt Free Download.

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.

The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.

By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

Robots.txt keywords:

More Downloads

  • RobotPack

    Robot-exclusion manager tool to inform robots and other to not index parts of your web site. It provides FTP access to your website so you can easily select the files and directories which shouldn't be indexed by search engines. It create robots.txt

  • Advanced Robots.txt Generator

    Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. The software supports 300 robots, works in a WYSWIWYG visual way and comes with full documentation and support.

  • Robot-Manager

    Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Easy to use

  • RoboTest

    RoboTest: Scheduled testing of your connection and information server performance. It's easy to use - select the type of test (ping, HTTP, POP3, SMTP) and the schedule you want. RoboTest provides success/failure percentages and response times.

  • StatsNow

    StatsNow is the ultimate live statistics program giving you a real time view of your visitors currently on your Web site(s), what pages they have visited, who referred them and a whole lot more!