Robots.txtRobots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the Robots.txt files, required to instruct search engine spiders, whiPlatforms: Windows 95/98/ME/NT/2000/XP/2003 Size: 2.80 M Cost: $99
Descriptions Robots.txt: Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with
|
| Hot Software |
| Parallels Desktop for Mac - Parallels Desktop for Mac |
| e-Campaign - e-Campaign enables you to design rich HTML emails/newletters/ezines easily, and deliver personalized HTML emails to mail lists. |
| Code 128 Barcode Font Advantage Package - IDAutomation Code 128 Barcode Fonts supporting Code-128, UCC-128, EAN-128, USS-128, SSCC-18, SCC-14... |
| MICR E13B Font Advantage Package - MICR E13B Fonts - TrueType, PostScript & PCL |
| Complete Barcode, MICR and OCR Font Advantage Package - A Complete Barcode, MICR and OCR Font Advantage Package includes all of our fonts and tools for one price |
| .NET Barcode Forms Control & DLL - .NET Barcode Windows Forms Controls for Dotnet, C# & VB.NET |
| Brave Dwarves 2 Gold - Charming challenge for two brave dwarves! This quest is even more difficult! |
| iOpus Internet Macros *Scripting Edition* - iOpus Internet Macros Scripting Edition |
| WinTasks Professional - WinTasks 4 Professional- Tweak Your System |
| WinBackup - Secure your data by making regular backups |