FREE Registration is required
Overview:
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which are parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; keep spiders out of sensitive and private areas of your Web site; track spider visits and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with.
(Is this item miscategorized? Does it need more tags? Let us know.)
| Format: | Software | Size: | 2,869 KB |
| Date: | Aug 2005 | Version: | 2.0 |
| License: | Free to try | Price: | $99.90 |
| Platform: | Windows | ||
| System Req: | Windows 98/Me/NT/2000/XP/2003 Server |
People who downloaded this item also downloaded
Top results from Web Development Software
 |
Intranet DASHBOARD 2.2.2 (Windows) |
|
A4DeskPro Flash Web Site Builder 2.11 (Windows) |
|
Site Translator 3.44 (Windows) |
|
ActionBars 1.6 (Mac) |
|
Akimbo Globetrotter 1.1.1 (Mac) |
White Papers, Webcasts, and Resources
- Live Webcast: Older PCs Costing You More Than You Think: The Financial Rewards of PC Refresh IntelYour older PCs cost you more than you think. Learn how refreshing them now can increase productivity and security, plus drive down PC management costs.
- Microsoft Online Services Business Value MicrosoftGain access to rich communication, collaboration, and productivity applications from anywhere with subscription-based Microsoft Online Services.
- Customer Case Study: A L Filters Dell EqualLogicLearn how your organization can take full advantage of the high-availability features included with Windows Server 2008 R2 Hyper-V.
Premier Vendor Content Whitepapers, webcasts & resources from our Power Center Sponsors
- Keep Up With The Latest In Document Management with The DocuMentor.
-
Doc delivers the scoop on today's enterprise content management, printer maintenance, and all other issues related to document management. It's the DocuMentor Blog.
- Learn more >>
- Reduce risk. Reduce complexity. Increase reliability.
-
A simplified IT environment isn't just less complex. It's also more reliable. Standardize on a single Linux platform with SUSE Linux Enterprise from Novell, and get the world's most interoperable Linux
- Learn more >>
- The best support in the Linux business
-
If Linux is going to power your mission-critical applications, you'd better have the best support known to business. Novell was rated the top provider of Linux technical support.
- Learn more >>
- Learn more about tools to grow your business
-
The Business Essentials Guide provides you useful tools and templates to help grow your business and save you time with automated shipping solutions.
- Save time with the UPS Business Essentials Guide
-
-
Smart Tech
Expert advice on innovations in healthcare and the green technologies that make it happen.
Find out more
-
Smart Business
Discussion and advice on management issues that revolve around making your world smarter and more useful.
More Smart Advice
-
Smart People
The best and worst moves in the management and strategy trenches.
Learn More
