RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable
PriceUSD0
LicenseFree
File Size1.43 MB
Version1.52 R2
Operating System Windows 95 Windows Windows 98 Windows NT Windows 2000
System RequirementsWindows 95/98/NT/2000