%general-entities; ]> WWW::RobotRules WWW::RobotRules parses robots.txt files, creating a WWW::RobotRules object with methods to check if access to a given URL is prohibited. &lfs83_checked; Package Information Download (HTTP): Download MD5 sum: &my-md5sum; WWW::RobotRules Dependencies Required (runtime) (install this module first and install that later)