User-agent: * Disallow: /online/ Disallow: /webalizer/ Disallow: /ASPSecured/ Disallow: /aspnet_client/ Disallow: /cp/ Disallow: /new/ User-agent: linksmanager Disallow: / User-agent: larbin Disallow: / User-agent: ia_archiver Disallow: / User-agent: ia_archiver/1.6 Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp-trivial/1.38 Disallow: / User-agent: lwp-trivial/1.41 Disallow: / User-agent: lwp Disallow: /