User-agent: * Disallow: /linkcheck.php Disallow: /list/
User-agent: * Disallow: /linkcheck.php Disallow: /legal/