User-agent: Mediapartners-Google* 
User-Agent: Yahoo! Slurp
Allow: /public*/