# All robots will spider the domain User-agent: * Disallow: # Disallow Bilbo/1.2+WAP User-agent: Bilbo/1.2+WAP Disallow: / # Disallow directory /flash/ User-agent: * Disallow: /flash/ # Disallow directory /picts/ User-agent: * Disallow: /picts/