# All robots will spider the domain User-agent: * Disallow: # Disallow directory /manager/ User-agent: * Disallow: /manager/ # Disallow directory /assets/ User-agent: * Disallow: /assets/ # Disallow directory /templates/ User-agent: * Disallow: /templates/ # Disallow directory /board/ User-agent: * Disallow: /boards/ # Disallow directory /wiki/ User-agent: * Disallow: /wiki/ # Disallow directory /bb/ User-agent: * Disallow: /bb/