User-Agent: * Disallow: Disallow: /test/ Disallow: /admin/ Disallow: /assets/*