User-Agent: * Allow: / Allow: /customers/ Allow: /pricing Allow: /product/ Disallow: /app/ Disallow: /admin/ Disallow: /api/