User-agent: * Disallow: /assets/generated-pdfs/* Disallow: /*/downloadpdf Disallow: /admin Disallow: /*/allchanges Disallow: /*/changes