User-agent: * Allow: /llms.txt Allow: /agents.txt Allow: / Disallow: /api/v1/assets/*/download