anc.dev the agent-native standard
Install ▸

Fix: /robots.txt present

Web-audit fix skill for the robots check (Discoverability, SHOULD).

Goal

Publish robots.txt and state your crawl policy explicitly.

Fix

Publish a robots.txt. Declare your crawl and AI-usage policy explicitly rather than leaving it to inference. An absent robots.txt is ambiguous; a present one is a clear signal.

Resources

Copy-paste prompt

Paste this into your coding agent, replacing the Issue line with the Result line from your audit:

Verify

Re-run the audit at https://anc.dev/web-audit or call the audit_website MCP tool; the robots check should report pass.