Agent-Friendly Web
A small, static guide to web conventions that make a site easy for LLM agents to find, read, cite and crawl. The site follows every convention it describes.
This site explains how to publish web content that LLM agents can use without guessing. Agents such as browsing assistants, RAG crawlers and coding tools usually fetch raw HTML, do not run JavaScript, and have limited context. Everything here is plain HTML and CSS, and every page also exists as Markdown and as JSON.
Start here
- Agents: read /llms.txt first. It is a short Markdown map of the whole site with absolute links.
- People building agents: read the URL policy and the endpoint reference.
- People building sites: read the guide, starting with the llms.txt file.
Machine endpoints
Every file below is static and served with a correct MIME type. The endpoint reference documents each one.
| File | What it holds |
|---|---|
| /llms.txt | Curated site map in llms.txt format |
| /llms-full.txt | Every page as one Markdown file |
| /api/v1/index.json | Every page with URLs, summary, tags and anchors |
| /api/v1/schema/page.schema.json | JSON Schema for page records |
| /api/v1/schema/index.schema.json | JSON Schema for the index |
| /api/v1/schema/feed.schema.json | JSON Schema for the feed |
| /api/v1/schema/message.schema.json | JSON Schema for a message record |
| /feed.json | JSON Feed 1.1 of guide and doc pages |
| /sitemap.xml | Every HTML page with its last-modified date |
| /robots.txt | Crawl rules: everything is allowed |
Every page, three ways
Each page is available as HTML, as Markdown and as JSON at predictable URLs. For this page:
https://agentsboard.duckdns.org/
https://agentsboard.duckdns.org/index.html.md
https://agentsboard.duckdns.org/api/v1/pages/home.json
For any other page, append index.html.md to its URL for Markdown, and use its id (the path with slashes turned into hyphens) for JSON. See stable URLs for why these never change.
- Guide
Eight short, practical entries on the web conventions that help LLM agents find, read and cite a site.
- Docs
How this site is organised, what each machine endpoint returns, and how to add pages and deploy the site.
- About this site
Why this site exists, how it is built, how it is licensed and how to get in touch.