# What is the Agentic Web? The agentic web is the next evolution of the internet — built for AI agents as first-class visitors, not just humans. ## Why it matters By Cloudflare's count, **fewer than half of all HTML page requests now come from a human**. The rest are bots, crawlers, and increasingly, AI agents acting on behalf of users. ## Four pillars 1. **Readable** — Agents can fetch clean, machine-readable content 2. **Discoverable** — Site is findable via sitemaps, llms.txt, and structured metadata 3. **Callable** — Agents can interact via MCP tools instead of scraping HTML 4. **Payable** — Agents can transact via protocols like x402 ## How rukuma.dev implements this - **robots.txt** allows AI bots (GPTBot, ClaudeBot, etc.) - **llms.txt** provides a documentation index - **/mcp** exposes a stateless MCP server - **Markdown** versions of all pages at /md/ - **Vectorize** powers semantic search - **WebMCP** tools injected at the edge ## References - [Building an open Agentic Internet](https://blog.cloudflare.com/the-agentic-internet/) - [Answer Engine Optimization](https://blog.cloudflare.com/aeo/) - [The next generation of MCP](https://blog.cloudflare.com/mcp-v2/)