MCP server to discover and analyze websites that implement the llms.txt standard.
mcp-llms-txt-explorer is easy to set up with trust notes worth reviewing. Check agent compatibility and use-case fit before adding it to your workflow.
Repository setup guidance
gh repo view thedaviddias/mcp-llms-txt-explorer --webOpen the official README and confirm the supported install method.
Add the server entry to your MCP client config.
Restart your agent and verify that the server tools appear.
This tool helps you find websites that have a special file called llms.txt, which gives AI models structured information about the site. You can check any website for this file and see a list of known compliant sites.
A Model Context Protocol (MCP) server for exploring websites with llms.txt files. It provides resources to check websites for llms.txt and llms-full.txt files, parse and validate their contents, and access structured data about compliant websites. The server includes two main tools: check_website to verify if a domain has llms.txt files, and list_websites to retrieve known websites with llms.txt support, with optional filtering by file type. Built with TypeScript and the MCP SDK, it is designed for integration with AI assistants like Claude Desktop.
Looks usable, but maintenance, license, or security notes deserve a closer look.
Last commit was about 193 days ago.
74 GitHub stars indicate community interest.
4 open issues signal maintenance load.
NOASSERTION license detected.
Discover websites that provide structured data for AI models via llms.txt
Validate if a website supports the llms.txt standard
Build a directory of llms.txt-compliant websites
Integrate with AI assistants to fetch structured website information
The server fetches external URLs; ensure network access is controlled.
No authentication or encryption is provided; use in trusted environments only.
74
Stars
14
Forks
4
Issues
NOASSERTION
License
Connect Google Search Console to AI assistants for natural language SEO analysis.
Open-source GEO audit engine to optimize websites for AI search visibility and citability.
Turn OpenAPI, MCP, Doxygen, godoc, rustdoc, and Markdown into static documentation sites you own.
MCP server to discover and analyze websites that implement the llms.txt standard.
AI/ML developers building context-aware assistants, Web developers implementing llms.txt standards, SEO specialists optimizing for AI crawlers
The setup section provides repository-level starting guidance, not a guarantee of an independently verified installation. Check the official README and release notes.
The server fetches external URLs; ensure network access is controlled. No authentication or encryption is provided; use in trusted environments only.
Similar or complementary options to evaluate include mcp-gsc, geo-optimizer-skill, sourcey.
Jun 7, 2026
2 security/trust notes recorded.
Setup difficulty is 2/5.