MCP server to discover and analyze websites that implement the llms.txt standard.
mcp-llms-txt-explorer is easy to set up with trust notes worth reviewing. Check agent compatibility and use-case fit before adding it to your workflow.
gh repo view thedaviddias/mcp-llms-txt-explorer --webOpen the official README and confirm the supported install method.
Add the server entry to your MCP client config.
Restart your agent and verify that the server tools appear.
This tool helps you find websites that have a special file called llms.txt, which gives AI models structured information about the site. You can check any website for this file and see a list of known compliant sites.
A Model Context Protocol (MCP) server for exploring websites with llms.txt files. It provides resources to check websites for llms.txt and llms-full.txt files, parse and validate their contents, and access structured data about compliant websites. The server includes two main tools: check_website to verify if a domain has llms.txt files, and list_websites to retrieve known websites with llms.txt support, with optional filtering by file type. Built with TypeScript and the MCP SDK, it is designed for integration with AI assistants like Claude Desktop.
Looks usable, but maintenance, license, or security notes deserve a closer look.
Last commit was about 143 days ago.
74 GitHub stars indicate community interest.
4 open issues signal maintenance load.
NOASSERTION license detected.
Discover websites that provide structured data for AI models via llms.txt
Validate if a website supports the llms.txt standard
Build a directory of llms.txt-compliant websites
Integrate with AI assistants to fetch structured website information
The server fetches external URLs; ensure network access is controlled.
No authentication or encryption is provided; use in trusted environments only.
74
Stars
14
Forks
4
Issues
NOASSERTION
License
Connect Google Search Console to AI assistants for natural language SEO analysis.
Open-source GEO audit engine to optimize websites for AI search visibility and citability.
Turn OpenAPI, MCP, Doxygen, godoc, rustdoc, and Markdown into static documentation sites you own.
2 security/trust notes recorded.
Setup difficulty is 2/5.