Llms.txt - Revision history

Dan Tobias at 18:20, 4 March 2026

2026-03-04T18:20:22Z

Dan Tobias at 18:19, 4 March 2026

2026-03-04T18:19:47Z

Dan Tobias at 18:17, 4 March 2026

2026-03-04T18:17:22Z

Jsummers at 00:21, 4 March 2026

2026-03-04T00:21:43Z

Ross-spencer: Add initial entry of llms.txt

2026-03-02T19:06:41Z

Add initial entry of llms.txt

New page

{{FormatInfo
|formattype=electronic
|subcat=Web
|extensions={{ext|txt}}
|wikidata={{wikidata|Q80776}}
}}

'''llms.txt''' is a proposed document standard by [https://jeremy.fast.ai/ Jeremy Howard] for enabling LLMs to make use of a website at inference time.

'''llms.txt''' is based on Markdown meaning it is human and machine readable. It adopts a precise structure enabling "fixed processing methods".

== Proposed structure ==

The structure is proposed as follows:

* An H1 with the name of the project or site. This is the only required section
* A blockquote with a short summary of the project, containing key information necessary for understanding the rest of the file
* Zero or more markdown sections (e.g. paragraphs, lists, etc) of any type except headings, containing more detailed information about the project and how to interpret the provided files
* Zero or more markdown sections delimited by H2 headers, containing “file lists” of URLs where further detail is available
:* Each “file list” is a markdown list, containing a required markdown hyperlink [name](url), then optionally a : and notes about the file.

== Example ==

An example might look as follows (from the documentation):

<pre>
# Title

> Optional description goes here

Optional details go here

## Section name

- [Link title](https://link_url): Optional link details

## Optional

- [Link title](https://link_url)
</pre>

== References ==

* [https://llmstxt.org/ llms.txt homepage]

← Older revision		Revision as of 18:20, 4 March 2026
Line 52:		Line 52:
	[[Category:AI and Machine Learning]]		[[Category:AI and Machine Learning]]
	[[Category:File formats with a distinctive filename]]		[[Category:File formats with a distinctive filename]]
−	~~[[Category:Web]]~~

@@ Line 4: / Line 4: @@
 |extensions={{ext|txt}}
 |wikidata={{wikidata|Q133958690}}
 }}
 {{DISPLAYTITLE:llms.txt}}
@@ Line 13: / Line 14: @@
 == Usage ==
-The file is intended to be placed at the root of a website, similarly to other standard site-informational files such as [[robots.txt]]. Optionally it may also be placed in subdirectories for information specific to that directory.
+The file is intended to be placed at the root of a website, similarly to other standard site-informational files such as [[Robots Exclusion Standard|robots.txt]]. Optionally it may also be placed in subdirectories for information specific to that directory.
 == Proposed structure ==

@@ Line 5: / Line 5: @@
 |wikidata={{wikidata|Q133958690}}
 }}
 '''llms.txt''' is a proposed document standard by [https://jeremy.fast.ai/ Jeremy Howard] for enabling LLMs to make use of a website at inference time.
 '''llms.txt''' is based on [[Markdown]] meaning it is human and machine readable. It adopts a precise structure enabling "fixed processing methods".
 == Proposed structure ==
@@ Line 45: / Line 50: @@
 [[Category:AI and Machine Learning]]

@@ Line 3: / Line 3: @@
 |subcat=Web
 |extensions={{ext|txt}}
-|wikidata={{wikidata|Q80776}}
+|wikidata={{wikidata|Q133958690}}
 }}
 '''llms.txt''' is a proposed document standard by [https://jeremy.fast.ai/ Jeremy Howard] for enabling LLMs to make use of a website at inference time.
-'''llms.txt''' is based on Markdown meaning it is human and machine readable. It adopts a precise structure enabling "fixed processing methods".
+'''llms.txt''' is based on [[Markdown]] meaning it is human and machine readable. It adopts a precise structure enabling "fixed processing methods".
 == Proposed structure ==
@@ Line 43: / Line 43: @@
 * [https://llmstxt.org/ llms.txt homepage]