What is an llms.txt file and do you need one?

llms.txt is a plain-text file at the root of your domain that tells AI crawlers which pages on your site matter most, formatted as a quick index for language models.

llms.txt is a plain-text file at the root of your domain that tells AI crawlers which pages on your site matter most, formatted as a quick index for language models.

llms.txt is to AI crawlers what robots.txt is to search crawlers.

It lists your canonical, citable pages in plain text.