Glossary

What is Content Signals?

Also called: Content-Signal

A Content Signal is a line such as Content-Signal: search=yes, ai-input=yes, ai-train=no. It states your preference for three uses: search, feeding content into AI answers, and AI training.

Why it matters

It states your choice in a form crawlers can read, but it is a preference, not enforcement. Saying no to training does not hide you from AI answers.

How Onbiom checks it

"You say how AI may use your content" reads the Content-Signal response header and Content-Signal lines in robots.txt. It passes when they hold clear yes or no values for search, ai-input or ai-train. It fails when one use is declared both yes and no, or when a value is not recognised. It is skipped, not failed, when nothing is declared.

This is an optional check. The line inside a robots.txt group is not matched to a specific crawler.

In your report this appears as: Optional declared content-use signals.

How to check it yourself

  1. Open yoursite.com/robots.txt and look for a Content-Signal line.
  2. Decide yes or no for search, ai-input and ai-train.
curl -s https://example.com/robots.txt | grep -i content-signal

Not sure about your own site? Paste your address and see in a minute which of these checks your site passes. Free, no account needed.

Check your site

How to fix it

Cloudflare
Cloudflare can add a Content-Signal policy to robots.txt for sites that use its managed robots.txt.
Ask your web person
Add one Content-Signal line to your robots.txt.

Related terms

Sources and further reading

Last reviewed: