Skip to content
uxTools
Developer

Meta Robots Tag Generator

Build a robots meta tag and matching X-Robots-Tag header from simple toggles. Configure indexing, link following, snippet and preview limits, then copy the output straight into your <head> or server config.

Meta tag
<meta name="robots" content="index, follow">
HTTP header
X-Robots-Tag: index, follow
Directive string
index, follow
Presets

Indexing

Search results
Links

Restrictions

Preview limits

max-snippetcharacters; -1 = no limit, 0 = none
max-image-preview
max-video-previewseconds; -1 = no limit, 0 = none
unavailable_afterstop showing in results after this date

About this tool

The robots meta tag and the X-Robots-Tag HTTP header tell search engine crawlers how to index and present a page. The default behaviour is index, follow, so an untouched form emits that baseline. Use the meta tag in your HTML <head> for individual pages, or the header in your server config to cover non-HTML resources like PDFs and images.