Perple
AI / LLMby Perplexity AI
PerplexityBot
Perplexity AI's crawler that indexes content for use in its AI-powered search engine. Content crawled by PerplexityBot may appear as cited sources in Perplexity answers.
Respects robots.txt
Yes
Can be blocked
Yes
Crawl-Delay support
No
Type
AI / LLM
Purpose
Indexing and retrieval for Perplexity AI search answers
SEO Impact
Allowing PerplexityBot increases the likelihood your content appears as a cited source in Perplexity Search answers. Perplexity is one of the fastest-growing AI search engines.
User-Agent String
PerplexityBot/1.0
robots.txt Control
Add "User-agent: PerplexityBot" with "Disallow: /" in robots.txt.
Block
User-agent: PerplexityBot Disallow: /
Allow (default)
User-agent: PerplexityBot Allow: /
Official Documentation
Test your robots.txt against PerplexityBot
Check which paths are blocked or allowed for each user-agent