Ahrefs
SEO Toolby Ahrefs
AhrefsBot
Ahrefs' crawler used for building its backlink index and powering its SEO research tools. AhrefsBot is one of the most comprehensive link crawlers and claims to be the most active non-Google crawler.
Respects robots.txt
Yes
Can be blocked
Yes
Crawl-Delay support
No
Type
SEO Tool
Purpose
Backlink analysis and site auditing for Ahrefs platform
SEO Impact
High volume crawler that can impact server performance. Blocking it prevents your site from appearing in Ahrefs' backlink reports, which affects how competitors analyze your site.
User-Agent String
AhrefsBot/7.0
robots.txt Control
Add "User-agent: AhrefsBot" with "Disallow: /" in robots.txt.
Block
User-agent: AhrefsBot Disallow: /
Allow (default)
User-agent: AhrefsBot Allow: /
Official Documentation
Test your robots.txt against AhrefsBot
Check which paths are blocked or allowed for each user-agent