Crawlr

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Crawlr is ranked #100 of 245 in SEO tools on Inferse. It runs on API, Web. There is a free plan. Paid plans start at $8/mo.

Compared on SEO tools

Free plan: Yescrawlr.ai
Paid from: $8/mocrawlr.ai
Crawl limit: 5,000 URLs/crawlcrawlr.ai
JavaScript rendering: Yescrawlr.ai
Scheduled crawls: Yescrawlr.ai
API access: Yescrawlr.ai

Facts

Free plan: Yescrawlr.ai · 20 Sept 2026
Paid from: 8crawlr.ai · 20 Sept 2026
API access: Yescrawlr.ai · 20 Sept 2026
Product: Crawlr is a website crawler and technical SEO audit tool that identifies technical SEO issues, crawl inefficiencies, and site architecture problems.crawlr.ai · 28 Sept 2026
URL discovery: The crawler discovers URLs through internal links, sitemaps, canonicals, and JavaScript.crawlr.ai · 28 Sept 2026
Crawl controls: Crawl settings include robots.txt compliance, rate limiting, include and exclude rules, and crawl depth controls.crawlr.ai · 28 Sept 2026
SEO analysis: The tool analyzes response codes, indexability signals, metadata, headings, word counts, and internal and external links.crawlr.ai · 28 Sept 2026
Visualizations: Crawlr offers interactive graphs, directory trees, 3D site exploration, and content cluster visualizations.crawlr.ai · 28 Sept 2026
Scheduled crawls: Scheduled crawls can run daily, weekly, or on custom schedules, with email notifications when they complete.crawlr.ai · 28 Sept 2026
API: The API supports starting crawls, checking status, retrieving structured JSON results, accessing historical data, and webhook events.crawlr.ai · 28 Sept 2026
Integrations: The pricing page lists Google PageSpeed Insights for the Starter plan and webhook notifications (Beta) for Growth.crawlr.ai · 28 Sept 2026
Exports: The Free plan includes CSV and JSON exports; paid plans add LLM-ready markdown exports and higher-tier bulk export capabilities.crawlr.ai · 28 Sept 2026
Security: The API uses API key authentication, and the documentation advises keeping keys out of client-side code, public repositories, and logs.crawlr.ai · 28 Sept 2026
Support: The pricing comparison lists priority support and dedicated support as plan features.crawlr.ai · 28 Sept 2026
Intended users: The pricing page describes Starter as suited to single domains and portfolios, Standard to growing teams and agencies, and Growth to high-volume AI and SEO pipelines.crawlr.ai · 28 Sept 2026
Sandbox limit: The API documentation says unauthenticated sandbox crawls are rate limited and have a maximum of 25 pages.crawlr.ai · 28 Sept 2026