Website Crawler

Input—per 1M tokens
Output—per 1M tokens
Context—tokens
WeightsClosed

About

Website Crawler is ranked #67 of 241 in SEO tools on Inferse. It runs on API, Web. There is a free plan. Paid plans start at $10/mo.

Compared on SEO tools

Free plan
Yeswebsitecrawler.org
Paid from
$20/mowebsitecrawler.org
Scheduled audits
Yeswebsitecrawler.org
JavaScript crawling
Yeswebsitecrawler.org
On-page audits
Yeswebsitecrawler.org
Search visibility audits
Yeswebsitecrawler.org
API access
Yeswebsitecrawler.org

Facts

Free plan
Yeswebsitecrawler.org · 21 Sept 2026
Paid from
20websitecrawler.org · 21 Sept 2026
API access
Yeswebsitecrawler.org · 21 Sept 2026
Product
Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues.websitecrawler.org · 29 Sept 2026
SEO audits
The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems.websitecrawler.org · 29 Sept 2026
JavaScript crawling
It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only.websitecrawler.org · 29 Sept 2026
Custom extraction
Users can configure extraction with CSS or XPath selectors and JavaScript snippets.websitecrawler.org · 29 Sept 2026
Exports and API
Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data.websitecrawler.org · 29 Sept 2026
Integrations
The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel.websitecrawler.org · 29 Sept 2026
Monitoring
The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute.websitecrawler.org · 29 Sept 2026
Security and privacy
The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted.websitecrawler.org · 29 Sept 2026
Crawl scope limit
The service works with publicly available information on HTML pages and does not automatically fill in or submit forms.websitecrawler.org · 29 Sept 2026
Free-plan limits
The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings.websitecrawler.org · 29 Sept 2026
Support
The maker says it provides email support on weekdays and weekends and replies within two to three hours.websitecrawler.org · 29 Sept 2026
Intended users
The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects.websitecrawler.org · 29 Sept 2026

Best Website Crawler alternatives

See all 12

Where it ranks on Inferse

Sources