https://bigpen.vn/ Β· Developer Tools
1 item
Bypass WAFs to securely crawl websites, check broken links (404, 301), and analyze meta data natively. SEO Crawler & Broken Link Checker A powerful, browser-native SEO spider designed to bypass WAFs and anti-bot protections (like Cloudflare, Shopify, Haravan, Sapo) by utilizing actual browser network stacks. Core Features: π·οΈ Native Crawling: Never get blocked by fake 404s or bot detection again. π Broken Link Checker: Instantly find 404 dead links and 301/302 redirects. π Metadata Extraction: Scrape Title and Meta Descriptions of all internal pages. πΊοΈ Sitemap Orphans: Discover pages in your sitemap that have no internal links pointing to them. π‘οΈ Smart Anti-bot Backoff: Automatically scales request delay if 429 Too Many Requests or 403 blocks are encountered. π Instant CSV Export: Export your crawler data directly to CSV.
rating_count is the Chrome Web Store ratings count, not a written-review count.