Media
2 items
Description
Crawls a site and exports each page as Markdown using Cloudflare Markdown for Agents. Site crawler and export asSite Crawler to Markdown v1.0 Site Crawler to Markdown v1.0 is a Chrome extension that converts web content into structured Markdown files using Cloudflare’s Page-to-Markdown capability. It allows users to crawl entire websites or export individual pages, turning scattered web content into clean, organized .md archives ready for documentation, AI workflows, or offline reference. Designed with performance in mind, the extension avoids heavy browser memory usage by processing large sites in controlled batches. Even websites with thousands of pages can be exported smoothly thanks to built-in pause and resume controls and automatic segmented downloads. 🔑 Key Features Full-Site Markdown Crawling Crawls all accessible pages within a site. Converts pages into Markdown format aligned with Cloudflare standards. Outputs multiple .md files within a structured folder. Batch Processing for Large Websites Downloads content in 100-page batches. Prevents memory overload during large crawls. Automatically continues with the next batch after each download. Pause and Resume Downloads Pause long crawling sessions anytime. Resume from the last completed page without restarting. Custom Markdown Download Location Users can define where files are saved locally. Keeps exported content organized by project or site. Single-Page Markdown Export One-click option to convert only the current page. Useful for quick captures without launching a full crawl. Structured File Output Clean naming and organized folder structure. Easier navigation and reuse of exported content. Version: v1.0 Initial release focused on scalable crawling, batch downloads, and Markdown export stability.