Question 1

How does URL to MD extract only the main content from a page?

Accepted Answer

We use semantic HTML analysis to identify the primary content area of any web page. The tool parses the DOM using Cheerio and searches for common content selectors like

,

, and [role="main"], then strips out navigation, sidebars, footers, ads, and scripts. If no semantic container is found, it falls back to a scoring algorithm that identifies the largest meaningful text block. This means you get clean body content without boilerplate.

Question 2

What markdown format does the output use?

Accepted Answer

Every conversion produces standard CommonMark markdown with a YAML frontmatter block at the top containing the page title, source URL, and scrape date. The HTML-to-markdown conversion is handled by Turndown, which preserves headings, links, images, lists, tables, bold, italic, and code blocks. Inline images retain their original src URLs so you can reference or download them separately.

Question 3

Can I convert pages that require JavaScript to render?

Accepted Answer

The free tier uses a server-side HTTP fetch, which retrieves the initial HTML response before any client-side JavaScript executes. This works well for most content sites, blogs, and documentation. Pages that rely heavily on single-page application frameworks (React, Vue, Angular) to render their content may return incomplete results. For JavaScript-heavy sites, the Pro tier processes pages server-side with rate limiting and retry logic to maximise extraction quality.

Question 4

How does bulk crawling discover URLs on my site?

Accepted Answer

Pro bulk crawling uses a two-stage discovery process. First, it fetches and parses your sitemap.xml (if enabled) to find all listed URLs. Then it crawls pages from your base URL, extracting internal links that match your include pattern while respecting your exclude patterns. Discovered URLs are deduplicated, filtered to your domain, and capped at your configured maximum (up to 500). Each page is then queued and processed with rate limiting to avoid overloading your server.

Question 5

Is my converted content stored, and for how long?

Accepted Answer

Anonymous conversions are not stored at all. They are processed in memory and returned directly to your browser. If you create a free account, your conversions are saved to your personal library for 14 days so you can re-download them from any device. Pro subscribers get permanent storage with no expiry. All stored data is tied to your account and is not accessible to other users.

Convert any URL to clean markdown

Instant Conversion

Smart Extraction

Bulk Crawl (Pro)

Frequently Asked Questions