17 Nov
How-to · 3 min
How to scrape a page that loads its content with JavaScript
Your scraper fetches a product or docs page and gets back an empty shell, because the prices, specs or text only appear after JavaScript runs in a…
2 · newest first
17 Nov
How-to · 3 min
Your scraper fetches a product or docs page and gets back an empty shell, because the prices, specs or text only appear after JavaScript runs in a…
3 Nov
How-to · 2 min
Developers feeding web content into AI models need to clean messy page HTML into concise markdown without wasting prompt token limits.
5
No. You connect over Streamable HTTP and send your API key as a Bearer header.
There is no OAuth. · Quoted from spicrawl.com
No. It does not follow links or discover pages, so you send it the exact URLs you want.
No crawling. Spicrawl does not follow links or find pages. Give the agent the URLs. · Quoted from spicrawl.com
When monthly credits run out, requests fail with a 402 status code. The error response tells you your account's next monthly credit reset date.
When your credits run out, requests fail with a 402 error that tells you the reset date. · Quoted from spicrawl.com
Spicrawl can return web page content as Markdown, JSON, HTML, text, PDF, or screenshots. You specify your desired format in the request payload.
One API for Markdown, JSON, HTML, text, PDF and screenshots. · Quoted from spicrawl.com
No, Spicrawl does not use OAuth for MCP server connections. You authenticate by passing your API key as a Bearer token header.
OAuth: none (API key only) · Quoted from spicrawl.com