# Crawlbase — MCP server on mcp.ai
> Connect your Crawlbase account and use 8 tools for web scraping straight from your AI agent. Connect with your own API key. Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage.

By: mcp.ai · official
Page: https://mcp.ai/crawlbase

## Connect (MCP protocol)
Remote MCP endpoint (HTTP, streamable): https://api.mcp.ai/p_crawlbase?ms=1787291520000
Add it as a custom/remote MCP connector, then authenticate when prompted.

## REST API (no MCP client required)
Every tool is also a REST endpoint, authed with a workspace API key.
Discover: GET https://api.mcp.ai/api/crawlbase/_endpoints   # public; lists every endpoint
Call:     POST https://api.mcp.ai/api/crawlbase/<endpoint>
  Authorization: Bearer sk_live_…   # create one at https://mcp.ai/settings/api-keys
  Content-Type: application/json
  Body: { …args }   →   { "ok": true, "tool": "<id>", "result": { … } }

## Developer docs
How to use (MCP or REST), markdown: https://mcp.ai/crawlbase/skill.md
Postman collection (v2.1): https://mcp.ai/crawlbase/postman.json

## Tools
- crawlbase_crawl_url(url: string, store?: boolean, device?: string, cookies?: string, country?: string, scraper?: string, autoparse?: boolean, user_agent?: string, tor_network?: boolean, output_format?: string, cookie_session?: string, request_headers?: object, custom_success_codes?: integer[]) — Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
- crawlbase_delete_stored_pages(rids: string[]) — Irreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
- crawlbase_generate_user_agents(size?: integer, device?: string) — Generate one to ten realistic randomized User-Agent strings for a selected device class.
- crawlbase_get_crawling_usage(include_previous_month?: boolean) — Return current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
- crawlbase_get_storage_count() — Return the number of pages currently held in Crawlbase Cloud Storage.
- crawlbase_get_stored_page(rid?: string, url?: string) — Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.
- crawlbase_get_stored_pages(rids: string[]) — Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them. Returns decoded page content and identifies requested IDs that were not found.
- crawlbase_list_stored_page_ids(limit?: integer, order?: string, next_cursor?: string) — Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.

## Example prompts
- "What can I do in Crawlbase?"
- "Show me a summary of my Crawlbase account"

## Links
Docs: https://mcp.ai/docs/mcps/crawlbase
Website: https://mcp.ai/mcps/crawlbase