webclaw
webclaw is a web extraction tool that turns websites into clean markdown or JSON for AI agents and apps, usable from a terminal, MCP, or API.
What it is good for
- Turning a web page into clean text for an AI assistant
- Scraping product or listing data from websites into structured fields
- Crawling a website's pages for research or retrieval pipelines
- Getting content from pages that block simple scrapers
At a glance
- Who it is for
- Setup
- Guided command-line setup
Level 4 of 5. You copy and paste commands into a terminal by following the instructions. Comfortable territory for vibe coders.
- Cost
- Free and open source
- Type
- MCP server or connector
- Tasks
- Works with
- Claude Code, Claude Desktop, Cursor, Windsurf, OpenCode, Codex CLI
Momentum
- Rank this week
- Not ranked yet
- Best rank
- None yet
- GitHub stars
- 2,421
GitHub numbers as of Nov 2, 2026. Updated weekly.
Official links
Setup steps are on the official pages. We do not repeat them here, since they change.
Questions
- Is webclaw free?
- Yes. It is free and open source (AGPL-3.0 license).
- Do I need to know how to code to use webclaw?
- You do not need to write code, but setup means copying and pasting commands into a terminal by following its instructions.
- What does webclaw work with?
- According to its own documentation, it works with Claude Code, Claude Desktop, Cursor, Windsurf, OpenCode, and Codex CLI.
- What is webclaw good for?
- Turning a web page into clean text for an AI assistant, scraping product or listing data from websites into structured fields, crawling a website's pages for research or retrieval pipelines, and getting content from pages that block simple scrapers.
Similar agents
- Firecrawl
Firecrawl is an API that searches the web and pulls clean page content for AI agents and apps.
- Scrapling
Scrapling is a Python web scraping framework that collects data from websites, including JavaScript-heavy and bot-protected ones, for developers.
- CocoIndex
CocoIndex is a Python framework that keeps data for AI agents and LLM apps continuously fresh by reprocessing only what changed.
- pagesift
pagesift is a self-hosted tool that turns web pages, PDFs and Office files into clean Markdown for AI agents and LLMs.
- ghidra-mcp
ghidra-mcp is an MCP server that lets AI tools analyze and document binaries in Ghidra for reverse engineers.
- kordoc
kordoc is a command-line tool and MCP server that converts Korean documents (HWP, HWPX, PDF, Office files) to Markdown for people working with government and office paperwork.