pagesift
pagesift is a self-hosted tool that turns web pages, PDFs and Office files into clean Markdown for AI agents and LLMs.
What it is good for
- Converting web pages and documents into text an AI can read
- Self-hosting a Firecrawl-style scraping service without per-page fees
- Feeding crawled website content into a RAG index
- Extracting text from PDFs, Word and Excel files
At a glance
- Who it is for
- Setup
- Guided command-line setup
Level 4 of 5. You copy and paste commands into a terminal by following the instructions. Comfortable territory for vibe coders.
- Cost
- Free and open source
- Type
- Framework or SDK
- Tasks
- Works with
- Claude Code, Firecrawl, Docker
Momentum
- Rank this week
- Not ranked yet
- Best rank
- None yet
- GitHub stars
- 184
GitHub numbers as of Nov 2, 2026. Updated weekly.
Official links
Setup steps are on the official pages. We do not repeat them here, since they change.
Questions
- Is pagesift free?
- Yes. It is free and open source (AGPL-3.0 license).
- Do I need to know how to code to use pagesift?
- You do not need to write code, but setup means copying and pasting commands into a terminal by following its instructions.
- What does pagesift work with?
- According to its own documentation, it works with Claude Code, Firecrawl, and Docker.
- What is pagesift good for?
- Converting web pages and documents into text an AI can read, self-hosting a Firecrawl-style scraping service without per-page fees, feeding crawled website content into a RAG index, and extracting text from PDFs, Word and Excel files.
Similar agents
- Firecrawl
Firecrawl is an API that searches the web and pulls clean page content for AI agents and apps.
- Scrapling
Scrapling is a Python web scraping framework that collects data from websites, including JavaScript-heavy and bot-protected ones, for developers.
- CocoIndex
CocoIndex is a Python framework that keeps data for AI agents and LLM apps continuously fresh by reprocessing only what changed.
- webclaw
webclaw is a web extraction tool that turns websites into clean markdown or JSON for AI agents and apps, usable from a terminal, MCP, or API.
- graphify
Graphify is a skill that turns a project's code, docs, and PDFs into a queryable map for AI coding assistants, so they can answer questions without rereading every file.
- crawl4ai
Crawl4AI is an open-source web crawler that turns any website into clean Markdown for AI agents and data pipelines.