Pagesift

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible…

LLM Mart 1 views 62 listing impressions

It is self-hosted and runs as a single Rust binary offering a CLI, Firecrawl and Jina Reader APIs, an MCP server, and SDKs for multiple languages. Its DataGraph feature tracks citations, provenance, version lineage, field-level evidence, and cross-source conflicts. PageSift supports crawling entire sites via sitemaps, trap handling, robots.txt, and per-host limits, outputting WARC files.

Summary drafted from the project's own website. Every sentence is backed by text on that page and was reviewed before publishing.

Related servers

Universal MCP Server with advanced AI memory capabilities and semantic search.

30 views

MCP server for MikroTik routers: firewall, NAT, routing, DHCP, DNS, WireGuard and more via SSH.

28 views

Let Codex orchestrate external coding agents through their native harnesses.

28 views

Control plane MCP for scoped recon, triage, and bounded proofs.

27 views