YOLOW92/pagesift
High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG. Adaptive crawling, clean Markdown, structured data, PDF/RSS parsing, browser rendering, Firecrawl-compatible APIs, and Python/Node.js SDKs.
Latest metrics (snapshot 2026-10-28)
| stars | 118 |
|---|---|
| forks | 18 |
| issues | 0 |
| pushed_at | 2026-10-28T05:04:19Z |
History
History chart: 1 daily snapshot so far (archive started 2026-10-14). The line fills in as the daily archive grows; full series via the API.
| Date | GitHub stars |
|---|---|
| 2026-10-28 | 118 |
ADC Momentum: 60/100
| Growth velocity | 65 |
|---|---|
| Consistency | 52 |
| Recency | 100 |
| Agent demand | 0 |
| Basis | bootstrap |
ADC Momentum (0-100) = 45% growth velocity (stars/likes gained per day in our daily archive, relative and absolute, percentile-ranked within the category) + 20% consistency (share of recent days with growth) + 20% recency (latest push/update/release, decaying) + 15% agent demand (how often AI agents looked it up via our API/MCP this week). MCP servers use release cadence; LLMs use price cuts, context and recency. Recomputed daily; scores marked "bootstrap" use lifetime rates until the archive has enough days. Method
Embed this badge
Maintainers: add the live badge to your README (updates daily).
[](https://agentdataco.com/repo/YOLOW92/pagesift)<a href="https://agentdataco.com/repo/YOLOW92/pagesift"><img src="https://agentdataco.com/badge/repo/YOLOW92/pagesift.svg" alt="ADC Momentum"></a>Details
| description | High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG. Adaptive crawling, clean Markdown, structured data, PDF/RSS parsing, browser rendering, Firecrawl-compatible APIs, and Python/Node.js SDKs. |
|---|---|
| url | https://github.com/YOLOW92/pagesift |
| language | Rust |
| license | AGPL-3.0 |
| topics | ai-agents browser-automation data-extraction firecrawl html-to-markdown markdown mcp pdf-extraction rag rust web-crawler web-scraping |
| created_at | 2026-10-20T17:30:59Z |
Get this data via API or MCP
Full daily history, trends and change events for YOLOW92/pagesift and thousands of other AI-ecosystem entities.
curl -H "Authorization: Bearer $ADC_KEY" \
"https://agentdataco.com/api/v1/github-ai-repos/history?entity=YOLOW92%2Fpagesift"
curl -H "Authorization: Bearer $ADC_KEY" \
"https://agentdataco.com/api/v1/github-ai-repos?repo=YOLOW92%2Fpagesift"Or connect your agent to our remote MCP server: https://agentdataco.com/mcp.
Agent Data Weekly
The week's notable AI agents, MCP servers, launches and price changes, from our daily archive. Free, double opt-in, unsubscribe any time. Past issues
Maintainer? Claim this listing
Owners and vendors can submit a description, pricing and corrections. We email you a verification link; verified submissions are reviewed daily (a work email on the project's domain is fastest).