跳到正文

Deepcrawl

活跃
lumpinif/deepcrawl

开源的 Firecrawl 替代方案,把公开网页转换为适合 AI 智能体使用的干净 Markdown 和链接树,包含 API 与认证 Workers。

在 GitHub 查看
星标
702
Fork
80
关注
702
未关闭 Issue
2

该介绍目前仅提供英文版本。

Overview

Deepcrawl is an agent-oriented platform for extracting website context. It returns the cleaned Markdown of a page’s content, an agent-friendly hierarchical links tree and metadata that LLMs can digest with minimal tokens — reducing context switching and hallucination.

It is positioned as a free, open-source alternative to Firecrawl. The whole platform is open: a Next.js dashboard, API Workers, auth Workers and the database.

Scope

Deepcrawl is built for high-frequency agent workloads that read public pages. Its README states that it does not target anti-scraping or anti-bot use.

Status

The project is under rapid development, and its authors warn against using it in production yet. Documentation lives at deepcrawl.dev/docs.

按共同分类和标签排序的同类开源项目。

全部 AI 项目 →