跳到正文
文章中级

用 Queues 和 Browser Run 构建网页爬虫

使用 Queues、Browser Run 和 Puppeteer 构建并部署网页爬虫,把结果存入 Workers KV。

最近更新
2026年10月12日
阅读原文

该介绍目前仅提供英文版本。

Submit links to a queue, and a consumer Worker crawls each one in a headless browser with Puppeteer through Browser Run, saving what it finds to KV — a scalable pattern for crawling only sites you’re allowed to.

What you’ll learn

  • Create a KV namespace and set up Browser Run
  • Set up a queue and its bindings
  • Submit links to crawl
  • Crawl with Puppeteer and deploy

Cloudflare products used

Queues, Browser Run, KV, Workers.

Follow the full, step-by-step tutorial in Cloudflare’s documentation.

继续学习