zyte-web-data Claude Code Plugin
Claude Code PluginClaude CodeAutomationWeb Search, Research & LearningAI Agents & AI App DevelopmentCloud, Deployment & CI/CDThe explanation below is AI-generated. Please verify it against the sources.
The zyte-web-data plugin is a Claude Code extension that converts a plain-English description of a target webpage into a working Scrapy spider built with web-poet page objects. According to the README, it explores the target site, proposes a field schema for the user to approve, then generates the Scrapy project, page objects, and test fixtures, followed by a smoke test to confirm extraction works. It can optionally deploy the finished project to Scrapy Cloud for scheduled runs and job monitoring. The README states that running the generated spider locally does not require a Zyte account, but using Zyte API for blocked sites or JavaScript rendering, or deploying to Scrapy Cloud, does require one.
About the service
Zyte is a web data extraction company whose Zyte API service provides proxy rotation, ban handling, and browser rendering for scraping, and whose Scrapy Cloud service hosts and monitors crawlers; the projects this plugin generates can optionally connect to either service.
What you can do with zyte-web-data
- Generate a Scrapy spider with web-poet page objects from a URL and a plain-English extraction request
- Review and approve a discovered field schema before any code is generated
- Run the generated Scrapy project locally with uv, independent of Claude Code
- Deploy the generated project to Scrapy Cloud for scheduled runs and job monitoring
- Set up Zyte API credentials to enable JavaScript rendering or bypass scraping blocks
- Add page objects manually or generate an HTML review page to verify schema and extracted data