Summary
Reworkd builds LLM agents that automate web scraping at scale. Customers provide lists of websites and a data schema, and their agents traverse sites, understand their structure, and generate custom Playwright code to extract data. They handle pagination, dynamic content, bot detection, captcha solving, and proxy management. Users can modify generated code in a built-in IDE, monitor scraping in real-time, schedule runs, and deduplicate results. They previously built AgentGPT, an open-source project that received over 30,000 GitHub stars and 1M+ users.
