What this skill does
Web scraping and content comprehension agent — multi-strategy extraction with cascade fallback, news detection, boilerplate removal, structured metadata.
Web Scraper is part of the Data & APIs category — data and API skills that fetch, query, and work with external data sources. You can install it on its own or alongside other data & apis skills from the OpenClaw catalog.
How to install Web Scraper
The easiest path is via the OpenClaw Easy desktop app — one click, no terminal required:
- Download OpenClaw Easy for macOS or Windows (free, one-click installer, ~30 seconds).
- Open the in-app Skills panel.
- Search for
web-scraperand click Install. - The skill activates automatically when an incoming message matches its description.
Install from the command line
If you already run the OpenClaw CLI, add Web Scraper with a single command:
openclaw skills add web-scraper
This pulls web-scraper from ClawHub and installs it into ~/.openclaw/skills/web-scraper/. Restart the OpenClaw gateway afterwards so the new skill is discovered.
How to use Web Scraper
Once installed, Web Scraper activates on its own: when an incoming message on WhatsApp, Telegram, Slack, Discord, Feishu or Line matches the skill's description, your OpenClaw agent loads it and runs the workflow. You can also trigger it explicitly by describing the task in chat. No extra configuration is required after install.
Manual install (advanced)
If you prefer manual installation:
- Click the Download .zip button above to grab
web-scraper-0.1.1.zipdirectly from our S3 mirror. - Unzip into
~/.openclaw/skills/web-scraper/(create the directory if it does not exist). - Restart OpenClaw Easy (or the OpenClaw CLI gateway) so the new skill is discovered.
Frequently asked questions
How do I install Web Scraper?
Install Web Scraper in the OpenClaw Easy desktop app by opening the Skills panel, searching for web-scraper, and clicking Install. From a terminal you can run: openclaw skills add web-scraper. Either way the skill is placed in ~/.openclaw/skills/web-scraper/.
Is Web Scraper free?
Yes. Web Scraper is free and open-source, distributed under the Apache-2.0 license through ClawHub. No account or payment is required to download or run it.
What does Web Scraper do?
Web scraping and content comprehension agent — multi-strategy extraction with cascade fallback, news detection, boilerplate removal, structured metadata.
Related: more data & apis skills
If Web Scraper looks useful, you may also want to check out other data & apis skills in the OpenClaw catalog:
Browse the full OpenClaw skill catalog
This page covers just one skill. The OpenClaw skill hub has 10,000+ more — search, sort by downloads or stars, and install any of them in one click. There is also a curated awesome-openclaw-skills list grouped by use case.
Get OpenClaw Easy — Free
Install Web Scraper and 10,000+ other OpenClaw skills in one click. Free, open-source, runs locally on macOS & Windows.
Free, open-source · Apache-2.0 · Works with Claude, ChatGPT, Gemini, or local Ollama models