What this skill does
Crawl/scrape and extract content from any webpage URL. Returns the page content as clean text or raw HTML.
Crawl By Desearch is part of the Research & Knowledge category — research and knowledge skills that gather, search, and summarize information. You can install it on its own or alongside other research & knowledge skills from the OpenClaw catalog.
How to install Crawl By Desearch
The easiest path is via the OpenClaw Easy desktop app — one click, no terminal required:
- Download OpenClaw Easy for macOS or Windows (free, one-click installer, ~30 seconds).
- Open the in-app Skills panel.
- Search for
desearch-crawland click Install. - The skill activates automatically when an incoming message matches its description.
Install from the command line
If you already run the OpenClaw CLI, add Crawl By Desearch with a single command:
openclaw skills add desearch-crawl
This pulls desearch-crawl from ClawHub and installs it into ~/.openclaw/skills/desearch-crawl/. Restart the OpenClaw gateway afterwards so the new skill is discovered.
How to use Crawl By Desearch
Once installed, Crawl By Desearch activates on its own: when an incoming message on WhatsApp, Telegram, Slack, Discord, Feishu or Line matches the skill's description, your OpenClaw agent loads it and runs the workflow. You can also trigger it explicitly by describing the task in chat. No extra configuration is required after install.
Manual install (advanced)
If you prefer manual installation:
- Click the Download .zip button above to grab
desearch-crawl-1.0.1.zipdirectly from our S3 mirror. - Unzip into
~/.openclaw/skills/desearch-crawl/(create the directory if it does not exist). - Restart OpenClaw Easy (or the OpenClaw CLI gateway) so the new skill is discovered.
Frequently asked questions
How do I install Crawl By Desearch?
Install Crawl By Desearch in the OpenClaw Easy desktop app by opening the Skills panel, searching for desearch-crawl, and clicking Install. From a terminal you can run: openclaw skills add desearch-crawl. Either way the skill is placed in ~/.openclaw/skills/desearch-crawl/.
Is Crawl By Desearch free?
Yes. Crawl By Desearch is free and open-source, distributed under the Apache-2.0 license through ClawHub. No account or payment is required to download or run it.
What does Crawl By Desearch do?
Crawl/scrape and extract content from any webpage URL. Returns the page content as clean text or raw HTML.
Related: more research & knowledge skills
If Crawl By Desearch looks useful, you may also want to check out other research & knowledge skills in the OpenClaw catalog:
Browse the full OpenClaw skill catalog
This page covers just one skill. The OpenClaw skill hub has 10,000+ more — search, sort by downloads or stars, and install any of them in one click. There is also a curated awesome-openclaw-skills list grouped by use case.
Get OpenClaw Easy — Free
Install Crawl By Desearch and 10,000+ other OpenClaw skills in one click. Free, open-source, runs locally on macOS & Windows.
Free, open-source · Apache-2.0 · Works with Claude, ChatGPT, Gemini, or local Ollama models