Crawl

What this skill does

Crawl any website and save pages as local markdown files. Use when you need to download documentation, knowledge bases, or web content for offline access or analysis. No code required - just provide a URL.

Crawl is part of the Developer Tools category — developer tools that help your agent write, review, debug, and ship code. You can install it on its own or alongside other developer tools skills from the OpenClaw catalog.

How to install Crawl

The easiest path is via the OpenClaw Easy desktop app — one click, no terminal required:

1. Download OpenClaw Easy for macOS or Windows (free, one-click installer, ~30 seconds).
2. Open the in-app Skills panel.
3. Search for crawl and click Install.
4. The skill activates automatically when an incoming message matches its description.

Install from the command line

If you already run the OpenClaw CLI, add Crawl with a single command:

openclaw skills add crawl

This pulls crawl from ClawHub and installs it into ~/.openclaw/skills/crawl/. Restart the OpenClaw gateway afterwards so the new skill is discovered.

How to use Crawl

Once installed, Crawl activates on its own: when an incoming message on WhatsApp, Telegram, Slack, Discord, Feishu or Line matches the skill's description, your OpenClaw agent loads it and runs the workflow. You can also trigger it explicitly by describing the task in chat. No extra configuration is required after install.

Manual install (advanced)

If you prefer manual installation:

1. Click the Download .zip button above to grab crawl-0.1.0.zip directly from our S3 mirror.
2. Unzip into ~/.openclaw/skills/crawl/ (create the directory if it does not exist).
3. Restart OpenClaw Easy (or the OpenClaw CLI gateway) so the new skill is discovered.

Frequently asked questions

How do I install Crawl?

Install Crawl in the OpenClaw Easy desktop app by opening the Skills panel, searching for crawl, and clicking Install. From a terminal you can run: openclaw skills add crawl. Either way the skill is placed in ~/.openclaw/skills/crawl/.

Is Crawl free?

Yes. Crawl is free and open-source, distributed under the Apache-2.0 license through ClawHub. No account or payment is required to download or run it.

What does Crawl do?

Crawl any website and save pages as local markdown files. Use when you need to download documentation, knowledge bases, or web content for offline access or analysis. No code required - just provide a URL.

Related: more developer tools skills

If Crawl looks useful, you may also want to check out other developer tools skills in the OpenClaw catalog:

• VEED UGC ⬇ 2K
• Crypto Backtest ⬇ 2K
• Fluora Setup ⬇ 2K
• Jianying Auto Editor ⬇ 2K
• Image and Video Generation with Vydra API ⬇ 2K

Browse the full OpenClaw skill catalog

This page covers just one skill. The OpenClaw skill hub has 10,000+ more — search, sort by downloads or stars, and install any of them in one click. There is also a curated awesome-openclaw-skills list grouped by use case.