What this skill does
智能爬虫工具 - 企业级数据采集与反爬虫处理 | Smart Web Crawler - Enterprise data collection with anti-detection
Smart Crawler is part of the Data & APIs category — data and API skills that fetch, query, and work with external data sources. You can install it on its own or alongside other data & apis skills from the OpenClaw catalog.
How to install Smart Crawler
The easiest path is via the OpenClaw Easy desktop app — one click, no terminal required:
- Download OpenClaw Easy for macOS or Windows (free, one-click installer, ~30 seconds).
- Open the in-app Skills panel.
- Search for
smart-crawlerand click Install. - The skill activates automatically when an incoming message matches its description.
Install from the command line
If you already run the OpenClaw CLI, add Smart Crawler with a single command:
openclaw skills add smart-crawler
This pulls smart-crawler from ClawHub and installs it into ~/.openclaw/skills/smart-crawler/. Restart the OpenClaw gateway afterwards so the new skill is discovered.
How to use Smart Crawler
Once installed, Smart Crawler activates on its own: when an incoming message on WhatsApp, Telegram, Slack, Discord, Feishu or Line matches the skill's description, your OpenClaw agent loads it and runs the workflow. You can also trigger it explicitly by describing the task in chat. No extra configuration is required after install.
Manual install (advanced)
If you prefer manual installation:
- Click the Download .zip button above to grab
smart-crawler-1.0.0.zipdirectly from our S3 mirror. - Unzip into
~/.openclaw/skills/smart-crawler/(create the directory if it does not exist). - Restart OpenClaw Easy (or the OpenClaw CLI gateway) so the new skill is discovered.
Frequently asked questions
How do I install Smart Crawler?
Install Smart Crawler in the OpenClaw Easy desktop app by opening the Skills panel, searching for smart-crawler, and clicking Install. From a terminal you can run: openclaw skills add smart-crawler. Either way the skill is placed in ~/.openclaw/skills/smart-crawler/.
Is Smart Crawler free?
Yes. Smart Crawler is free and open-source, distributed under the Apache-2.0 license through ClawHub. No account or payment is required to download or run it.
What does Smart Crawler do?
智能爬虫工具 - 企业级数据采集与反爬虫处理 | Smart Web Crawler - Enterprise data collection with anti-detection
Related: more data & apis skills
If Smart Crawler looks useful, you may also want to check out other data & apis skills in the OpenClaw catalog:
Browse the full OpenClaw skill catalog
This page covers just one skill. The OpenClaw skill hub has 10,000+ more — search, sort by downloads or stars, and install any of them in one click. There is also a curated awesome-openclaw-skills list grouped by use case.
Get OpenClaw Easy — Free
Install Smart Crawler and 10,000+ other OpenClaw skills in one click. Free, open-source, runs locally on macOS & Windows.
Free, open-source · Apache-2.0 · Works with Claude, ChatGPT, Gemini, or local Ollama models