scrape-explore-site
SkillExplore a website to find and save diverse pages (start, list, detail) with classified links
Install
git clone https://github.com/zytedata/claude-skills.git ~/.claude/skills/scrape-explore-siteWhat is scrape-explore-site?
Explore a website to find and save diverse pages (start, list, detail) with classified links
What this can do
Capabilities declared in this component's own frontmatter — not inferred.
Run shell commands
Declares Bash
Create and modify files
Declares Write or Edit
~23 tokens of context used while enabled, before you invoke anything
All declared tools (3)
BashReadWriteDocumentation
README · ~6 min readYou are exploring a website to discover and save a diverse set of pages. Given a start URL, find start, list/category, and detail pages within its scope.
Read ${CLAUDE_SKILL_DIR}/../scrape/references/python-environments.md.
Input
The raw argument string is $ARGUMENTS. Split it into up to 4 whitespace-separated positional arguments:
- url: start URL, typically homepage
- project_path: path to save output
- DETAIL_COUNT: number of detail pages to find (default: 3)
- LIST_COUNT: number of list/category pages to save (default: 2)
The start page is always saved.
Scope
Reviews
Log in to leave a review.
No reviews yet — be the first.
Explore related
Other things in this space — across every part of the ecosystem, not just skills.
Skillssimilar to this one
All skills →link-rot-scanner
Crawl and validate all internal and external links across an AEM Edge Delivery Services site. Uses the query index or sitemap to discover pages, extracts links from .plain.html renditions, checks HTTP status codes, and produces a prioritized report of broken, redirecting, and insecure links. Use whe
151 stars
extract
Crawl an existing website (capped, multi-page) and seed stardust/current/ with PRODUCT.md, DESIGN.md, DESIGN.json, a per-page inventory, and the consolidated brand surface — the captured design system, palette, typography, motifs, and voice of the live site. Use when the user wants to analyze an exi
151 stars
scrape-webpage
Use this when the page-import pipeline needs to fetch a source webpage and prepare it for import/migration to AEM Edge Delivery Services. Covers scraping content, extracting metadata, downloading images, and returning analysis JSON with paths, metadata, cleaned HTML, and local images. Do not invoke
151 stars
MCP Servers
All mcp servers →Plugins
All plugins →exa
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers, and more.
4.8K stars
cli
CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents
549 stars
tavily
Build AI applications with real-time web data using Tavily's search, extract, crawl, and research APIs.
436 stars