tavily-crawl
by tavily-ai
· Github
Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a local markdown file.
Add tavily-crawl to your agent in AIniverse
Discover more reusable skills, save them to your stack, get notified when new ones land.
Open in App · skills.shMore agent skills
find-skills
Helps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is...
gstack-autoplan
Fully reviewed plan running CEO → design → eng review automatically.
android-agp-9-upgrade
Upgrades, or migrates, an Android project to use Android Gradle Plugin (AGP) version 9. Do not use this skill for mig...
gstack-benchmark
Baseline page load times, Core Web Vitals, and resource sizes.