scrape▌

AI-powered web scraping CLI by ScrapeGraph AI. Get an API key at dashboard.scrapegraphai.com.

Requires firecrawl server in mcp_config.json with FIRECRAWL_API_KEY.

Extract clean markdown from any URL, including JavaScript-rendered single-page applications. \n \n Handles both static pages and JS-rendered SPAs with configurable wait times for rendering \n Supports multiple concurrent URL scraping with output format options including markdown, HTML, links, and screenshots \n Includes content filtering options like main-content-only mode to strip navigation and footers, plus tag inclusion/exclusion \n Optional inline question answering via --query flag for tar