search-webai-ml

Dumpling AI

dumpling-ai

by dumpling-ai

Dumpling AI offers advanced web scraping tools, acting as a web scraper to extract structured data from websites and doc

Provides a bridge to Dumpling AI's data extraction API for performing web searches, scraping content, extracting structured data, and processing various document formats through 20+ specialized tools.

github stars

29

0 commentsdiscussion

Both formats append explainx.ai attribution and the canonical URL for this MCP server listing.

20+ specialized toolsSupports multiple document formatsSecure code execution environment

best for

  • / Data scientists needing web scraping and content extraction
  • / Researchers collecting information from multiple sources
  • / Developers building data processing pipelines
  • / Content creators extracting media transcripts

capabilities

  • / Scrape web pages and extract structured data
  • / Search YouTube transcripts and web content
  • / Convert documents and extract text from PDFs
  • / Take website screenshots
  • / Extract data from images, audio, and video files
  • / Run JavaScript and Python code securely

what it does

Connects to Dumpling AI's API to perform web scraping, document processing, and data extraction from various sources. Includes 20+ tools for content extraction, web searches, and document conversion.

about

Dumpling AI is an official MCP server published by dumpling-ai that provides AI assistants with tools and capabilities via the Model Context Protocol. Dumpling AI offers advanced web scraping tools, acting as a web scraper to extract structured data from websites and doc It is categorized under search web, ai ml.

how to install

You can install Dumpling AI in your AI client of choice. Use the install panel on this page to get one-click setup for Cursor, Claude Desktop, VS Code, and other MCP-compatible clients. This server runs locally on your machine via the stdio transport.

license

MIT

Dumpling AI is released under the MIT license. This is a permissive open-source license, meaning you can freely use, modify, and distribute the software.

readme

Dumpling AI MCP Server

A Model Context Protocol (MCP) server implementation that integrates with Dumpling AI for data scraping, content processing, knowledge management, AI agents, and code execution capabilities.

smithery badge

Features

  • Complete integration with all Dumpling AI API endpoints
  • Data APIs for YouTube transcripts, search, autocomplete, maps, places, news, and reviews
  • Web scraping with support for scraping, crawling, screenshots, and structured data extraction
  • Document conversion tools for text extraction, PDF operations, video processing
  • Extract data from documents, images, audio, and video
  • AI capabilities including agent completions, knowledge base management, and image generation
  • Developer tools for running JavaScript and Python code in a secure environment
  • Automatic error handling and detailed response formatting

Installation

Installing via Smithery

To install mcp-server-dumplingai for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @Dumpling-AI/mcp-server-dumplingai --client claude

Running with npx

env DUMPLING_API_KEY=your_api_key npx -y mcp-server-dumplingai

Manual Installation

npm install -g mcp-server-dumplingai

Running on Cursor

Configuring Cursor 🖥️ Note: Requires Cursor version 0.45.6+

To configure Dumpling AI MCP in Cursor:

  1. Open Cursor Settings
  2. Go to Features > MCP Servers
  3. Click "+ Add New MCP Server"
  4. Enter the following:
{
  "mcpServers": {
    "dumplingai": {
      "command": "npx",
      "args": ["-y", "mcp-server-dumplingai"],
      "env": {
        "DUMPLING_API_KEY": "<your-api-key>"
      }
    }
  }
}

If you are using Windows and are running into issues, try cmd /c "set DUMPLING_API_KEY=your-api-key && npx -y mcp-server-dumplingai"

Replace your-api-key with your Dumpling AI API key.

Configuration

Environment Variables

  • DUMPLING_API_KEY: Your Dumpling AI API key (required)

Available Tools

Data APIs

1. Get YouTube Transcript (get-youtube-transcript)

Extract transcripts from YouTube videos with optional timestamps.

{
  "name": "get-youtube-transcript",
  "arguments": {
    "videoUrl": "https://www.youtube.com/watch?v=dQw4w9WgXcQ",
    "includeTimestamps": true,
    "timestampsToCombine": 3,
    "preferredLanguage": "en"
  }
}

2. Search (search)

Perform Google web searches and optionally scrape content from results.

{
  "name": "search",
  "arguments": {
    "query": "machine learning basics",
    "country": "us",
    "language": "en",
    "dateRange": "pastMonth",
    "scrapeResults": true,
    "numResultsToScrape": 3,
    "scrapeOptions": {
      "format": "markdown",
      "cleaned": true
    }
  }
}

3. Get Autocomplete (get-autocomplete)

Get Google search autocomplete suggestions for a query.

{
  "name": "get-autocomplete",
  "arguments": {
    "query": "how to learn",
    "country": "us",
    "language": "en",
    "location": "New York"
  }
}

4. Search Maps (search-maps)

Search Google Maps for locations and businesses.

{
  "name": "search-maps",
  "arguments": {
    "query": "coffee shops",
    "gpsPositionZoom": "37.7749,-122.4194,14z",
    "language": "en",
    "page": 1
  }
}

5. Search Places (search-places)

Search for places with more detailed information.

{
  "name": "search-places",
  "arguments": {
    "query": "hotels in paris",
    "country": "fr",
    "language": "en",
    "page": 1
  }
}

6. Search News (search-news)

Search for news articles with customizable parameters.

{
  "name": "search-news",
  "arguments": {
    "query": "climate change",
    "country": "us",
    "language": "en",
    "dateRange": "pastWeek"
  }
}

7. Get Google Reviews (get-google-reviews)

Retrieve Google reviews for businesses or places.

{
  "name": "get-google-reviews",
  "arguments": {
    "businessName": "Eiffel Tower",
    "location": "Paris, France",
    "limit": 10,
    "sortBy": "relevance"
  }
}

Web Scraping

8. Scrape (scrape)

Extract content from a web page with formatting options.

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown",
    "cleaned": true,
    "renderJs": true
  }
}

9. Crawl (crawl)

Recursively crawl websites and extract content with customizable parameters.

{
  "name": "crawl",
  "arguments": {
    "baseUrl": "https://example.com",
    "maxPages": 10,
    "crawlBeyondBaseUrl": false,
    "depth": 2,
    "scrapeOptions": {
      "format": "markdown",
      "cleaned": true,
      "renderJs": true
    }
  }
}

10. Screenshot (screenshot)

Capture screenshots of web pages with customizable viewport and format options.

{
  "name": "screenshot",
  "arguments": {
    "url": "https://example.com",
    "width": 1280,
    "height": 800,
    "fullPage": true,
    "format": "png",
    "waitFor": 1000
  }
}

11. Extract (extract)

Extract structured data from web pages using AI-powered instructions.

{
  "name": "extract",
  "arguments": {
    "url": "https://example.com/products",
    "instructions": "Extract all product names, prices, and descriptions from this page",
    "schema": {
      "products": [
        {
          "name": "string",
          "price": "number",
          "description": "string"
        }
      ]
    },
    "renderJs": true
  }
}

Document Conversion

12. Doc to Text (doc-to-text)

Convert documents to plaintext with optional OCR.

{
  "name": "doc-to-text",
  "arguments": {
    "url": "https://example.com/document.pdf",
    "options": {
      "ocr": true,
      "language": "en"
    }
  }
}

13. Convert to PDF (convert-to-pdf)

Convert various file formats to PDF.

{
  "name": "convert-to-pdf",
  "arguments": {
    "url": "https://example.com/document.docx",
    "format": "docx",
    "options": {
      "quality": 90,
      "pageSize": "A4",
      "margin": 10
    }
  }
}

14. Merge PDFs (merge-pdfs)

Combine multiple PDFs into a single document.

{
  "name": "merge-pdfs",
  "arguments": {
    "urls": ["https://example.com/doc1.pdf", "https://example.com/doc2.pdf"],
    "options": {
      "addPageNumbers": true,
      "addTableOfContents": true
    }
  }
}

15. Trim Video (trim-video)

Extract a specific clip from a video.

{
  "name": "trim-video",
  "arguments": {
    "url": "https://example.com/video.mp4",
    "startTime": 30,
    "endTime": 60,
    "output": "mp4",
    "options": {
      "quality": 720,
      "fps": 30
    }
  }
}

16. Extract Document (extract-document)

Extract specific content from documents in various formats.

{
  "name": "extract-document",
  "arguments": {
    "url": "https://example.com/document.pdf",
    "format": "structured",
    "options": {
      "ocr": true,
      "language": "en",
      "includeMetadata": true
    }
  }
}

17. Extract Image (extract-image)

Extract text and information from images.

{
  "name": "extract-image",
  "arguments": {
    "url": "https://example.com/image.jpg",
    "extractionType": "text",
    "options": {
      "language": "en",
      "detectOrientation": true
    }
  }
}

18. Extract Audio (extract-audio)

Transcribe and extract information from audio files.

{
  "name": "extract-audio",
  "arguments": {
    "url": "https://example.com/audio.mp3",
    "language": "en",
    "options": {
      "model": "enhanced",
      "speakerDiarization": true,
      "wordTimestamps": true
    }
  }
}

19. Extract Video (extract-video)

Extract content from videos including transcripts, scenes, and objects.

{
  "name": "extract-video",
  "arguments": {
    "url": "https://example.com/video.mp4",
    "extractionType": "transcript",
    "options": {
      "language": "en",
      "speakerDiarization": true
    }
  }
}

20. Read PDF Metadata (read-pdf-metadata)

Extract metadata from PDF files.

{
  "name": "read-pdf-metadata",
  "arguments": {
    "url": "https://example.com/document.pdf",
    "includeExtended": true
  }
}

21. Write PDF Metadata (write-pdf-metadata)

Update metadata in PDF files.

{
  "name": "write-pdf-metadata",
  "arguments": {
    "url": "https://example.com/document.pdf",
    "metadata": {
      "title": "New Title",
      "author": "John Doe",
      "keywords": ["keyword1", "keyword2"]
    }
  }
}

AI

22. Generate Agent Completion (generate-agent-completion)

Get AI agent completions with optional tool definitions.

{
  "name": "generate-agent-completion",
  "arguments": {
    "prompt": "How can I improve my website's SEO?",
    "model": "gpt-4",
    "temperature": 0.7,
    "maxTokens": 500,
    "context": ["The website is an e-commerce store selling handmade crafts."]
  }
}

23. Search Knowledge Base (search-knowledge-base)

Search a knowledge base for relevant information.

{
  "name": "search-knowledge-base",
  "arguments": {
    "kbId": "kb_12345",
    "query": "How to optimize database performance",
    "limit": 5,
    "similarityThreshold": 0.7
  }
}

24. Add to Knowledge Base (add-to-knowledge-base)

Add entries to a knowledge base.

{
  "name": "add-to-knowledge-base",
  "arguments": {
    "kbId": "kb_12345",
    "entries": [
      {
        "text": "MongoDB is a document-based NoSQL database.",
        "metadata": {
          "source": "MongoDB documentation",
          "category": "databases"
        }
      }
    ],
    "upsert": true
  }
}

25. Generate AI Image (`generate-ai-ima


FAQ

What is the Dumpling AI MCP server?
Dumpling AI is a Model Context Protocol (MCP) server profile on explainx.ai. MCP lets AI hosts (e.g. Claude Desktop, Cursor) call tools and resources through a standard interface; this page summarizes categories, install hints, and community ratings.
How do MCP servers relate to agent skills?
Skills are reusable instruction packages (often SKILL.md); MCP servers expose live capabilities. Teams frequently combine both—skills for workflows, MCP for APIs and data. See explainx.ai/skills and explainx.ai/mcp-servers for parallel directories.
How are reviews shown for Dumpling AI?
This profile displays 29 aggregated ratings (sample rows for discoverability plus signed-in user reviews). Average score is about 4.7 out of 5—verify behavior in your own environment before production use.

Use Cases

Web Research & Information Gathering

Fetch and extract information from websites automatically

Example

Research competitor pricing, scrape product reviews, monitor news mentions

Automate 5-10 hours/week of manual web research

Content Monitoring & Alerts

Track website changes, new content, price updates

Example

Monitor competitor blog for new posts, track stock availability, watch for pricing changes

Stay informed without manual checking, never miss important updates

Data Extraction & Aggregation

Extract structured data from multiple websites

Example

Compile product listings from 10 e-commerce sites, aggregate job postings, collect real estate data

Build datasets 100x faster than manual copying

API-less Integration

Interact with services that don't offer APIs

Example

Check form submissions, validate website functionality, test user flows

Automate interactions with any website, even without API

Implementation Guide

Prerequisites

  • Claude Desktop or Cursor with MCP support
  • Understanding of web scraping ethics and robots.txt
  • Rate limiting awareness to avoid overwhelming target sites
  • Knowledge of legal restrictions on data collection

Time Estimate

20-40 minutes including configuration and testing

Installation Steps

  1. 1.Install web automation MCP server via npm or pip
  2. 2.Configure allowed domains and rate limits in MCP config
  3. 3.Test with simple fetch: 'Get content from example.com'
  4. 4.Progress to extraction: 'Extract all product prices from this page'
  5. 5.Set up monitoring: 'Check this URL daily for changes'
  6. 6.Parse structured data: 'Create CSV from this table'
  7. 7.Respect robots.txt and rate limits always

Troubleshooting

  • 403 Forbidden: Website blocks bots—respect their wishes, use official API instead
  • Rate limit errors: Slow down requests, add delays between fetches
  • Stale data: Target site changed HTML structure—update selectors
  • Timeout errors: Site is slow or blocking—increase timeout, try different user agent
  • JavaScript-rendered content: Use headless browser MCP servers for dynamic sites

Best Practices

✓ Do

  • +Check robots.txt and respect crawl rules
  • +Rate limit requests: 1-2 requests/second maximum
  • +Use official APIs when available instead of scraping
  • +Identify your bot with descriptive user agent
  • +Cache results to minimize repeated requests
  • +Handle errors gracefully with retries and fallbacks
  • +Validate extracted data for accuracy

✗ Don't

  • Don't scrape sites that explicitly forbid it (robots.txt, ToS)
  • Don't overwhelm servers with rapid requests—use rate limiting
  • Don't scrape personal data without consent and legal basis
  • Don't ignore copyright on extracted content
  • Don't assume HTML structure is stable—handle changes
  • Don't use scraped data for commercial purposes without permission

💡 Pro Tips

  • Use CSS selectors or XPath for robust data extraction
  • Set up monitoring alerts for extraction failures (structure changed)
  • Implement exponential backoff for retries on failures
  • Store raw HTML for reprocessing if extraction logic changes
  • Combine with data analysis tools for insights from extracted data
  • Consider using official APIs or RSS feeds as more stable alternatives

Technical Details

Architecture

MCP server handles HTTP requests, HTML parsing, JavaScript rendering (if headless browser), and returns structured data to Claude.

Protocols

  • HTTP/HTTPS
  • WebSocket (for real-time sites)
  • Puppeteer/Playwright (for JavaScript sites)

Compatibility

  • Static HTML sites
  • JavaScript-rendered SPAs (with headless browser)
  • REST APIs
  • GraphQL endpoints

When to Use This

✓ Use When

Use for research automation, content monitoring, data aggregation from multiple sources, and when official APIs don't exist. Best for read-only information gathering.

✗ Avoid When

Avoid for sites with APIs (use API instead), sites that explicitly forbid scraping, when data is copyrighted, or for login-required content without proper authorization.

Integration

  • Scheduled monitoring with change detection
  • Multi-source data aggregation pipelines
  • Fallback to web scraping when API rate limits hit
  • Headless browser for JavaScript-heavy sites

Discussion

Product Hunt–style comments (not star reviews)
  • No comments yet — start the thread.

List & Promote Your MCP Server

Share your MCP server with the developer community

GET_STARTED →
MCP server reviews

Ratings

4.729 reviews
  • Emma Martinez· Dec 28, 2024

    Dumpling AI is among the better-indexed MCP projects we tried; the explainx.ai summary tracks the official description.

  • Ren Gill· Dec 12, 2024

    Dumpling AI reduced integration guesswork — categories and install configs on the listing matched the upstream repo.

  • James Huang· Dec 8, 2024

    Dumpling AI is a well-scoped MCP server in the explainx.ai directory — install snippets and categories matched our Claude Code setup.

  • Liam Bhatia· Nov 19, 2024

    We evaluated Dumpling AI against two servers with overlapping tools; this profile had the clearer scope statement.

  • James Diallo· Nov 3, 2024

    We wired Dumpling AI into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.

  • Zara Anderson· Oct 22, 2024

    We evaluated Dumpling AI against two servers with overlapping tools; this profile had the clearer scope statement.

  • Yusuf Martinez· Oct 10, 2024

    We wired Dumpling AI into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.

  • Piyush G· Sep 25, 2024

    We evaluated Dumpling AI against two servers with overlapping tools; this profile had the clearer scope statement.

  • Tariq Reddy· Sep 17, 2024

    According to our notes, Dumpling AI benefits from clear Model Context Protocol framing — fewer ambiguous “AI plugin” claims.

  • Diya Khanna· Sep 1, 2024

    I recommend Dumpling AI for teams standardizing on MCP; the explainx.ai page compares cleanly with sibling servers.

showing 1-10 of 29

1 / 3