scraper
Back to API docs
  • Overview
  • Setup
  • Authentication
  • Available Tools
  • Examples
  • Troubleshooting

MCP Server

Connect your AI assistant to 20+ scraping and data tools with one command.

Overview

The Model Context Protocol (MCP) is a standard that lets AI assistants call external tools directly. Scraper exposes all its tools as an MCP server, so your assistant can search Google, fetch reviews, find jobs, and more without you writing any integration code.

No code needed

Connect once, then ask your assistant in natural language. It picks the right tool automatically.

Secure by default

OAuth 2.1 with PKCE handles authentication. No API keys to copy or manage.

Same billing

Uses the same credit system as the REST API. No extra fees for MCP access.

Setup

On first use, your client opens a browser window to authorize. After that, the token refreshes automatically.

Claude Code

claude mcp add scraper --transport http https://scraper.run/api/mcp

Claude Desktop

Add to your claude_desktop_config.json:

{
"mcpServers": {
"scraper": {
"type": "streamable-http",
"url": "https://scraper.run/api/mcp"
}
}
}

Cursor

Add to .cursor/mcp.json in your project:

{
"mcpServers": {
"scraper": {
"type": "streamable-http",
"url": "https://scraper.run/api/mcp"
}
}
}

VS Code

Add to your .vscode/mcp.json:

{
"servers": {
"scraper": {
"type": "http",
"url": "https://scraper.run/api/mcp"
}
}
}

Windsurf

Add to ~/.codeium/windsurf/mcp_config.json:

{
"mcpServers": {
"scraper": {
"type": "streamable-http",
"url": "https://scraper.run/api/mcp"
}
}
}

Other clients

Any MCP client that supports Streamable HTTP can connect. Point it at https://scraper.run/api/mcp. OAuth metadata is at https://scraper.run/api/.well-known/oauth-authorization-server

Authentication

The MCP server supports two authentication methods:

MethodHow it worksBest for
OAuth 2.1Browser-based consent flow with PKCE, automatic token refreshClaude, Cursor, VS Code, Windsurf
API KeyPass your sc_live_ key as a Bearer tokenProgrammatic or headless clients

OAuth tokens have a 1-hour lifetime and refresh automatically. API keys work the same as with the REST API.

Available Tools

All tools use the same credit system as the REST API.

ToolDescriptionCredits
google_searchWeb search via Google0.5
google_translateTranslate text between languages1
google_visionAnalyze images (labels, text, landmarks)0.5
google_geocodeGeocode addresses or reverse-geocode coordinates0.1
google_places_searchSearch for places by query1
google_places_detailsGet place details by place ID0.6
google_places_nearbyFind places near a location1
google_places_autocompleteAutocomplete place names0.1
google_maps_reviewsGet Google Maps reviews for a place1
trustpilot_reviewsGet Trustpilot reviews for a business1
tripadvisor_reviewsGet Tripadvisor reviews1
yelp_reviewsGet Yelp reviews for a business1
glassdoor_reviewsGet Glassdoor company reviews1
glassdoor_companyGet Glassdoor company overview1
glassdoor_salariesGet salary data from Glassdoor1
glassdoor_interviewsGet interview experiences1
glassdoor_jobsSearch Glassdoor job listings1
glassdoor_benefitsGet company benefits info1
indeed_jobsSearch Indeed job listings1
tiktok_productGet TikTok Shop product details1
tiktok_product_reviewsGet TikTok Shop product reviews1
youtube_searchSearch YouTube videos, channels, playlists1
youtube_videoGet metadata for a YouTube video0.5
youtube_channelGet metadata for a YouTube channel0.5
youtube_channel_videosList videos for a YouTube channel1
youtube_playlistGet metadata and videos for a YouTube playlist0.5
youtube_hashtagFind YouTube content by hashtag0.5
youtube_transcriptGet the transcript for a YouTube video0.5
youtube_commentsGet comments on a YouTube video1
reddit_postGet a Reddit post and its comments1
reddit_searchSearch Reddit1
hackernews_postGet a HackerNews post and its comments1
hackernews_searchSearch HackerNews1
booking_hotelGet full hotel details from Booking.com1
booking_reviewsGet guest reviews for a Booking.com hotel1
booking_searchSearch Booking.com hotels by destination1
g2_analyticsGet aggregated analytics for G2 products1
g2_productsSearch or look up G2 software products1
g2_discussionsFetch Q&A discussion threads for a G2 product1
g2_reviewsGet G2 software reviews1
twitter_threadGet a Twitter/X post and its replies2
twitter_searchSearch Twitter/X for recent tweets2
twitter_user_tweetsGet recent tweets from an X/Twitter user2
twitter_user_infoGet an X/Twitter user profile1
linkedin_postGet a LinkedIn post and its comments2
instagram_postGet an Instagram post and its comments2
instagram_searchSearch Instagram posts by hashtag2
threads_postGet a Threads post and its replies2
threads_searchSearch Threads for recent posts2
facebook_postGet a Facebook post and its comments5
facebook_searchSearch Facebook for posts and pages5

Selecting fields

Most tools accept an optional fields parameter that limits the response to specific fields. Use it to reduce token cost when you only need part of the response. Click any tool name above to see its full field reference.

Example: passing fields: ["rating", "text", "author"] to trustpilot_reviews returns only those three fields per review.

Examples

Once connected, ask your assistant in natural language. It picks the right tool automatically.

Single tool

“Get Trustpilot reviews for notion.so and list the most common complaints”

trustpilot_reviews

“Find senior React developer jobs on Indeed in San Francisco”

indeed_jobs

“What are the Google Maps reviews for Blue Bottle Coffee in Tokyo?”

google_maps_reviews

“Translate this paragraph to Japanese”

google_translate

Multi-tool chains

“Search Google for Notion competitors and get Trustpilot reviews for each one”

google_searchtrustpilot_reviews

“Find React developer jobs on Indeed in San Francisco, then translate the top 3 descriptions to Vietnamese”

indeed_jobsgoogle_translate

“Compare Glassdoor reviews and salaries for Meta vs Google for senior engineers”

glassdoor_reviewsglassdoor_salaries

“Find coffee shops near Times Square and get their Google Maps reviews”

google_places_nearbygoogle_maps_reviews

Troubleshooting

My assistant uses its built-in web search instead of google_search

Some assistants (like Claude) have a native web search tool. For generic search prompts, they may prefer their own tool over the MCP version. Two workarounds:

  • Chain it with another Scraper tool so the assistant uses both in one flow (e.g. “Search Google for X and get Trustpilot reviews for each result”)
  • Reference the tool by name: “Use the google_search tool to find...”

OAuth flow not opening in the browser

Make sure your client supports Streamable HTTP transport. Some older MCP clients only support stdio. Check that you're using the latest version of your client.

Session expired or 401 errors

OAuth tokens expire after 1 hour and should refresh automatically. If you see repeated 401 errors, remove and re-add the MCP server to trigger a fresh authorization flow.

scraperAPI Docs