scraper

Getting Started

  • Getting Started

Authentication

  • Authentication

Endpoints

  • POSTScrape
  • GETUsage
  • GETPlatforms

Tools

  • Google
  • Google Maps
  • Trustpilot
  • Tripadvisor
  • Yelp
  • Glassdoor
  • Indeed
  • TikTok
  • YouTube
  • Reddit
  • HackerNews
  • Booking.com
  • G2
  • Twitter
  • LinkedIn
  • Facebook
  • Instagram
  • Threads

MCP

  • MCP Server

Reference

  • Errors
  • Rate Limits

Platforms

The list of sites the scrape endpoint supports, and the URL formats for each.

GET/api/v1/platforms

Response Schema

platformsobject[]

List of supported platforms

namestring

Platform identifier

domainsstring[]

Accepted domain patterns

statusstring

Platform status (active, beta)

docsUrlstring

Platform-specific documentation URL

Request

curl https://scraper.run/api/v1/platforms

Response Example

{
"platforms": [
{
"name": "twitter",
"domains": [
"x.com",
"twitter.com"
],
"status": "active",
"docsUrl": "..."
},
{
"name": "reddit",
"domains": [
"reddit.com"
],
"status": "active",
"docsUrl": "..."
}
]
}

Supported URLs

Each platform supports specific URL formats. Pass any of these to the /v1/scrape endpoint.

Twitter / X

TypeURL Pattern
Postx.com/{user}/status/{id}
https://x.com/elonmusk/status/1234567890
Searchx.com/search?q={query}
https://x.com/search?q=raycast

Reddit

TypeURL Pattern
Postreddit.com/r/{sub}/comments/{id}/...
https://www.reddit.com/r/programming/comments/abc123/...
Searchreddit.com/search?q={query}
https://www.reddit.com/search?q=nextjs

Hacker News

TypeURL Pattern
Postnews.ycombinator.com/item?id={id}
https://news.ycombinator.com/item?id=42424242
Searchhn.algolia.com/?query={query}
https://hn.algolia.com/?query=rust

Threads

TypeURL Pattern
Postthreads.net/@{user}/post/{code}
https://www.threads.net/@zuck/post/abc123
Searchthreads.net/search?q={query}
https://www.threads.net/search?q=figma

TikTok

TypeURL Pattern
Posttiktok.com/@{user}/video/{id}
https://www.tiktok.com/@user/video/1234567890
Searchtiktok.com/search?q={query}
https://www.tiktok.com/search?q=coding

Instagram

TypeURL Pattern
Postinstagram.com/p/{code}/
https://www.instagram.com/p/DUVn_ewDjcI/
Reelinstagram.com/reel/{code}/
https://www.instagram.com/reel/abc123/
Hashtaginstagram.com/explore/tags/{tag}
https://www.instagram.com/explore/tags/travel

YouTube

TypeURL Pattern
Videoyoutube.com/watch?v={id}
https://www.youtube.com/watch?v=dQw4w9WgXcQ
Shortyoutube.com/shorts/{id}
https://www.youtube.com/shorts/abc123
Searchyoutube.com/results?search_query={query}
https://www.youtube.com/results?search_query=react

LinkedIn

TypeURL Pattern
Postlinkedin.com/feed/update/urn:li:activity:{id}
https://www.linkedin.com/feed/update/urn:li:activity:7443280380897562624
Postlinkedin.com/posts/{slug}-activity-{id}-{hash}
https://www.linkedin.com/posts/claude_content-activity-7438237754267914241-bKwe

Facebook

TypeURL Pattern
Postfacebook.com/{user}/posts/{id}
https://www.facebook.com/openai/posts/pfbid0w96S8oxKwX...
Searchfacebook.com/search/posts?q={query}
https://www.facebook.com/search/posts?q=react

Indeed

TypeURL Pattern
Jobindeed.com/viewjob?jk={id}
https://www.indeed.com/viewjob?jk=5e5dafc2a80c214d
Searchindeed.com/jobs?q={query}
https://www.indeed.com/jobs?q=software+engineer

Glassdoor

TypeURL Pattern
Reviewsglassdoor.com/Reviews/{company}-Reviews-E{id}.htm
https://www.glassdoor.com/Reviews/Meta-Reviews-E40772.htm

Google Maps

TypeURL Pattern
Placegoogle.com/maps/place/{name}
https://www.google.com/maps/place/Starbucks+Reserve+Roastery

Booking.com

TypeURL Pattern
Hotelbooking.com/hotel/{country}/{slug}.html
https://www.booking.com/hotel/it/grand-excelsior.html
Searchbooking.com/searchresults.html?ss={destination}&checkin={date}&checkout={date}
https://www.booking.com/searchresults.html?ss=Rome&checkin=2026-05-01&checkout=2026-05-03

G2

TypeURL Pattern
Productg2.com/products/{slug}/reviews
https://www.g2.com/products/slack/reviews
Categoryg2.com/categories/{slug}
https://www.g2.com/categories/project-management
scraperHome