scraper

Getting Started

  • Getting Started

Authentication

  • Authentication

Endpoints

  • POSTScrape
  • GETUsage
  • GETPlatforms

Tools

  • Google
  • Google Maps
  • Trustpilot
  • Tripadvisor
  • Yelp
  • Glassdoor
  • Indeed
  • TikTok
  • YouTube
  • Reddit
  • HackerNews
  • Booking.com
  • G2
  • Twitter
  • LinkedIn
  • Facebook
  • Instagram
  • Threads

MCP

  • MCP Server

Reference

  • Errors
  • Rate Limits

Scrape

Scrape a URL and get structured data back. This is the core endpoint.

POST/api/v1/scrape

Parameters

urlstringrequired

The URL to scrape

Response Schema

requestIdstring

Unique identifier for this request

platformstring

Detected platform (e.g. twitter, reddit)

urlstring

The URL that was scraped

itemsobject[]

Array of scraped items

typestring

Item type (post, comment, etc.)

externalIdstring

Platform-specific ID

parentIdstring | null

Parent item ID for replies

authorstring

Author username

textstring

Item text content

createdAtstring

ISO 8601 timestamp

metricsobject

Engagement metrics (likes, shares, etc.)

Request

curl -X POST https://scraper.run/api/v1/scrape \
-H "Authorization: Bearer sc_live_..." \
-H "Content-Type: application/json" \
-d '{"url": "https://x.com/LLMJunky/status/2036239240300818751"}'

Response Example

{
"requestId": "req_abc123",
"platform": "twitter",
"url": "https://x.com/LLMJunky/status/2036239240300818751",
"items": [
{
"type": "post",
"externalId": "2036239240300818751",
"parentId": null,
"author": "LLMJunky",
"text": "...",
"createdAt": "2026-03-15T10:30:00Z",
"metrics": {
"likes": 639,
"retweets": 39,
"replies": 57
}
}
]
}
Try it
POST /v1/playground
scraperHome