scraper

Getting Started

  • Getting Started

Authentication

  • Authentication

Endpoints

  • POSTScrape
  • GETUsage
  • GETPlatforms

Tools

  • Airbnb
  • Booking.com
  • Facebook
  • G2
  • Glassdoor
  • Google
  • HackerNews
  • hCaptcha
  • Indeed
  • Instagram
  • LinkedIn
  • Naukri
  • Reddit
  • Threads
  • TikTok
  • Tripadvisor
  • Trustpilot
  • Twitter
  • Upwork
  • Yahoo Finance
  • Yelp
  • YouTube

MCP

  • MCP Server

Reference

  • Errors
  • Rate Limits

Scrape

Scrape a URL and get structured data back. This is the core endpoint.

POST/api/v1/scrape

Parameters

urlstringrequired

The URL to scrape

Response Schema

requestIdstring

Unique identifier for this request

platformstring

Detected platform (e.g. twitter, reddit)

urlstring

The URL that was scraped

itemsobject[]

Array of scraped items

typestring

Item type (post, comment, etc.)

externalIdstring

Platform-specific ID

parentIdstring | null

Parent item ID for replies

authorstring

Author username

textstring

Item text content

createdAtstring

ISO 8601 timestamp

metricsobject

Engagement metrics (likes, shares, etc.)

truncatedboolean

Present as true when the service limits the result. Omitted otherwise.

totalRepliesnumber

Legacy field name for the total replies or results reported or estimated by the platform. Present only for a truncated response when known.

Request

curl -X POST https://scraper.run/api/v1/scrape \
-H "Authorization: Bearer sc_live_..." \
-H "Content-Type: application/json" \
-d '{"url": "https://x.com/LLMJunky/status/2036239240300818751"}'

Response Example

{
"requestId": "req_abc123",
"platform": "twitter",
"url": "https://x.com/LLMJunky/status/2036239240300818751",
"items": [
{
"type": "post",
"externalId": "2036239240300818751",
"parentId": null,
"author": "LLMJunky",
"text": "...",
"createdAt": "2026-03-15T10:30:00Z",
"metrics": {
"likes": 639,
"retweets": 39,
"replies": 57
}
}
],
"truncated": true,
"totalReplies": 57
}
Try it
POST /v1/playground
scraperHome