Reddit Scraper

Reddit Scraper

Pulls posts from any subreddit or user profile without an API key or login. Point it at a list of sources, pick a sort and time window, and you get back full post data including the body text (selftext), with optional cleaned, TTS-ready narration. Built for people batching Reddit content: short-form video scripts, research datasets, content monitoring.

How it works

Reddit hard-blocks the anonymous .json API but still serves Atom RSS feeds from separate infrastructure that isn't rate-limited the same way, so the default rss method reads those feeds and parses them into structured records. RSS doesn't expose upvote scores or comments, so if you need those, add free Reddit "script" app credentials and the actor switches to the authenticated OAuth endpoint for that data.

Input

Nothing is strictly required. If you pass no sources, the actor falls back to its prefilled examples. The fields you'll actually touch:

Output

Each post is one dataset item. Alongside the metadata you get selftext (the full post body) and, when cleanText is on, a narration field plus ttsSegments split into sentences ready to hand to a text-to-speech step.

Key fields: id, subreddit, title, url, author, score, numComments, createdUtc, over18, selftext, postType, narration, ttsSegments, wordCount, readTimeSeconds, hookScore, fitsShort. When commentLimit is set, a comments array (author, body, score, depth) and fetchedCommentCount are added. Set rawMode if you'd rather have the unshaped Reddit post object.

Example

{
  "sources": ["r/tifu", "r/AskReddit", "u/GallowBoob"],
  "sort": "top",
  "time": "week",
  "maxPostsPerSubreddit": 25,
  "cleanText": true
}

Pricing

$0.50 per 1000 posts, pay per result, no subscription. Steps that use an AI model expect your own OpenAI key.

Notes

Scores and comments are not in the RSS feed. If you need them, create a free script app at reddit.com/prefs/apps and pass redditClientId and redditClientSecret. Anonymous comment fetching is mostly blocked by Reddit and will usually come back empty.