Reddit Scraper for Leads & Pain Points

中文简介 / Chinese summary

• 功能： 抓取 Reddit 帖子、评论、社区、用户资料和搜索结果，用于市场调研、线索发现、舆情监测和用户痛点分析。
• 输入示例： {"startLinks":[{"url":"https://www.reddit.com/r/Bonsai/"}],"totalItemCap":20}
• 计费： 按结果付费（pay-per-result），价格见本页 Pricing 标签；可设置单次运行最大费用以控制支出。
• 支持： 遇到问题请在 Issues 标签提交，并附上输入参数和 Run ID。

Scrape Reddit posts, comments, communities, profiles, leaderboards, and search results for market research, lead discovery, social listening, and pain point monitoring.

Your own residential or mobile proxy is strongly recommended. Reddit blocks shared and datacenter IPs, so without a good proxy many requests return 403 and results can fall back to partial data. Add your proxy URLs in proxyConfiguration.proxyUrls (for example http://user:pass@host:port) for the most complete and reliable runs.

Best for

• Founders and growth teams finding repeated pain points and buying intent
• Market researchers monitoring category discussions and competitor mentions
• Community analysts collecting posts, comments, authors, and subreddit context
• AI workflows that need clean source URLs, text, scores, and discussion metadata

Quick start

Use search mode for a stable lead-research run:

{
  "searchQueries": ["web scraping proxy blocked", "youtube scraper blocked"],
  "searchScope": "posts",
  "sortOrder": "relevance",
  "timeWindow": "month",
  "totalItemCap": 25,
  "postCap": 25,
  "commentCap": 0,
  "lightExtract": true,
  "enableDeduplication": true,
  "failOnNoResults": true,
  "useApifyProxy": true,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Use direct URLs when you already know the subreddit, post, profile, or leaderboard page:

{
  "startLinks": [{ "url": "https://www.reddit.com/r/Bonsai/" }],
  "totalItemCap": 50,
  "postCap": 50,
  "commentCap": 5,
  "scrollWaitSeconds": 1,
  "failOnNoResults": true,
  "useApifyProxy": true
}

Ready-to-run use cases

Copy an input below into the Input tab. All three were run on the live Actor.

1. Pain point monitoring

Find recent complaints about a tool or category. Replace the queries with your own topic. A published example of this run is on the Reddit pain point monitor task.

{
  "searchQueries": ["CRM is too slow", "CRM sync problem", "hate our CRM"],
  "searchScope": "posts",
  "sortOrder": "relevance",
  "timeWindow": "month",
  "totalItemCap": 25,
  "postCap": 25,
  "commentCap": 0,
  "lightExtract": true,
  "enableDeduplication": true,
  "includeNSFW": false,
  "failOnNoResults": true,
  "useApifyProxy": true,
  "proxyConfiguration": { "useApifyProxy": true }
}

2. Buying intent detection

Catch people asking for alternatives or recommendations, newest first. Run it on a daily schedule to get a fresh lead list.

{
  "searchQueries": [
    "alternative to HubSpot",
    "looking for a CRM recommendation",
    "switching from Salesforce"
  ],
  "searchScope": "posts",
  "sortOrder": "new",
  "timeWindow": "week",
  "totalItemCap": 25,
  "postCap": 25,
  "commentCap": 0,
  "lightExtract": true,
  "enableDeduplication": true,
  "includeNSFW": false,
  "failOnNoResults": true,
  "useApifyProxy": true,
  "proxyConfiguration": { "useApifyProxy": true }
}

3. Subreddit tracking

Follow the latest posts of one community. Reddit blocks direct subreddit pages from datacenter IPs, so this input uses residential proxies (available on Apify plans that include residential proxy).

{
  "startLinks": [{ "url": "https://www.reddit.com/r/Bonsai/" }],
  "totalItemCap": 25,
  "postCap": 25,
  "commentCap": 0,
  "lightExtract": true,
  "enableDeduplication": true,
  "includeNSFW": false,
  "failOnNoResults": true,
  "useApifyProxy": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Common workflows

• Pain point mining: search for complaints, blockers, alternatives, and recommendations; export headline, textBody, permalink, and scores.
• Competitor monitoring: track mentions of competitors across subreddits and time windows.
• Community research: collect posts and comments from specific subreddits, profiles, leaderboards, or multireddits.
• AI source collection: keep sourceInput, permalink, author, subreddit, and timestamps for traceable summaries.

Useful input fields

Field	Use
searchQueries	One or more Reddit search queries.
searchScope	Search posts or communities.
sortOrder, timeWindow	Control relevance and recency.
startLinks	Direct Reddit URLs.
totalItemCap, postCap, commentCap	Keep costs and runtime bounded.
lightExtract	Faster records for lead and pain point monitoring.
enablePagination	Continue beyond first pages when needed.
useApifyProxy	Recommended for cloud runs.

Output fields

The dataset can include:

• headline
• textBody
• permalink
• communityName
• communityTag
• author
• score
• voteScore
• commentTotal
• publishedAt
• comments
• profileUrl
• sourceInput
• listingUrl
• scrapedAt

Settings that convert best

• Prefer focused searchQueries over broad subreddit crawls for first runs.
• Start with lightExtract: true and commentCap: 0.
• Add comments only after the post-level output looks useful.
• Use failOnNoResults: true for scheduled monitoring.
• Keep caps explicit so runs cannot grow unexpectedly.

Limitations

Reddit can block, delay, or alter public responses. The Actor uses fallback paths, but some records can be partial. Each record has a source field: absent for direct Reddit data, rss_fallback for Reddit RSS records, and duckduckgo_fallback for search-engine discovery, which can lack score, date, and comment data. The run log and status message show how many results came from fallback paths. Keep source URLs, timestamps, and quality warnings when feeding results to AI, CRM, or dashboards.

Support

If a run returns unexpected data, open an issue from the Actor page with the input used, the run ID, and the result you expected.