# Google Search Results Scraper — SERP API (`webdatatools/google-search-scraper`) Actor Google Search Results Scraper returns organic titles, real destination URLs and snippets through the Apify GOOGLE_SERP proxy. One row per accepted SERP page; failures go to diagnostics. Verified zero-result pages remain billable pages. - **URL**: https://apify.com/webdatatools/google-search-scraper.md - **Developed by:** [Murat Uzun](https://apify.com/webdatatools) (community) - **Categories:** SEO tools, Lead generation, AI - **Features:** Limited permissions - **Stats:** 41 total users, 17 monthly users, 93.3% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $4.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ### What is Google Search Results Scraper? Google Search Results Scraper is an Apify Actor that fetches Google search result pages (SERPs) and returns **organic results with real, ready-to-click destination URLs** as one clean, structured row per page. It works through the Apify Proxy `GOOGLE_SERP` group — the proxy pool Google accepts requests through — asking for Google's `&gbv=1` ("basic HTML") rendering, whose links can be a decodable `/url?q=` redirect or an opaque `/url?q=` wrapper. The modern page can use opaque `/goto?url=` click trackers. The Actor decodes clear destinations and follows Google's own redirect for opaque wrappers, so `url` is the full destination either way, never a domain guessed from the breadcrumb. Priced **per accepted SERP page, not per organic listing**. Filter by date range, site, file type or exact phrase, and page through up to 10 result pages per query. **Pricing:** Google Search Results Scraper costs **$5.00 per 1,000 results** (pay per result, no subscription; Apify's free plan credit covers small runs). ### What data does Google Search Results Scraper extract? Google Search Results Scraper extracts the organic result list for every query/page combination you give it: | Field | Type | Description | | ---------------------------------------------------------------------------------------------- | ----------------- | ---------------------------------------------------------------------------------------------- | | `query`, `page`, `countryCode`, `languageCode`, `device` | string, number | The request that produced this row | | `searchUrl` | string | The exact Google URL fetched through the proxy | | `organicResults`, `organicCount` | array, number | `{position, title, url, displayedUrl, snippet, date, sitelinks[]}` per organic listing | | `peopleAlsoAsk`, `relatedSearches`, `ads`, `adCount`, `featuredSnippet`, `knowledgePanelTitle` | array/object/null | Parsed when present — see the FAQ, they are near-always empty on this Actor's leaner rendering | | `totalResultsText`, `htmlLength` | string, number | Google's own results-count text (rarely present) and the raw HTML size fetched | | `error`, `scrapedAt` | string | Null on accepted result pages; failures are in diagnostics, plus the ISO timestamp | ### Result quality and billing Each SERP page uses one proxy attempt, with no automatic paid-proxy retry. That request can wait up to 60 seconds, shortened when the run deadline is closer. Google result-link redirects use at most six direct attempts per unique link, within the same run deadline; they do not fetch a new SERP page. Explicit Google refresh waits up to 30 seconds are honored before following the new link. After two rejected pages in a run, the Actor stops starting queued pages and lets in-flight pages finish. Effective concurrency is capped at 3 (older inputs up to 10 are still accepted). Completed, accepted pages are kept; an all-rejected run fails. Inspect `OUTPUT.costGuardTriggered`, `costSkippedPages`, `rejectedPages` and `serpRequestAttempts` before retrying skipped queries. These counters describe the current process attempt, not cumulative migration/restart totals. Defaults use 256 MB memory. This limits avoidable usage; unsuccessful requests and in-flight work can still have costs. Only accepted SERP pages enter the default dataset. `resultStatus` distinguishes `results` (organic listings with non-empty titles and real destination URLs), `no_results` (an explicit Google no-match message), and `features_only` (useful SERP widgets without organic listings). A verified zero-result page is still a billable SERP page. A small or large unknown page, blocked page, failed fetch or page with missing organic destination URLs is stored as a unique `DIAGNOSTIC-*` record instead. `OUTPUT` lists confirmed results, diagnostics and partial/delivery state; inspect it as well as the run status. Diagnostics do not generate the default-dataset result event. The start fee and applicable platform/proxy usage may still apply. Check the live **Pricing** tab for your plan. The initial result allowance caps how many source pages are attempted, in query/page order; rejected pages are not replaced with extra proxy requests. All rejected attempts fail the run unless it was deliberately stopped for time or aborted. An empty query list never starts an example search. Counts apply to the current process attempt; migration/restart deduplication is not claimed. ### How to use Google Search Results Scraper 1. Enter your search terms into **Search queries**, e.g. `apify web scraping`. One row comes back per query per result page. 2. Set **Max pages per query** (up to 10) if you need more than the first ~10 results — Google returns about 10 per page. 3. Optionally narrow the search with **Date range**, **Only this site**, **File type** or **Exact phrase**. 4. Pick **Device** (desktop or mobile User-Agent), click **Start**, then export as JSON, CSV, Excel or HTML — every `organicResults[].url` is the full destination link, ready to open or crawl further (pages with missing organic destination URLs go to diagnostics instead of the paid dataset). ### Example input ```json { "queries": ["apify web scraping", "best crm for startups"], "countryCode": "us", "languageCode": "en", "resultsPerPage": 10, "maxPagesPerQuery": 1, "device": "desktop" } ``` ### Example output ```json { "query": "apify web scraping", "page": 1, "device": "desktop", "searchUrl": "http://www.google.com/search?q=apify+web+scraping&hl=en&gl=us&num=10&gbv=1", "organicResults": [ { "position": 1, "title": "Apify: The largest marketplace of trusted tools for AI", "url": "https://apify.com/", "displayedUrl": "apify.com", "snippet": "68,172 tools for your AI ... Apify is the largest marketplace of trusted tools for AI. Get real-time...", "date": null, "sitelinks": [] }, { "position": 2, "title": "Apify - GitHub", "url": "https://github.com/apify", "displayedUrl": "github.com › apify", "snippet": null, "date": null, "sitelinks": [] } ], "organicCount": 6, "peopleAlsoAsk": [], "relatedSearches": [], "adCount": 0, "error": null, "scrapedAt": "2026-09-12T18:23:45.000Z" } ``` ### Input parameters | Parameter | Type | Default | Description | | ------------------------ | ------- | ------------------------ | --------------------------------------------------------- | | `queries` | array | `["apify web scraping"]` | Search queries, one or more result pages per query | | `countryCode` | string | `"us"` | 2-letter country code (`gl`) | | `languageCode` | string | `"en"` | 2-letter language code (`hl`) | | `resultsPerPage` | integer | `10` | Sent as `num`; Google currently returns ~10 per page anyway | | `maxPagesPerQuery` | integer | `1` | Result pages fetched per query (1-10), ~10 results each | | `dateRange` | string | — | `hour`, `day`, `week`, `month` or `year` (`tbs=qdr:`) | | `site` | string | — | Adds `site:` to every query, e.g. `reddit.com` or `gov` | | `fileType` | string | — | Adds `filetype:` to every query, e.g. `pdf` | | `exactPhrase` | string | — | Adds a quoted phrase every result must contain | | `device` | string | `"desktop"` | `desktop` or `mobile` User-Agent | | `includePeopleAlsoAsk` | boolean | `true` | Parse People Also Ask when Google renders it (modern page only, see FAQ) | | `includeRelatedSearches` | boolean | `true` | Parse related searches when Google renders them | | `safeSearch` | boolean | `false` | Request SafeSearch filtering | | `maxConcurrency` | integer | `3` | Effective parallel pages 1-3; legacy values up to 10 are capped at 3 | | `debugHtml` | boolean | `false` | Save every fetched Google page as `PAGE_.html` in the key-value store (for bug reports) | There is no proxy configuration input — every request goes through the Apify Proxy `GOOGLE_SERP` group automatically, and that proxy cost is already included in the price below. ### Search filters and more than 10 results per query The filters are applied to every query in the run: `dateRange` sets Google's "Any time" filter (`tbs=qdr:h/d/w/m/y`), and `site`, `fileType` and `exactPhrase` add `site:`, `filetype:` and a quoted phrase to the query. The row's `searchUrl` shows exactly what was sent. Measured on Apify on 9 October 2026: - `climate` with `exactPhrase: "annual report"`, `site: "gov"`, `fileType: "pdf"` and `dateRange: "year"`: page 1 had 10 results, all on `.gov` sites, all dated between 21 October 2025 and 29 September 2026, with PDF page counts in the snippets. - **Paging past the first 10:** `pizza delivery` with `maxPagesPerQuery: 2` gave 8 results on page 1 and 10 more on page 2, with no title repeated. Each page is one row and one billed SERP page. - **`resultsPerPage` above 10 does not help:** with `resultsPerPage: 100` Google returned 9 results. Pages are therefore requested at `start=10, 20, …` whatever `resultsPerPage` says, so no results are skipped between pages; use `maxPagesPerQuery` for depth. A page whose proxy request times out is saved to diagnostics, outside the result dataset. Successful pages are retained; an entirely rejected run fails unless it was deliberately stopped. ### Pricing Google Search Results Scraper uses a **result** event per accepted Google SERP page, rather than per organic listing. The Free-plan rate is **$0.005 per page ($5.00 per 1,000 accepted pages)**; the paid-plan rate is $0.0045 per page in the pricing checked on October 28, 2026. The actor-start event is $0.00005 per event, with one event per GB of memory and a minimum of one. The live **Pricing** tab is authoritative. Failed, blocked, unrecognised and missing-destination pages go to diagnostics without a result event. Explicitly verified zero-result pages remain billable. Therefore accepted result count can be lower than queries × pages. Set **Maximum cost per run** (`maxTotalChargeUsd`); the Actor caps source attempts at the initial result allowance and stops before its timeout where possible. ### Google Search Results Scraper vs. apify/google-search-scraper Both Actors are pay-per-event and bill per Google results page, so the cost is easy to estimate up front either way; `apify/google-search-scraper` adds optional paid add-ons (such as AI Overview capture) and many more SERP features. Google Search Results Scraper is deliberately simple: one result event per accepted query page, plus the start event, and `organicResults[].url` is the full destination link on both Google layouts, rather than the opaque click-tracker link many scrapers pass through unresolved. The trade-off is that People Also Ask, ads and related searches are often empty (see the FAQ) — pick this Actor when you need clean organic URLs, not SERP widgets. ### Using Google Search Results Scraper with AI agents and MCP Google Search Results Scraper is pay-per-event with limited permissions — the two requirements for an Actor to be callable through the Apify MCP server at `mcp.apify.com`. An agent passes `queries` and gets back structured organic results with real destination URLs per page — ready for competitive research, content-gap analysis, or a lead-generation pipeline that needs to actually visit or crawl the result. The same run works from n8n, Make, Zapier and LangChain through Apify's integrations. **Short timeouts save completed results where possible.** Accepted SERP pages are saved in task order as earlier pages finish or are skipped. When the run's `timeout` is close (the last 10 s, or 5 % of a longer run, at most 2 min) the Actor starts no new pages, saves everything it has and attempts to finish with a status message such as `Stopped early before the run timeout: 12 of 40 SERP page(s) done…`. Read the run's `statusMessage` to tell a complete result from a partial one. **Sizing a run.** A SERP page takes about 1–3 s (rarely up to ~7 s) and `maxConcurrency` pages run in parallel, plus ~5 s start-up: 30 pages at the default concurrency of 3 fit comfortably in a 60-second `timeout`; for hundreds of pages raise `maxConcurrency` or the timeout. `maxTotalChargeUsd` caps the cost — the Actor fetches only as many pages as the budget covers (using your plan’s live page rate after the start fee) and says so in the status message. ### FAQ **Which Google page does the Actor get, and how does `url` get the full link?** Every request asks for Google's `&gbv=1` ("basic HTML") page. Clear `/url?q=` destinations are decoded. On October 28, 2026, a captured basic page also used opaque `CAES…` tokens in `/url?q=`; these are resolved through Google's own redirect, like modern `/goto?url=` links. Google often ignores that and serves its modern JavaScript page instead: on 9 October 2026, 11 of 16 test fetches came back modern, and which one arrives varies by query and over minutes, not reliably by User-Agent (Lynx, Opera Mini and IE6 User-Agents were tried). On the modern page every result link is `/goto?url=`, an encrypted token with no destination in the page. For those the Actor uses a bounded sequence of direct requests to Google's own redirect and reads the destination from its answer. In a 9 October cloud check (3 queries, one page each: 2 basic pages, 1 modern page) all 25 organic results had their full URL, including all 7 from the modern page. **What happens if a destination URL cannot be resolved?** The whole affected SERP page is saved as a `DIAGNOSTIC-*` record with its available data, without a default-dataset result event. A breadcrumb is never substituted for the destination URL. An HTTP200 response may instruct a timed refresh to a new Google tracking URL. The Actor waits the stated delay (up to 10 seconds) and follows that wrapper within the existing maximum of three requests per distinct original link. Loops, ambiguous refreshes and unrecognized pages remain unresolved; JavaScript is not executed and the destination website is not fetched. Direct redirect lookups share a maximum of three concurrent requests across the Actor, independently of page-fetch concurrency. `OUTPUT` records their response-status counts without storing tracker tokens. Check `OUTPUT` and diagnostics if a run delivers fewer accepted pages than requested. **Why are `peopleAlsoAsk`, `relatedSearches`, `ads` and `featuredSnippet` often empty?** Google's basic `&gbv=1` page does not include those widgets at all. The modern page usually carries People Also Ask questions, so `peopleAlsoAsk` is filled on the pages where Google served it; ads and related searches are rarely parsed. Which layout a page gets is Google's choice (previous question), so do not rely on these fields — pick this Actor for organic results. **Is a page with a cookie-consent banner a failure?** No. The modern page sometimes carries a "Before you continue to Google" dialog on top of complete results; the Actor parses the results underneath. Only a consent page with no results is reported as blocked. **What happens if Google shows a CAPTCHA or a consent page with no results?** The row's `error` says so (`"Blocked by Google (captcha page detected)..."`) and the raw HTML is saved to the run's key-value store as `DEBUG_.html` so it can be inspected; lower **Max concurrency** and try again later. **What if Google changes its markup?** Every selector has 2-3 fallbacks. If a page still comes back with 0 organic results despite being a real (large) response, the row gets `error: "Could not parse results (markup changed?)"` and the HTML is likewise saved as `DEBUG_.html` — open an issue with that file attached. **Is this legal to run?** Scraping publicly visible search results is generally lower-risk than scraping logged-in content, but you are responsible for complying with Google's Terms of Service and your local laws for your use case. **Can I export to CSV or Excel?** Yes, from the Output tab or the API, with a ready-made **Overview** view. ### Related Actors Part of the **webdatatools** web-intelligence suite — every Actor is pay-per-event, reads public data without a login, and returns one clean row per entity: Browse the whole suite at [webdatatools](https://paulet4a-commits.github.io/webdatatools/), or call ten of these Actors straight from Claude, Cursor or Cline with the [webdatatools MCP server](https://github.com/paulet4a-commits/webdatatools-mcp-server). **Website & domain intelligence** - [Email Extractor — Website Contact & Social Finder](https://apify.com/webdatatools/contact-extractor) — e-mails, phones and social profiles per domain - [Tech Stack Detector — Wappalyzer & BuiltWith Alternative](https://apify.com/webdatatools/tech-stack-detector) — CMS, e-commerce, analytics, pixels and payments per domain - [Domain DNS & Email Security Checker](https://apify.com/webdatatools/dns-email-security-checker) — SPF, DKIM, DMARC, MX provider, registrar and domain age - [Domain Security Audit (TLS, HTTP headers, redirects, robots)](https://apify.com/webdatatools/domain-security-audit) — TLS expiry, security headers, redirect chain, robots and llms.txt - [Subdomain Finder (Certificate Transparency)](https://apify.com/webdatatools/subdomain-finder) — every subdomain seen in CT logs, with a live DNS check - [Bulk Core Web Vitals & PageSpeed Audit](https://apify.com/webdatatools/core-web-vitals-audit) — Lighthouse scores, LCP, CLS, INP and top fixes per URL - [On-Page SEO Audit](https://apify.com/webdatatools/seo-page-audit) — title, meta, headings, links, images and schema issues per page - [Sitemap URL Extractor & Change Monitor](https://apify.com/webdatatools/sitemap-extractor) — every sitemap URL, or new and removed pages between runs - [Wayback Machine Snapshot & Page Change Tracker](https://apify.com/webdatatools/wayback-page-diff) — how a page changed over time, or every archived snapshot - [Bulk Domain WHOIS & RDAP Lookup](https://apify.com/webdatatools/domain-whois-rdap) — registrar, dates, status and nameservers per domain - [Web Scraper — CSS Selector & Data Extractor](https://apify.com/webdatatools/css-selector-extractor) — pull any CSS selector off any page, one row per URL - [Website Screenshot Generator](https://apify.com/webdatatools/website-screenshot) — full-page or viewport PNG/JPEG screenshots of any URL **Content for AI, LLMs and RAG** - [AI Web Search & Read: Google results as clean Markdown](https://apify.com/webdatatools/ai-web-search) — a query turned into clean Markdown from the top search results - [Website to Markdown — Content Crawler for LLM & RAG](https://apify.com/webdatatools/website-to-markdown) — any site as clean Markdown per page, no browser - [llms.txt Generator (Website to llms.txt & llms-full.txt)](https://apify.com/webdatatools/llms-txt-generator) — llms.txt and llms-full.txt for any website or docs site - [PDF to Markdown Converter (Text, Headings, Metadata)](https://apify.com/webdatatools/pdf-to-markdown) — PDF files to clean Markdown with headings, metadata and token counts - [RAG Text Chunker (Markdown to Chunks, Token Counts)](https://apify.com/webdatatools/rag-text-chunker) — heading-aware RAG chunks with exact GPT token counts from any dataset - [Article & News Extractor (clean text, author, date, markdown)](https://apify.com/webdatatools/article-extractor) — clean article text, author, date and Markdown per URL - [Structured Data & JSON-LD Extractor (Schema.org, Open Graph)](https://apify.com/webdatatools/structured-data-extractor) — Schema.org and Open Graph data from any page - [Google News Scraper (RSS search by keyword, topic, site)](https://apify.com/webdatatools/google-news-scraper) — news results by keyword, topic or site - [Press Release Monitor: PR Newswire, BusinessWire, GlobeNewswire](https://apify.com/webdatatools/press-release-monitor) — PR Newswire, Business Wire and GlobeNewswire releases **Search, video and social** - [YouTube Shorts Scraper](https://apify.com/webdatatools/youtube-shorts-scraper) — Shorts from channels, hashtags and searches with view counts - [Pinterest Pins Scraper](https://apify.com/webdatatools/pinterest-pins-scraper) — latest pins of public Pinterest profiles and boards - [YouTube Transcript Scraper](https://apify.com/webdatatools/youtube-transcript-scraper) — captions and subtitles as text + timed segments, per video or channel - [YouTube Comments Scraper — Comments & Replies](https://apify.com/webdatatools/youtube-comments-scraper) — comments and replies with likes, no API key - [YouTube Channel Latest Videos (RSS, no API key)](https://apify.com/webdatatools/youtube-channel-videos) — the latest 15 videos of any channel from RSS - [YouTube Channel Scraper (videos, shorts, live)](https://apify.com/webdatatools/youtube-channel-scraper) — a channel's full video, shorts and stream list - [YouTube Search Results Scraper (videos, channels, no API key)](https://apify.com/webdatatools/youtube-search-scraper) — videos, channels and playlists per query - [YouTube Video Details Scraper (views, likes, description, tags)](https://apify.com/webdatatools/youtube-video-details) — views, likes, description, tags and chapters per video - [Apple Podcasts Lookup & Episodes Scraper](https://apify.com/webdatatools/podcast-lookup) — podcast metadata and episodes from iTunes and RSS - [Bluesky Post, Search & Profile Scraper](https://apify.com/webdatatools/bluesky-scraper) — posts, profiles, followers and threads from the AT Protocol API - [X Tweet Scraper (Twitter Posts by URL, No Login)](https://apify.com/webdatatools/x-tweet-scraper) — X (Twitter) posts by URL with likes, replies, author, media and MP4 links - [TikTok Profile Scraper (Followers, Likes, Bio, Video Stats)](https://apify.com/webdatatools/tiktok-profile-scraper) — TikTok profiles with exact follower and like counts, plus video stats - [Telegram Channel Posts Scraper](https://apify.com/webdatatools/telegram-channel-scraper) — posts, views and media flags from any public channel - [Substack Publication & Posts Scraper](https://apify.com/webdatatools/substack-scraper) — archive, authors and paywall status per publication - [Google Play Reviews Scraper](https://apify.com/webdatatools/google-play-reviews-scraper) — reviews, ratings, replies and app versions per app - [App Store Reviews Scraper](https://apify.com/webdatatools/app-store-reviews-scraper) — iOS reviews and ratings per app and country - [Trustpilot Reviews Scraper (Ratings, Replies, No Login)](https://apify.com/webdatatools/trustpilot-reviews-scraper) — Trustpilot reviews with stars, full text, verification and company replies - [Google Trends Scraper](https://apify.com/webdatatools/google-trends-scraper) — interest over time, by region, and related queries per keyword - [Google Ads Transparency Scraper](https://apify.com/webdatatools/google-ads-transparency-scraper) — ads any advertiser runs on Google, with format and dates - [Keyword Suggestions Scraper (Google, YouTube, Amazon, Bing)](https://apify.com/webdatatools/keyword-suggestions-scraper) — autocomplete keyword ideas from four search engines - [Bilibili Scraper (Videos, Search, Popular)](https://apify.com/webdatatools/bilibili-scraper) — Chinese video platform: views, likes, coins, danmaku, uploader - [Mastodon Scraper (Hashtags, Accounts, Trending)](https://apify.com/webdatatools/mastodon-scraper) — public fediverse posts by hashtag, account or trending - [Meetup Events Scraper (Search by Keyword & City)](https://apify.com/webdatatools/meetup-events-scraper) — upcoming events with RSVPs, fees, venues and groups - [Eventbrite Scraper (Events by Keyword & City)](https://apify.com/webdatatools/eventbrite-scraper) — events by keyword and city with venue, dates and organizer **Leads, jobs and company data** - [Career Site Jobs API (Greenhouse, Lever, Ashby, Workday +1)](https://apify.com/webdatatools/career-site-jobs-api) — company domains in, their open jobs out, ATS detected automatically - [Workday Jobs Scraper](https://apify.com/webdatatools/workday-jobs-scraper) — jobs with full descriptions from any Workday career site - [Google Maps Scraper](https://apify.com/webdatatools/google-maps-scraper) — businesses with phone, website, address, rating and coordinates per search - [2GIS Places Scraper (Phones, Websites, Ratings, Hours)](https://apify.com/webdatatools/2gis-places-scraper) — 2GIS businesses in Russia, Kazakhstan, UAE and more with phones, website, rating and hours - [LinkedIn Jobs Scraper](https://apify.com/webdatatools/linkedin-jobs-scraper) — job titles, companies, locations and full descriptions from LinkedIn job search - [Company 360: full company profile from a domain](https://apify.com/webdatatools/company-360) — one row per domain: contacts, tech, security, hiring and company facts - [Hiring Signals Scraper (Greenhouse, Lever, Ashby, Workable)](https://apify.com/webdatatools/hiring-signals) — open jobs and hiring velocity from 10 public ATS boards - [Y Combinator Companies & Founders Scraper](https://apify.com/webdatatools/yc-companies-scraper) — YC startups by batch, industry and hiring status - [Wikidata Entity & Company Enrichment (facts, IDs, links)](https://apify.com/webdatatools/wikidata-entity-enrichment) — HQ, founders, employees, revenue and social IDs per company - [Email Validator & Verifier — Bulk Email Check](https://apify.com/webdatatools/email-validator) — syntax, MX, disposable, role and free-provider checks - [OpenStreetMap POI Extractor (Overpass API: shops, amenities)](https://apify.com/webdatatools/overpass-poi-extractor) — shops and amenities by radius, bbox or area - [Stock, Crypto & FX Quotes](https://apify.com/webdatatools/market-quotes) — one row per symbol from Yahoo, Binance and ECB rates - [Yahoo Finance Scraper (Quotes, Fundamentals, Financials, News)](https://apify.com/webdatatools/yahoo-finance-scraper) — Yahoo Finance fundamentals, analyst targets, financial statements, ownership, news and history per ticker - [DexScreener Scraper (DEX Pairs, Prices, Liquidity, Boosts)](https://apify.com/webdatatools/dexscreener-scraper) — DEX pairs with price, volume, liquidity, FDV and boosted tokens across chains - [Polymarket Scraper (Prediction Markets, Odds, Volume)](https://apify.com/webdatatools/polymarket-scraper) — Polymarket markets and events with outcome prices, volume and liquidity - [StockTwits Scraper (Messages, Sentiment, Trending)](https://apify.com/webdatatools/stocktwits-scraper) — StockTwits messages with Bullish/Bearish sentiment and trending symbols - [Economic Calendar Scraper (Forex Events, Impact, Forecasts)](https://apify.com/webdatatools/economic-calendar-scraper) — This week's macro events with impact, forecast and previous values - [Crypto Fear & Greed Index](https://apify.com/webdatatools/crypto-fear-greed-index) — Daily Crypto Fear & Greed Index values with full history - [Remote Jobs Aggregator (RemoteOK, WWR, Hacker News)](https://apify.com/webdatatools/remote-jobs-aggregator) — one clean row per remote job, de-duplicated across feeds - [Greenhouse Jobs Scraper](https://apify.com/webdatatools/greenhouse-jobs-scraper) — jobs with descriptions from any Greenhouse job board - [Lever Jobs Scraper](https://apify.com/webdatatools/lever-jobs-scraper) — jobs with descriptions from any Lever careers page - [Ashby Jobs Scraper](https://apify.com/webdatatools/ashby-jobs-scraper) — jobs, salaries and descriptions from any Ashby job board - [SmartRecruiters Jobs Scraper](https://apify.com/webdatatools/smartrecruiters-jobs-scraper) — jobs with descriptions from any SmartRecruiters company - [Seek Jobs Scraper (Australia & New Zealand)](https://apify.com/webdatatools/seek-jobs-scraper) — Seek job ads with salary, work type and location - [Dice Jobs Scraper](https://apify.com/webdatatools/dice-jobs-scraper) — US tech jobs from Dice with salary and remote flag - [AutoScout24 Scraper](https://apify.com/webdatatools/autoscout24-scraper) — European car listings with price, mileage and seller - [Rightmove Scraper](https://apify.com/webdatatools/rightmove-scraper) — UK property for sale or rent with price and agent - [Wellfound Jobs Scraper (AngelList Startup Jobs)](https://apify.com/webdatatools/wellfound-jobs-scraper) — startup jobs with salary and equity ranges, company size and stage - [Yandex Maps Scraper (Places, Ratings, Phones)](https://apify.com/webdatatools/yandex-maps-scraper) — businesses in Russia, Türkiye and the CIS with phones, ratings, hours - [Craigslist Scraper (Listings, Prices, Locations)](https://apify.com/webdatatools/craigslist-scraper) — listings in any area and category with price, date and coordinates - [JobStreet Scraper (Malaysia, Singapore, PH, ID + JobsDB)](https://apify.com/webdatatools/jobstreet-scraper) — JobStreet and JobsDB jobs in 6 Asian countries with parsed salaries - [InfoJobs Scraper (Spain Jobs, Salaries, Companies)](https://apify.com/webdatatools/infojobs-scraper) — Spanish jobs with salary range, contract type and full description - [StepStone Scraper (Germany, Austria, Belgium Jobs)](https://apify.com/webdatatools/stepstone-scraper) — StepStone jobs in Germany, Austria and Belgium by keyword and city - [Naukri Jobs Scraper (Salary, Skills, Company Rating)](https://apify.com/webdatatools/naukri-jobs-scraper) — Naukri.com jobs in India with salary range, experience, skills and company rating - [Zillow Scraper (Homes for Sale, Rent & Sold, Zestimates)](https://apify.com/webdatatools/zillow-scraper) — Zillow homes for sale, rent or sold with Zestimates, beds, baths and photos - [Zillow Home Details Scraper (Description, Photos, History)](https://apify.com/webdatatools/zillow-detail-scraper) — full Zillow property pages: description, photos, HOA, tax rate, agent - [Redfin Scraper (Homes for Sale, Prices, Details)](https://apify.com/webdatatools/redfin-scraper) — US homes for sale or sold from any Redfin search, with price and details - [Kleinanzeigen Scraper (Ads, Prices, Locations)](https://apify.com/webdatatools/kleinanzeigen-scraper) — German classifieds with price, VB flag, ZIP, city and seller type **Developer, app and research data** - [npm, PyPI & Crates.io Package Health Checker](https://apify.com/webdatatools/package-health-checker) — releases, downloads, deprecation and a health score - [GitHub Repository Health & Activity Report](https://apify.com/webdatatools/github-repo-health) — stars, commits, contributors and risk flags per repo - [VS Code Marketplace Extension Scraper (installs, ratings)](https://apify.com/webdatatools/vscode-marketplace-extensions) — installs, ratings and versions per extension - [Chrome Web Store Extension Scraper (installs, ratings)](https://apify.com/webdatatools/chrome-web-store-extensions) — users, rating, version and developer per extension - [Google Play Scraper](https://apify.com/webdatatools/google-play-scraper) — apps, ratings, installs, developer contact and reviews - [App Store (iOS) App Metadata, Ratings & Top Charts Lookup](https://apify.com/webdatatools/app-store-lookup) — ratings, price, version and charts per app - [CrossRef DOI & Citation Metadata Lookup](https://apify.com/webdatatools/crossref-doi-lookup) — papers, authors, journals and citation counts - [FDA Recalls & Adverse Events Monitor (openFDA)](https://apify.com/webdatatools/openfda-recall-monitor) — food, drug and device recalls from openFDA - [iCal / ICS Calendar Feed to Events Extractor](https://apify.com/webdatatools/ical-calendar-extractor) — any public calendar feed as event rows - [Shopify Store Products Scraper](https://apify.com/webdatatools/shopify-products-scraper) — catalog, prices, variants and stock per store - [Hacker News Search & Front Page Scraper](https://apify.com/webdatatools/hacker-news-scraper) — stories, comments and points by query or front page - [GitHub Trending Repositories Scraper](https://apify.com/webdatatools/github-trending-scraper) — trending repos and developers by language and period - [Stack Overflow & Stack Exchange Q\&A Scraper](https://apify.com/webdatatools/stackexchange-scraper) — questions, answers and scores by query, tag or site - [Bulk Image Downloader](https://apify.com/webdatatools/bulk-image-downloader) — download image URLs to storage with size, dimensions and a ZIP - [Google Flights Scraper (Prices, Airlines, Stops)](https://apify.com/webdatatools/google-flights-scraper) — flight prices, airlines, times, stops and CO2 by route and date - [Google Hotels Scraper (Prices, Ratings, Reviews)](https://apify.com/webdatatools/google-hotels-scraper) — hotel prices per night, stars, rating and reviews by city and dates - [Booking.com Scraper (Hotel Prices, Ratings, Availability)](https://apify.com/webdatatools/booking-scraper) — Booking.com hotels for any city and dates with prices, scores and deals - [Airbnb Scraper (Listings, Prices, Ratings, Coordinates)](https://apify.com/webdatatools/airbnb-scraper) — Airbnb stays for any city and dates with prices, ratings and coordinates - [AliExpress Scraper (Search Products & Prices)](https://apify.com/webdatatools/aliexpress-scraper) — AliExpress search results with USD price, discount and rank - [Lazada Scraper (Products, Prices, Sold, Ratings)](https://apify.com/webdatatools/lazada-scraper) — Lazada products in 6 countries with price, rating, units sold and seller - [Trendyol Scraper (Turkey Products, Prices, Ratings)](https://apify.com/webdatatools/trendyol-scraper) — Trendyol products with price, basket discount, rating and promotions ### Support and feedback Found a query pattern that returns a parse error, a selector Google changed, or a field worth adding? Open an issue on the **Issues** tab — attach the `DEBUG_.html` file from the run's key-value store if you have one. # Actor input Schema ## `queries` (type: `array`): Enter the Google search queries to scrape, e.g. apify web scraping. One dataset row is returned per accepted query/page. Verified zero-result pages remain billable; fetch, block, parsing and missing-destination failures are stored separately in diagnostics. Rows are saved as they finish; if the run timeout is near, the Actor stops early and still ends SUCCEEDED with the pages done so far. ## `countryCode` (type: `string`): Enter the 2-letter country code Google should localise results for, e.g. us, gb, de. Sent as the gl parameter. ## `languageCode` (type: `string`): Enter the 2-letter interface language code, e.g. en, es, fr. Sent as the hl parameter and affects snippet language. ## `resultsPerPage` (type: `integer`): Sent to Google as num, e.g. 10. Google currently ignores it and returns about 10 organic results per page (a 9 Oct 2026 test with 100 gave 9), so use Max pages per query to get more results. ## `maxPagesPerQuery` (type: `integer`): Enter how many result pages to fetch per query, e.g. 1. Each extra page is the next ~10 results (start=10, 20, …) and a separate billed SERP page. Total pages = queries x this value; when choosing the run timeout, allow about 2 s per page divided by Max concurrency. ## `dateRange` (type: `string`): Optional. Only results from the past hour, day, week, month or year (Google's Tools > Any time filter, sent as tbs=qdr:). ## `site` (type: `string`): Optional. Restrict every query to one domain or TLD, e.g. reddit.com or gov — adds site: to each query. ## `fileType` (type: `string`): Optional. Only documents of this type, e.g. pdf, docx, xlsx — adds filetype: to each query. ## `exactPhrase` (type: `string`): Optional. A phrase every result must contain word for word — added to each query in quotes. ## `device` (type: `string`): Choose desktop or mobile to control which User-Agent is sent — Google sometimes shows slightly different snippets/layout per device. ## `includePeopleAlsoAsk` (type: `boolean`): Leave on to parse the People Also Ask box. The basic-HTML Google page this Actor fetches (for real result URLs) rarely contains it, so peopleAlsoAsk is usually empty; it is filled whenever Google does render the box. Does not change the price. ## `includeRelatedSearches` (type: `boolean`): Leave on to parse the related-searches suggestions. Like People Also Ask, Google's basic-HTML page rarely includes them, so expect relatedSearches to be empty on most pages. Does not change the price. ## `safeSearch` (type: `boolean`): Turn this on to request Google's SafeSearch filtering (adds safe=active to the request). ## `maxConcurrency` (type: `integer`): SERP pages to fetch in parallel, e.g. 3. Effective concurrency is capped at 3; older inputs up to 10 remain accepted. After two rejected pages, queued pages are skipped while in-flight pages finish. Inspect OUTPUT for partial results before retrying. ## `debugHtml` (type: `boolean`): Turn on only when reporting a parsing problem: saves every fetched Google page as PAGE\_.html in the run's key-value store. Does not change the price or the results. ## Actor input object example ```json { "queries": [ "apify web scraping" ], "countryCode": "us", "languageCode": "en", "resultsPerPage": 10, "maxPagesPerQuery": 1, "device": "desktop", "includePeopleAlsoAsk": true, "includeRelatedSearches": true, "safeSearch": false, "maxConcurrency": 1, "debugHtml": false } ``` # Actor output Schema ## `serpPages` (type: `string`): All scraped SERP pages — download as JSON, CSV, Excel or HTML. ## `qualityReport` (type: `string`): Confirmed pages, rejected pages, actual proxy attempts, cost-guard skipped pages and partial delivery state. ## `diagnostics` (type: `string`): DIAGNOSTIC-\* keys contain rejected pages outside the result dataset. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "queries": [ "apify web scraping" ], "countryCode": "us", "languageCode": "en", "resultsPerPage": 10, "maxPagesPerQuery": 1, "device": "desktop", "includePeopleAlsoAsk": true, "includeRelatedSearches": true, "safeSearch": false, "maxConcurrency": 1 }; // Run the Actor and wait for it to finish const run = await client.actor("webdatatools/google-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "queries": ["apify web scraping"], "countryCode": "us", "languageCode": "en", "resultsPerPage": 10, "maxPagesPerQuery": 1, "device": "desktop", "includePeopleAlsoAsk": True, "includeRelatedSearches": True, "safeSearch": False, "maxConcurrency": 1, } # Run the Actor and wait for it to finish run = client.actor("webdatatools/google-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "queries": [ "apify web scraping" ], "countryCode": "us", "languageCode": "en", "resultsPerPage": 10, "maxPagesPerQuery": 1, "device": "desktop", "includePeopleAlsoAsk": true, "includeRelatedSearches": true, "safeSearch": false, "maxConcurrency": 1 }' | apify call webdatatools/google-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,webdatatools/google-search-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/WBNF7gdGseCUnEeYI/builds/9k1ykKFYBohmmQzUN/openapi.json