# Indeed Jobs Scraper — Public Listings (`crabwalker/indeed-scraper`) Actor

Search public Indeed job listings by position, location, salary, company, job type, and posting date into structured datasets.

- **URL**: https://apify.com/crabwalker/indeed-scraper.md
- **Developed by:** [Crab Walker](https://apify.com/crabwalker) (community)
- **Categories:** Jobs, Lead generation
- **Features:** Limited permissions
- **Stats:** 4 total users, 1 monthly users, 94.4% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $50.00 / 1,000 indeed job listings

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Indeed Public Jobs Scraper

Search public Indeed job listings by position, location, or URL. The Actor does not log in, use candidate or employer accounts, or access private data.

Indeed protects its public pages against non-browser HTTP clients. This Actor uses browser-level TLS and header impersonation with session-sticky proxy support, automatically rotating to a fresh residential session when a proxy tunnel fails. It visits each public job-detail page to return the full description, without logging into Indeed or solving CAPTCHAs.

Listings whose public detail page remains unavailable after proxy rotation are skipped, so `maxItemsPerSearch` counts complete records with full descriptions rather than incomplete or chargeable placeholder rows.

### Input

Use the reference Actor fields `position`, `maxItemsPerSearch`, `country`, `location`, `parseCompanyDetails`, `saveOnlyUniqueItems`, and `followApplyRedirects`, or provide public Indeed search URLs in `startUrls`. The legacy aliases `maxItems` and `maxPages` are also accepted.

### Output

Each row exposes the reference Indeed fields (`positionName`, `salary`, `jobType`, `company`, `companyIndeedUrl`, `location`, `rating`, `reviewsCount`, `externalApplyLink`, `url`, `id`, `postedAt`, `postingDateParsed`, `description`, and company/error fields) plus shared provenance fields.

### Pricing for 70%+ margin

Profit on pay-per-event is `profit = 0.8 * revenue - platformCosts`, so
`margin = profit / revenue`. For 70% margin with costs borne by the developer:

```
revenue >= platformCosts / 0.1  (i.e. 10x costs)
```

Measured cost drivers per 1,000 full-description results (FREE/BRONZE tier):
residential proxy ~0.4 GB x $8 = ~$3.20, compute + transfer + writes ~$0.15.
Total `C ≈ $3.35 / 1,000 results`.

- Set `apify-default-dataset-item` to **$0.04-0.05 per result ($40-50 / 1,000)**.
  At $0.05: `profit = 0.8*50 - 3.35 = $36.65`, margin ≈ 73%.
- Keep **platform usage costs included** in the event price (predictable for users).
  The safest alternative is enabling **"Pass platform usage costs to users"** in
  Console monetization: margin is then fixed at 80% and the event price can be lower.
- Set `minimalMaxTotalChargeUsd` to ~$0.50 so a run can cover start + first results.
- Memory is capped (`min 256 MB`, `max 1024 MB`, default 512 MB) so a high-memory
  run cannot multiply compute costs without extra revenue.

Cost controls in code: charge-limit checks run before each detail fetch (no proxy
burn for unbilled results), detail retries capped at 2, and `includeFullDescription: false`
skips detail pages entirely (~10x less proxy for snippet-only runs).

Add an `APIFY_API_TOKEN` repository secret. The GitHub Actions workflow runs tests and publishes the Actor on pushes to `main` or `master`.

# Actor input Schema

## `position` (type: `string`):

Job title, skill, or keyword to search on Indeed.

## `maxItemsPerSearch` (type: `integer`):

Maximum job listings to return for each search.

## `country` (type: `string`):

Two-letter country code used to select the Indeed site.

## `location` (type: `string`):

City, region, or other location filter.

## `parseCompanyDetails` (type: `boolean`):

Whether to collect additional public company details when available.

## `saveOnlyUniqueItems` (type: `boolean`):

Whether to deduplicate jobs by listing ID.

## `followApplyRedirects` (type: `boolean`):

Whether to follow external application redirects.

## `startUrls` (type: `array`):

Indeed search, company jobs, or detail URLs.

## `maxPages` (type: `integer`):

Maximum Indeed result pages to request.

## `requestDelaySecs` (type: `number`):

Seconds to wait between Indeed page requests.

## `includeFullDescription` (type: `boolean`):

Visit each job detail page for the full description. Turn off for snippet-only results: ~10x less residential proxy traffic and faster runs.

## `requireCompleteDescription` (type: `boolean`):

Skip listings whose full description could not be fetched. Leave this off to keep the shorter search-result summary when Indeed blocks a detail page.

## `proxyConfiguration` (type: `object`):

Optional Apify proxy configuration for requests.

## Actor input object example

```json
{
  "position": "software engineer",
  "maxItemsPerSearch": 5,
  "country": "US",
  "location": "New York, NY",
  "parseCompanyDetails": false,
  "saveOnlyUniqueItems": true,
  "followApplyRedirects": false,
  "startUrls": [],
  "maxPages": 1,
  "requestDelaySecs": 2,
  "includeFullDescription": true,
  "requireCompleteDescription": false,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "position": "software engineer",
    "maxItemsPerSearch": 5,
    "country": "US",
    "location": "New York, NY",
    "maxPages": 1
};

// Run the Actor and wait for it to finish
const run = await client.actor("crabwalker/indeed-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "position": "software engineer",
    "maxItemsPerSearch": 5,
    "country": "US",
    "location": "New York, NY",
    "maxPages": 1,
}

# Run the Actor and wait for it to finish
run = client.actor("crabwalker/indeed-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "position": "software engineer",
  "maxItemsPerSearch": 5,
  "country": "US",
  "location": "New York, NY",
  "maxPages": 1
}' |
apify call crabwalker/indeed-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,crabwalker/indeed-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/wUZmwK2AmILAuj2kn/builds/nEwI4Q2C6RfGv7HvM/openapi.json