# Article Content Extractor πŸ“„ (`easyapi/article-content-extractor`) Actor Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. πŸ”πŸ“„ - **URL**: https://apify.com/easyapi/article-content-extractor.md - **Developed by:** [EasyApi](https://apify.com/easyapi) (community) - **Categories:** Developer tools, Integrations, Other - **Features:** Limited permissions - **Stats:** 253 total users, 14 monthly users, 100.0% runs succeeded, 4 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $2.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ## Article Content Extractor πŸ“„ Extract clean article content and metadata from any web pages automatically. This actor helps you get structured content from news sites, blogs, and other article-based websites. ### Features ✨ - Extract article content and metadata from any URL - Support batch processing of multiple URLs - Clean and structured JSON output - Built-in rate limiting to avoid overloading target sites - Robust error handling and validation - Fast and efficient processing ### Output Data Structure πŸ“Š The actor extracts the following information from each article: - Title - Description - Main content (both HTML and plain text) - Author - Publication date - Source domain - Featured image URL - Related links - Tags - Scraping timestamp ### Use Cases πŸ’‘ - Content aggregation and syndication - News monitoring and analysis - Research and data collection - Content migration - SEO analysis - Digital archiving ### Limitations ⚠️ - Respects robots.txt and implements polite scraping - 2-second delay between requests to avoid overwhelming target servers - URLs must be valid and accessible - Content extraction quality depends on page structure ### Tips for Best Results πŸ’ͺ 1. Provide valid, accessible URLs 2. Use for public content only 3. Consider target website's terms of service 4. Monitor execution logs for any issues Need help or have questions? Feel free to reach out! #### Input Example A full explanation of an input example in JSON. ```json { "urls": [ "https://cleartax.in/s/gst-hsn-lookup", "https://www.fancode.com/pickleball/schedule" ] } ``` #### Output sample The results will be wrapped into a dataset which you can always find in theΒ **Storage**Β tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. ```json [ { "url": "https://www.fancode.com/pickleball/schedule", "title": "Pickleball Schedule - Check International and Domestic matches on FanCode", "description": "ABOUT FANCODEIndia's Premium Live Streaming, Live Scores & Sports Merchandise Shopping platform FanCode has grown to become one of the most loved and followed all-sports destination in the last few years....", "content": "

", "author": "", "publishedDate": "", "source": "fancode.com", "image": "https://www.fancode.com/skillup-uploads/fc-web/home-page-new-arc/hero-image/v1/hero-image-dweb-v4.png", "links": [ "https://www.fancode.com/pickleball/schedule" ], "tags": [], "scrapedAt": "2025-02-05T07:19:26.119Z" }, ... ] ``` ### Related Actors - πŸ“„ [URL Metadata Crawler](https://apify.com/easyapi/url-metadata-crawler) - Extract comprehensive metadata from web pages including meta tags, favicons, and Open Graph tags. - πŸ” [Google News Scraper](https://apify.com/easyapi/google-news-scraper) - Collect up to 5000 news articles with flexible search options and language support. - πŸ“š [arXiv Search Scraper](https://apify.com/easyapi/arxiv-search-scraper) - Extract comprehensive research paper data including titles, authors, and abstracts. - πŸ”¬ [Nature Search Results Scraper](https://apify.com/easyapi/nature-search-results-scraper) - Extract research article data from Nature.com with detailed metadata. - πŸ“š [Medium Posts Search Scraper](https://apify.com/easyapi/medium-posts-search-scraper) - Get detailed information about articles, authors, and engagement metrics from Medium. - πŸ“š [Substack Posts Scraper](https://apify.com/easyapi/substack-posts-scraper) - Extract comprehensive post data including title, author, and publication details. - πŸ” [PubMed Search Scraper](https://apify.com/easyapi/pubmed-search-scraper) - Scrape research papers and academic articles with comprehensive metadata. - πŸ“„ [WikiHow Article Scraper](https://apify.com/easyapi/wikihow-article-scraper) - Extract article titles, dates, views, and detailed step-by-step content. - πŸ” [Cointelegraph Search Scraper](https://apify.com/easyapi/cointelegraph-search-scraper) - Extract comprehensive article data including titles, authors, and publish dates. - πŸ“š [Medium User Posts Scraper](https://apify.com/easyapi/medium-user-posts-scraper) - Extract detailed post data including engagement metrics and publication details. - 🎯 [Keyword Discovery Tool](https://apify.com/easyapi/keyword-discovery-tool) - Discover new keyword ideas and uncover valuable search insights. - πŸ” [Keyword Density Checker](https://apify.com/easyapi/keyword-density-checker) - Analyze webpage content to calculate keyword density and frequency. - πŸ” [AI-powered Search](https://apify.com/easyapi/ai-powered-search) - Transform search queries into structured, AI-powered summaries with references. - πŸ“ [Text Summarization](https://apify.com/easyapi/text-summarization) - Automatically generate concise summaries of documents while preserving original content. - 🌐 [Website Content to Markdown for LLM Training](https://apify.com/easyapi/website-content-to-markdown-for-llm-training) - Transform web content into clean, LLM-ready Markdown format. *** #### More from EasyAPI - [Article Content Extractor on easyapi.tools](https://easyapi.tools/article-content-extractor/?utm_source=apify\&utm_medium=store\&utm_campaign=readme\&utm_content=article-content-extractor) β€” input reference, example output and per-1k-result pricing. - [All EasyAPI scrapers](https://easyapi.tools/news/?utm_source=apify\&utm_medium=store\&utm_campaign=readme\&utm_content=article-content-extractor) β€” the full catalog for news, social, ads, jobs and e-commerce. *EasyAPI builds and maintains this Actor. Billing and runs stay on Apify.* # Actor input Schema ## `urls` (type: `array`): List of article URLs to extract content from ## Actor input object example ```json { "urls": [ "https://www.fancode.com/pickleball/schedule" ] } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.fancode.com/pickleball/schedule" ] }; // Run the Actor and wait for it to finish const run = await client.actor("easyapi/article-content-extractor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.fancode.com/pickleball/schedule"] } # Run the Actor and wait for it to finish run = client.actor("easyapi/article-content-extractor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.fancode.com/pickleball/schedule" ] }' | apify call easyapi/article-content-extractor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,easyapi/article-content-extractor" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/k23ty7AnmPk81AFxp/builds/08pmqN0XkO8rA3jxr/openapi.json