Shoprite Product Search Scraper

ShopRite Product Search Scraper: Extract Real-Time Grocery Pricing Data

---

What Is ShopRite?

ShopRite is a major supermarket chain offering an extensive range of groceries, household items, and specialty products through both physical stores and online shopping. Its product database includes thousands of SKUs updated in real-time with pricing, promotions, and inventory status. Manually tracking product availability, pricing changes, and promotional offers across categories is labor-intensive — the ShopRite Product Search Scraper automates this process, delivering complete product data instantly.

---

Overview

The ShopRite Product Search Scraper extracts detailed product information from ShopRite.com search results and category pages, turning unstructured listings into machine-readable records. It is designed for:

• Price monitoring services tracking grocery inflation and competitor pricing
• Retail analysts benchmarking product assortments and promotional strategies
• Loyalty program researchers studying how promotions vary by membership tier
• eCommerce aggregators building product feeds and comparison tools
• Market researchers analyzing product availability and discounts across regions

Key strengths include dual scraping modes (URLs and keyword search), on-sale filtering, flexible sorting options, and rich output spanning pricing, promotions, loyalty discounts, and product attributes.

---

Input Format

The scraper accepts configuration in two modes: Scrape by URLs or Scrape by Search Filters. Choose one mode per run.

Mode 1: Scrape by URLs

Paste direct links to product search results or category pages:

{
  "urls": [
    "https://www.shoprite.com/sm/pickup/rsid/3000/categories/meat/beef-id-519883?f=Breadcrumb%3Agrocery%2Fmeat%2Fbeef",
    "https://www.shoprite.com/sm/pickup/rsid/3000/results?q=meat&take=30&sort=ppfreq&fpromotions=True"
  ],
  "max_items_per_url": 200,
  "ignore_url_failures": true
}

Field	Description
urls	Direct links to ShopRite search or category pages. Each URL can return up to max_items_per_url products.
max_items_per_url	Maximum products collected per URL (e.g., 200). Leave empty for no limit.
ignore_url_failures	If true, scraper skips failed URLs and continues. If false, it stops on error.

Mode 2: Scrape by Search Filters

Search for products using keywords and filter criteria:

{
  "keyword": "meat",
  "sort_by": "ppfreq",
  "on_sale": true,
  "page": 2,
  "max_items_per_url": 200
}

Field	Description
keyword	Search term (e.g., "meat", "organic milk", "pasta"). Required for this mode.
sort_by	Sort results by: "" (relevance, default), "brand" (A-Z), "brand desc" (Z-A), "price" (low to high), "price desc" (high to low)
on_sale	If true, returns only discounted/promotional items. If false, all matching products.
page	Starting page number (default: 1). Use 2 to start from page 2, etc.
max_items_per_url	Maximum products per page (e.g., 200).

Note: Leave urls empty when using search filters. Do not mix both modes in one run.

---

Output Format

Sample output

{
  "sku": "00858113005692",
  "name": "Bertolino Foods Beef Rib Shaved Steak, 16 oz",
  "brand": "Bertolino Foods",
  "description": "Bertolino Foods Beef Rib Shaved Steak, 16 oz",
  "available": true,
  "price": "$11.99",
  "was_price": "$11.99",
  "currency": "USD",
  "price_label": "",
  "price_source": "regular",
  "is_discounted": false,
  "unit_price": "$0.75/oz",
  "was_unit_price": "",
  "unit_price_unit": "Ounce",
  "unit_price_with_loyalty": "",
  "unit_price_without_loyalty": "",
  "has_loyalty_discount": false,
  "promotions": [],
  "points_based_promotions": [],
  "is_sponsored": false,
  "sell_by": "each",
  "size_value": 16,
  "size_unit": "Ounce",
  "size_unit_abbreviation": "oz",
  "price_unit": "Each",
  "categories": [
    "Grocery",
    "Grocery/Meat",
    "Grocery/Meat/Beef",
    "Grocery/Meat/Beef/Steaks"
  ],
  "default_categories": [
    "Grocery/Meat/Beef/Steaks"
  ],
  "image_url": "https://images.cdn.shoprite.com/cell/00858113005692_1",
  "image_detail_url": "https://images.cdn.shoprite.com/detail/00858113005692_1",
  "image_zoom_url": "https://images.cdn.shoprite.com/zoom/00858113005692_1",
  "image_template_url": "https://images.cdn.shoprite.com/{size}/00858113005692_1",
  "attributes": [
    {
      "label": "Lifestyle",
      "value": [
        "Keto Friendly",
        "No Artificial Ingredients",
        "No High Fructose Corn Syrup",
        "No Added Sugar",
        "Paleo"
      ]
    },
    {
      "label": "Keto Friendly",
      "value": true
    },
    {
      "label": "No Added Sugar",
      "value": true
    },
    {
      "label": "No Artificial Ingredients",
      "value": true
    },
    {
      "label": "Paleo",
      "value": true
    },
    {
      "label": "Features",
      "value": [
        "Outstanding flavor ",
        "Uncompromising standards",
        "Cooks in a skillet in minutes!"
      ]
    },
    {
      "label": "Brand Information",
      "value": "Since 1978 Certified Angus Beef® brand\nAngus beef at its best.®"
    },
    {
      "label": "No High Fructose Corn Syrup",
      "value": true
    },
    {
      "label": "EU1169 Compliance",
      "value": "Unspecified"
    },
    {
      "label": "Company Address",
      "value": "Five 5th Street,\nPeabody, MA, 01960."
    },
    {
      "label": "Company Name",
      "value": [
        "Bertolino Foods, Inc."
      ]
    },
    {
      "label": "Manufacturer",
      "value": "Bertolino Foods, Inc.,\nFive 5th Street,\nPeabody, MA, 01960."
    },
    {
      "label": "Other Usage",
      "value": [
        "4 servings per container"
      ]
    },
    {
      "label": "Recycling Information",
      "value": {
        "whole _packaging": "Recyclable"
      }
    },
    {
      "label": "Return To",
      "value": "100% satisfaction guaranteed\ncertifiedangusbeef.com\nBertolino Foods, Inc.,\nFive 5th Street,\nPeabody, MA, 01960."
    },
    {
      "label": "Safety Warning",
      "value": "SAFE HANDLING INSTRUCTIONS\nThis product was prepared from inspected and passed meat and/or poultry. Some food products may contain bacteria that could cause illness if the product is mishandled or cooked improperly. For your protection, follow these safe handling instructions.\n\nKeep refrigerated or frozen. Thaw in refrigerator or microwave.\n\nKeep raw meat and poultry separate from other foods. Wash working surfaces (including cutting boards). utensils and hands after touching raw meat or poultry.\n\nCook thoroughly.\n\nKeep hot foods hot. Refrigerate leftovers immediately or discard."
    },
    {
      "label": "Storage",
      "value": "Previously handled frozen for your protection refreeze or keep refrigerated"
    },
    {
      "label": "Storage & Usage",
      "value": [
        "Keep Refrigerated"
      ]
    },
    {
      "label": "Storage Type",
      "value": {
        "type": "Chilled"
      }
    },
    {
      "label": "Web Address",
      "value": [
        "certifiedangusbeef.com"
      ]
    },
    {
      "label": "Box Contents",
      "value": [
        "NET WT. 16oz (453.6g)"
      ]
    },
    {
      "label": "Unit Type",
      "value": [
        "Each"
      ]
    },
    {
      "label": "Nutrition Other Text",
      "value": "The % Daily Value (DV) tells you how much a nutrient in a serving of food contributes to a daily diet. 2,000 calories a day is used for general nutrition advice."
    },
    {
      "label": "Other Information",
      "value": "USDA Inspected - U.S. Inspected and Passed by Department of Agriculture - Est. 17994"
    },
    {
      "label": "Net Content",
      "value": {
        "net _content": "16oz (453.6g)"
      }
    },
    {
      "label": "U.S. Product Specifications",
      "value": {
        "food _form": "Solid"
      }
    },
    {
      "label": "Description Breakdown",
      "value": {
        "functional _name": "Shaved Steak",
        "variant": "Beef Rib"
      }
    },
    {
      "label": "Dimension",
      "value": {
        "shelf _height": "47",
        "shelf _width": "222",
        "shelf _depth": "53"
      }
    },
    {
      "label": "Number Of Units",
      "value": {
        "count _per _package": "1"
      }
    },
    {
      "label": "Numeric Size",
      "value": {
        "u_s _customary _numeric _size": "16"
      }
    },
    {
      "label": "Unit Merchandising",
      "value": {
        "height": "53",
        "width": "222",
        "depth": "47",
        "unit _stackable": "Yes",
        "unit _stable": "Yes",
        "merchandise _multiple _ways": "No"
      }
    },
    {
      "label": "Weight",
      "value": {
        "gross _weight": "492"
      }
    },
    {
      "label": "Packaging Material Marks",
      "value": {
        "material _mark": "5 - PP"
      }
    },
    {
      "label": "Pack Type",
      "value": {
        "type": "Tray"
      }
    },
    {
      "label": "Standardized Brand",
      "value": {
        "brand": "Bertolino Foods"
      }
    },
    {
      "label": "Unit Specific",
      "value": {
        "u_s _customary _unit (specific)": "Ounce"
      }
    }
  ],
  "options": [],
  "tax_details": [],
  "raw_data": null,
  "from_url": "https://www.shoprite.com/sm/pickup/rsid/3000/categories/meat/beef-id-519883?f=Breadcrumb%3Agrocery%2Fmeat%2Fbeef"
}

Complete Output Structure and Field Definitions

The scraper returns JSON data with each product as an object containing detailed fields. Understanding field purposes enables effective analysis and application.

Product Identification

SKU: Unique product code (stock keeping unit) on the retailer's catalog, usually matching the barcode. Purpose: Database indexing, tracking a product over time, avoiding duplicates, matching products across retailers.

Name: Product title as displayed on the store. Purpose: Product search, keyword analysis, catalog display.

Brand: Brand of the product. Purpose: Brand-level analysis, private-label versus national-brand comparison.

Description: Short product description from the retailer. Purpose: Content analysis and verification of product details.

Available: Whether the product can currently be purchased. Purpose: Stock and availability monitoring.

Pricing

Price: Current selling price as displayed. Purpose: Price tracking, competitive benchmarking, market analysis.

Was Price: Regular price before the discount. Purpose: Calculating discount depth and promotion analysis.

Currency: Currency of the listed prices (USD). Purpose: Correct financial interpretation when merging datasets from multiple markets.

Price Label: Promotional label shown next to the price (e.g., On Sale!). Purpose: Identifying active promotions and their messaging.

Price Source: Type of price applied (e.g., tpr = temporary price reduction). Purpose: Distinguishing regular prices from temporary promotional pricing.

Is Discounted: Whether the product is currently discounted. Purpose: Filtering promotional items and measuring promotion frequency.

Unit Price: Price per standard unit of measure (e.g., $0.31/oz). Purpose: Fair comparison between products with different package sizes.

Was Unit Price: Regular price per unit before the discount. Purpose: Discount analysis at unit level.

Unit Price Unit: Unit of measure used for the unit price (e.g., Ounce). Purpose: Interpreting and normalizing unit prices.

Unit Price With Loyalty: Unit price after the loyalty program discount (may be empty). Purpose: Analyzing loyalty-based pricing.

Unit Price Without Loyalty: Unit price without loyalty discount (may be empty). Purpose: Comparing standard versus member pricing.

Has Loyalty Discount: Whether a loyalty discount applies to the product. Purpose: Identifying member-only deals.

Promotions: List of active promotions on the product. Purpose: Promotion tracking and campaign analysis.

Points Based Promotions: List of loyalty-points promotions on the product. Purpose: Analyzing reward and points campaigns.

Is Sponsored: Whether the product appears as a paid/sponsored placement. Purpose: Analyzing brand advertising spend and search visibility.

Size and Selling Unit

Sell By: How the product is sold (e.g., each, by weight). Purpose: Understanding the purchase unit and pricing model.

Size Value: Numeric size of the package. Purpose: Price-per-unit calculations and size comparison.

Size Unit: Unit of the package size (e.g., Ounce). Purpose: Interpreting package size correctly.

Size Unit Abbreviation: Short form of the size unit (e.g., oz). Purpose: Compact display in reports and dashboards.

Price Unit: Unit the price applies to (e.g., Each). Purpose: Interpreting whether the price is per item or per weight.

Categories

Categories: List of all category paths the product belongs to (breadcrumb format). Purpose: Market segmentation, taxonomy mapping, finding the product in featured shops and dietary collections.

Default Categories: List of primary category paths assigned to the product by the retailer. Purpose: Main classification of the product for category-level analysis.

Images

Image URL: Default product image. Purpose: Catalog display and quick preview.

Image Detail URL: Larger product image for detail view. Purpose: Visual inspection and product page display.

Image Zoom URL: Highest resolution product image. Purpose: Image analysis, computer vision, quality checks.

Image Template URL: Image URL pattern with a {size} placeholder. Purpose: Generating images in custom sizes.

Attributes

Attributes: List of flexible product attributes, each as an object with label and value. Values can be text, boolean, list or object. Typical labels include Features, Lifestyle (Gluten Free, Keto Friendly, ...), Storage, Storage Type, Company Name, Company Address, Distributor Address, Web Address, Net Content, Box Contents, Number Of Units, Pack Type, Allergy Advice, Safety Warning, Recycling Information, Date Marking Type and Nutrition Other Text. Purpose: Product comparison, dietary and allergen filtering, compliance review, supplier identification and enrichment of product catalogs. The set of labels varies per product.

Variants and Taxes

Options: List of selectable product options or variants (empty if none). Purpose: Analyzing configurable products.

Tax Details: List of tax information applied to the product (empty if none). Purpose: Calculating final shelf price and tax analysis.

Raw Data

Raw Data: Complete original JSON object of the product as scraped, without modification. Purpose: Auditing, debugging, accessing fields not included in the cleaned output, and reprocessing without re-scraping.

---

How to Use

By URLs (Recommended for specific searches)

1. Navigate ShopRite.com — Use the search or category menu to find products.
2. Copy URLs — Get the full URL from your browser (e.g., https://www.shoprite.com/sm/pickup/rsid/3000/results?q=meat).
3. Paste in scraper — Add URLs to the urls array.
4. Set limits — Adjust max_items_per_url (e.g., 200 for full category).
5. Run scraper — Start the actor and monitor progress.

By Search Filters (For dynamic, keyword-based searches)

1. Enter keyword — Type your search term (e.g., "organic milk", "cereal").
2. Set filters — Choose sort order, enable on_sale if needed, set start page.
3. Configure limits — Set max_items_per_url to control volume.
4. Run scraper — Start the run; scraper handles pagination automatically.

Troubleshooting:

• If a URL returns no products, verify the link is a search results or category page (not a product detail page).
• Use ignore_url_failures: true for bulk runs to prevent interruptions.
• Loyalty pricing varies by store; pricing may differ by location (rsid parameter).

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing across categories and regions in real-time
• Promotional analysis: Identify discount patterns and measure coupon effectiveness
• Loyalty insights: Compare member vs. non-member pricing to understand tier benefits
• Product feed — Aggregate ShopRite data into custom price comparison or shopping aggregator apps
• Supply chain: Monitor product availability and stock levels across locations
• Market research: Analyze shelf space allocation, brand positioning, and category assortments

By automating data collection, the ShopRite scraper replaces hours of manual monitoring with structured, actionable data that feeds directly into analytics, BI platforms, and pricing engines.

---

Conclusion

The ShopRite Product Search Scraper is a powerful tool for retail intelligence, competitive analysis, and pricing automation. With support for both URL-based and keyword-based scraping, granular filtering, and 40+ output fields covering pricing, promotions, and loyalty details, it unlocks insights that manual browsing cannot match. Start a run today and transform ShopRite data into business advantage.