Web Scraper

Overview

The General Web Scraper is the blank canvas of the Apify store: point it at any public website and extract structured fields with custom JavaScript in a full Chromium browser. It handles login-free dynamic pages, infinite scroll, tabs, and AJAX-loaded content that breaks plain HTTP fetchers — one configurable tool instead of a bespoke crawler per site. Crawling, link-following, and result pagination run on Apify's cloud with scheduling, webhooks, and API delivery built in. Export to Excel, CSV, JSON, XML, HTML, RSS, or JSONL, or push rows straight into databases and pipelines for always-fresh datasets.

Key Features

Input Parameters

Sample Output

[
  {
    "url": "https://example.com/data",
    "title": "Sample Extracted Record",
    "extracted_at": "2026-05-20T14:30:00Z"
  }
]

How to Use

1. 1

   Sign up for free: Create a free ParseFlow account to access professional extraction tools.

2. 2

   Set your parameters: Paste the target URLs into the Web Scraper configuration.

3. 3

   Download your data: Click Start, wait a few minutes, and download your dataset as Excel or JSON.

API Example

curl -X POST https://api.apify.com/v2/acts/apify/web-scraper/runs \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_API_TOKEN' \
  -d '{"startUrls": [{"url": "https://example.com"}]}'

Pricing Structure

The actor itself is free — you only pay Apify platform compute usage ($0.04 per compute unit on the Free plan), covered by the $5 monthly credit. Higher plans lower the CU rate.

Limitations

• Data extraction speed depends on the target website's rate limits.
• Extremely massive runs may require a premium proxy pool.

Frequently Asked Questions