Scrapfly was originally an insider product and battle-tested before becoming publicly accessible in early 2017. It was then opened to everyone in 2020.
Our mission is to simplify the work of data engineers and analysts to access the data. The internet is the largest database in the world, yet it remains the least accessible, both technically and legally.
Overall Scrapfly performs exceptionally well with Scrapeway's benchmarks showing it to be one of the best-performing services in terms of bypassing anti-bot measures and general price value.
Scrapfly offers a wide range of features beyond industry average like dynamic pricing which still can be controlled through API options making this a great fit for both beginners and advanced scrapers.
Pros
- Exceptional and fair scraper blocking bypass.
- Below average pricing for most targets.
- Javascript rendering with custom javascript evaluation.
- Full browser control through Javascript Scenarios.
- Python, Scrapy and Typescript SDKs for easy integration.
- Detailed web dashboard for reviewing scraping performance.
- Multi-project support with dedicated environments and quotas.
- Feature rich with many unique features
- Low entry point at $30.
- Web UI player for testing and experimenting.
Cons
- Credits do not carry over month-to-month.
- No annual plans are available.
- Above average pricing for some targets in favor of higher success rate and reliability.
Scrapfly vs Other Services
Here's how Scrapfly compares against other web scraping APIs in terms of success rate, speed and cost.
| # | Service | Success % | Speed | Cost $/1000 | |
|---|---|---|---|---|---|
| 1 | Scrapfly |
94%
|
12.2s
|
$3.71
|
|
| 2 | Scrapingbee |
74%
|
3.1s
|
$3.42
|
|
| 3 | WebScrapingAPI |
74%
|
22.1s
|
$2.39
|
|
| 4 | Scraperapi |
71%
|
7.3s
|
$5.17
|
|
| 5 | Zenrows |
69%
|
8.0s
|
$4.52
|
|
| 6 | Scrapingdog |
46%
|
4.8s
|
$1.54
|
|
| 7 | Scrapingant |
44%
|
13.4s
|
$1.99
|
This data is based on the averages of Scrapeway's weekly benchmarks covering 12 most popular web scraping targets and overall:
- Scrapfly has an above-average success rate of 94.2% compared to industry average of 67.5%
- Scrapfly has a below-average scraping speed of 12.2s compared to industry average of 10.1s
- Scrapfly has an above-average price of $3.7/1000 scrapes compared to industry average of $3.2
Scrapfly Benchmarks
Scrapeway runs weekly benchmarks for Scrapfly for the most popular web scraping targets.
| Target | Success % | Speed | Cost $/1000 | |
|---|---|---|---|---|
|
94%
|
12.2s
|
$3.71
|
||
|
100%
|
1.4s
|
$0.15
|
||
|
100%
|
2.0s
|
$3.76
|
||
|
100%
|
3.9s
|
$0.69
|
||
|
100%
|
9.3s
|
$4.18
|
||
|
100%
|
13.2s
|
$4.17
|
||
|
100%
|
20.7s
|
$3.01
|
||
|
100%
|
30.3s
|
$8.01
|
||
|
99%
|
1.4s
|
$3.75
|
||
|
96%
|
37.4s
|
$12.0
|
||
|
75%
|
1.9s
|
$0.15
|
||
|
66%
|
13.1s
|
$0.9
|
Scrapfly Pricing
Scrapfly is a credit-based service where each scrape request can cost 1-25 credits depending on the used features and required anti-bot bypass.
| Plan | Price | Credits | Concurrency |
|---|---|---|---|
| Discovery | $30 | 200,000 | 5 |
| Pro | $100 | 1,000,000 | 20 |
| Startup | $250 | 2,500,000 | 50 |
| Enterprise | $500 | 5,500,000 | 100 |
| Custom | - | - | ∞ |
Overall Scrapfly offers a very attractive pricing model for all plan levels especially when combined with Scrapfly's dynamic credit pricing (ASP) which enables itself based on required anti-bot bypass.
Scrapfly Features
Overall, Scrapfly offers a wide range of features far beyond the industry average. It offers the standard feature set for all plans:
| Feature | Availability |
|---|---|
| Integrations | Python, Typescript |
| Proxy support | Datacenter default, Residential optional |
| Geolocation | 50+ countries |
| Webhook support | Yes |
| Javascript rendering | Yes, at extra cost |
| Custom JS evaluation | Yes, up to 160s |
| Browser control | Yes, up to 160s |
| Screenshots | Yes, full page and individual elements |
| Sessions | Yes, persistent IP & cookies |
To add, Scrapfly offers some unique features at no extra cost included with every plan:
- AI auto extraction for extracting common data structures like reviews, products, articles etc.
- LLM query engine for prompting scraped results through an LLM engine.
- Multi project support with separate keys, quotas etc.
- Result caching for days to weeks (based on plan).
- SSL analysis for scraping SSL certificate details.
- DNS scraping for collecting latest DNS entries.
- Scraper throttling configurations for managing scraping speeds.