Anti-bot (aka WAF) are paid services that integrate with websites and detect web scrapers and other automated web actors.
These system are currently the biggest threat for web scrapers and thus a major topic in the web scraping industry. Below is a compilation of the most common anti-bot services encountered in web scraping.
Cloudflare is mostly known for it's CDN service but it also offers a powerful web application firewall (WAF) and anti-bot protection used to block web scrapers
2024-04-22
Perimeter X is cloud based security solution that provides DDoS and anti bot protection. It's mostly known for relying heavily on AI based behavior analysis.
2024-04-22
Datadome is an European based anti bot solution that provides DDoS protection and bot mitigation which also includes web scraper blocking.
2024-04-22
Akamai is a global CDN provider that also offers a wide range of security solutions including anti bot protection which is used to block web scrapers
2024-04-22
Kasada is a bot mitigation solution that provides DDoS protection and anti bot protection which is also used to block web scrapers.
2024-04-22
Imperva Incapsula is a cloud based security solution that provides DDoS protection and anti bot protection which is also used to block web scrapers.
2024-04-22