AI web scraping agent
Editorial picks for "ai web scraper".
32 tools
ScrapeGraphAI
LLM-driven web scraping tools designed to extract structured data from any website and HTML content.
n8n
Workflow automation platform combining AI capabilities with business process automation, offering code flexibility and no-code speed.
Skyvern
Skyvern automates browser-based workflows using LLMs and computer vision.
Browser Use
Cloud browser infrastructure and hosted agents for AI automation, with stealth browsers available at $0.02 per hour.
Sim
Open-source AI workspace for building, deploying, and managing AI agents.
Exa
Search API for AI agents providing real-time web data, deep research, and structured content.
Firecrawl
Web data API to search, scrape, and interact with the web at scale.
Manus
Generalist agent for research, code, and web tasks.
OpenCLI
OpenCLI is a browser automation tool for AI agents.
Open Deep Research
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models.
Hyperbrowser
Cloud browsers, isolated sandboxes, and web data APIs for AI agents.
PageAgent
An in-page JavaScript GUI agent that drives web interfaces with natural language, no headless browser required.
AgenticSeek
Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.
Browser Use Web UI
Gradio web UI for running browser-use AI agents in a real or persistent Chrome session.
You.com
Core AI infrastructure for maximizing accuracy while reducing latency and costs.
Nekton AI
Plain-English workflow automation that generates and runs cloud code from your prompt.
Browserbase
Browserbase makes the web as reliable and programmable as APIs for AI agents.
Dia Browser
An AI-native browser from The Browser Company that turns tabs into an agentic assistant for knowledge workers.
DuckDuckGo MCP Server
MCP server providing DuckDuckGo web search and content fetching capabilities.
Exa MCP Server
Exa MCP for web search and web crawling
Fellou
Fellou is an AI browser that takes automated web action.
Firecrawl MCP Server
MCP server that brings Firecrawl's web search, scrape, and interaction capabilities to MCP-compatible clients, returning clean Markdown or structured data.
Kagi MCP Server
Official Kagi Search MCP server: search and extract the web from any MCP-compatible agent.
MCP Fetch Server
Official Model Context Protocol reference server that lets any MCP-compatible LLM fetch web pages and read them as clean markdown.
Opera Neon
Opera Neon is a browser built to act.
Perplexity Comet
An agentic AI browser from Perplexity that reads, reasons over, and acts on the pages you're viewing.
Perplexity MCP Server
Official MCP server for Perplexity's Sonar search, research, and reasoning APIs
Playwright MCP
A Model Context Protocol server that provides browser automation capabilities using Playwright.
Puppeteer MCP Server
Reference MCP server that lets LLMs drive a real Chromium browser via Puppeteer.
Scrapling
A Python web scraping framework combining fast HTTP requests, stealth browsers, parsing, and concurrent crawling.
Stagehand
The SDK for browser agents
Tavily
One secure API for real-time web access.