← back
ScrapeGraphAI
100AI-powered web scraping API that extracts structured data from any webpage using natural language prompts — no selectors or maintenance needed.
OpenAPI SpecAPI KeyFreemiumJSONBot Blocking: NoneNo CCweb-scrapingai-extractionmarkdown-outputcrawlingstructured-databrowser-automation
Pros
- + Natural language prompts replace CSS selectors — agents describe what they want, not where it is
- + Official MCP server plus LangChain/LlamaIndex/CrewAI integrations for direct agent use
- + OpenAPI spec available; Python and JS SDKs are production-ready
Cons
- - Free tier is only 50 one-time credits — essentially a trial, not viable for ongoing agent use
- - Credit costs vary by endpoint (2-30 credits/call) making usage prediction complex for agents
Integration
example.py
from scrapegraph_py import Client
client = Client(api_key="your-api-key")response = client.smartscraper( website_url="https://example.com", user_prompt="Extract the main heading and summary")print(response["result"])Details
- Category
- Web Scraping
- Pricing
- Freemium
- Free Tier
- 50 API credits (one-time), 10 req/min, no credit card required
- Rate Limit
- 10 RPM (free), 30 RPM (starter), 60 RPM (growth), 200 RPM (pro)
- Verified
- 2026-03-31
Score Breakdown
Base +50
OpenAPI Spec (Yes) +15
Auth Complexity (API Key) +10
Response Format (JSON) +10
Bot Blocking (None) +10
No Credit Card (Yes) +5
Completely Free (No) 0
Total 100
Related APIs in Web Scraping
Olostep
Web ScrapingWeb data API that lets AI agents scrape, search, crawl, and extract structured content from any public webpage with JS rendering and residential proxies.
OpenAPI SpecAPI KeyFreemiumNo CC
Scrape Creators
Web ScrapingReal-time social media scraping API with 107 endpoints across 27+ platforms — extract profiles, posts, comments, and metrics from TikTok, Instagram, YouTube, X, and more as clean JSON.
OpenAPI SpecAPI KeyPay-as-you-goNo CC
Riveter
Web ScrapingAI search agent API that combines web search, scraping, and structured data extraction into a single endpoint — tell it what you need via a prompt and get clean JSON back.
API KeyFreemiumNo CC