← back
ScrapeGraphAI

ScrapeGraphAI

100

AI-powered web scraping API that extracts structured data from any webpage using natural language prompts — no selectors or maintenance needed.

OpenAPI SpecAPI KeyFreemiumJSONBot Blocking: NoneNo CCweb-scrapingai-extractionmarkdown-outputcrawlingstructured-databrowser-automation

Pros

  • + Natural language prompts replace CSS selectors — agents describe what they want, not where it is
  • + Official MCP server plus LangChain/LlamaIndex/CrewAI integrations for direct agent use
  • + OpenAPI spec available; Python and JS SDKs are production-ready

Cons

  • - Free tier is only 50 one-time credits — essentially a trial, not viable for ongoing agent use
  • - Credit costs vary by endpoint (2-30 credits/call) making usage prediction complex for agents

Integration

example.py
from scrapegraph_py import Client
client = Client(api_key="your-api-key")response = client.smartscraper(    website_url="https://example.com",    user_prompt="Extract the main heading and summary")print(response["result"])

Details

Category
Web Scraping
Pricing
Freemium
Free Tier
50 API credits (one-time), 10 req/min, no credit card required
Rate Limit
10 RPM (free), 30 RPM (starter), 60 RPM (growth), 200 RPM (pro)
Verified
2026-03-31

Score Breakdown

Base +50
OpenAPI Spec (Yes) +15
Auth Complexity (API Key) +10
Response Format (JSON) +10
Bot Blocking (None) +10
No Credit Card (Yes) +5
Completely Free (No) 0
Total 100

Related APIs in Web Scraping