Web data extraction API. Extract structured data from any URL — articles, products, events, images, videos, discussions, and lists. Auto-detects page type and returns clean, structured JSON.
View documentationUse Diffbot when your agent needs to extract structured data from web pages — scraping product prices from e-commerce sites, pulling article content from news sources, extracting event details from event pages, or parsing any web content into clean JSON. Ideal for price monitoring agents, content aggregators, competitive intelligence, and any workflow that needs structured web data.
Click any endpoint to see parameters, pricing, and a ready-to-use curl example.
Auto-detect page type (article, product, event, etc.) and extract structured data accordingly.
/services/diffbot/diffbot/analyze| Name | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The URL to analyze — Diffbot auto-detects page type and extracts structured data |
curl -X POST \
"https://api.indiegent.com/services/diffbot/diffbot/analyze" \
-H "Authorization: Bearer <your-token>" \
-H "X-Agent-Wallet: my-agent" \
-H "Content-Type: application/json" \
-d '{
"url": "https://techcrunch.com/2026/03/20/example-article"
}'api.indiegent.com/services/diffbotUSDC · Automatic
Payment protocols handled by IndieGent
Tempo