# Webgrab

> Screenshot, PDF, content extraction, metadata, AI analysis, and batch processing API for developers.

## About

Webgrab is a developer API platform for capturing and analyzing web pages. One API key gives access to 7 endpoints. Free tier: 200 credits/month. No credit card required.

## Auth

All endpoints require `x-api-key` header or `Authorization: Bearer` header. Keys start with "wg_".

## API Endpoints

### POST /screenshot
Host: screenshots.webgrab.dev

Full-page or viewport website screenshots (PNG, WebP, JPEG). Headless browser with automatic cookie banner, popup, and ad removal.

Parameters:
- url (string, required) — Any valid URL with protocol
- device (string, default: "desktop") — "desktop" or "mobile"
- full_page (boolean, default: true) — Capture full scrollable page or viewport only
- format (string, default: "webp") — "webp", "png", or "jpeg"
- quality (number, default: 75) — 1–100 (ignored for png)
- remove_cookie_banners (boolean, default: true) — Auto-dismiss cookie popups
- remove_ads (boolean, default: true) — Block common ad networks
- wait_after_load (number, default: 1000) — Milliseconds to wait after page load

### POST /pdf
Host: screenshots.webgrab.dev

URL to PDF conversion. Same parameters as /screenshot minus format and quality.

Parameters:
- url (string, required) — Any valid URL with protocol
- device (string, default: "desktop") — "desktop" or "mobile"
- full_page (boolean, default: true) — Capture full scrollable page or viewport only
- remove_cookie_banners (boolean, default: true) — Auto-dismiss cookie popups
- remove_ads (boolean, default: true) — Block common ad networks
- wait_after_load (number, default: 1000) — Milliseconds to wait after page load

### GET /og
Host: screenshots.webgrab.dev

Drop-in OG image generator. Live social preview images via a single meta tag. Auto-cached on CDN.

Parameters:
- url (query string, required) — The URL to generate an OG image for

### POST /content
Host: api.webgrab.dev

Content extraction API. Clean markdown, structured HTML, metadata, internal links, and sitemap discovery from any URL.

Parameters:
- url (string, required) — The URL to extract content from
- include_html (boolean, default: true) — Include raw HTML in response
- include_markdown (boolean, default: true) — Include markdown conversion
- include_metadata (boolean, default: true) — Include page metadata
- include_links (boolean, default: true) — Include categorized links
- include_sitemap (boolean, default: true) — Discover and parse sitemap
- remove_cookie_banners (boolean, default: true) — Remove cookie popups
- remove_ads (boolean, default: true) — Block ad networks

### POST /content/analyze
Host: api.webgrab.dev

AI-powered content analysis. SEO scoring, readability analysis, keyword density, heading structure, conversion signals, and page classification.

Parameters:
- url (string, required) — The URL being analyzed
- html (string, default: null) — Pre-fetched HTML (skips browser rendering)
- markdown (string, default: null) — Pre-fetched markdown content
- metadata (object, default: null) — Pre-fetched metadata object
- links (object, default: null) — Pre-fetched links object
- analysis_type (string, default: "full") — "full", "seo", "content", or "technical"

### POST /meta
Host: api.webgrab.dev

Metadata extraction in under 500ms. OG tags, Twitter cards, JSON-LD schema, favicons, and RSS feeds. No headless browser needed.

Parameters:
- url (string, required) — URL to extract metadata from
- include_favicon (boolean, default: true) — Extract favicon URLs
- include_schema (boolean, default: true) — Parse JSON-LD schema
- include_feeds (boolean, default: true) — Discover RSS/Atom feeds

### POST /batch
Host: api.webgrab.dev

Batch processing up to 10 URLs per request. Parallel execution for meta extraction or content scraping at scale.

Parameters:
- urls (string[], required) — Array of URLs (max 10)
- operation (string, default: "meta") — "meta" or "content"

## Error Codes

- WG-100 (408) — Timeout, site took too long to load
- WG-101 (422) — Page too resource-intensive to capture
- WG-102 (422) — GDPR/cookie consent blocking content
- WG-103 (502) — Connection refused by target site
- WG-104 (413) — Payload too large
- WG-105 (502) — SSL certificate error
- WG-106 (502) — Domain not found
- WG-199 (500) — Unknown / unexpected error
- WG-200 (401) — API key missing
- WG-201 (401) — Invalid API key
- WG-300 (400) — Invalid request body (bad JSON)
- WG-301 (400) — Invalid URL format
- WG-302 (400) — Invalid device parameter
- WG-303 (400) — Invalid format parameter

## Pricing

- Free: 200 credits/month, no credit card required
- Growth: $9/month, 5,000 credits
- Pro: $29/month, 25,000 credits
- Scale: $79/month, 100,000 credits
- 1 credit = 1 API call to any endpoint

## Use Cases

- Web archiving and compliance screenshots
- SEO monitoring and metadata tracking
- Visual regression and UI testing
- Link preview and OG image generation
- Web scraping and data extraction for AI pipelines
- AI-powered content analysis at scale

## Links

- Website: https://webgrab.dev
- Docs: https://webgrab.dev/docs
- Blog: https://webgrab.dev/blog
- Pricing: https://webgrab.dev/pricing
- Status: https://webgrab.dev/status
- Changelog: https://webgrab.dev/changelog
- Alternatives: https://webgrab.dev/alternatives
- Use Cases: https://webgrab.dev/use-cases