---
title: "How to use Website Scraper"
url: "https://lookvalid.com/help/products/website-scraper.md"
canonical_url: "https://lookvalid.com/help/products/website-scraper"
last_updated: "2026-10-22"
type: "how-to"
summary: "What Website Scraper takes in, which fields it returns and how credits are charged for each lookup."
related: ["https://lookvalid.com/help/products/domain-authority.md", "https://lookvalid.com/help/products/domain-age.md", "https://lookvalid.com/help/products/website-contacts-scraper.md", "https://lookvalid.com/help/billing/plans-and-credits.md"]
---

# How to use Website Scraper

What Website Scraper takes in, which fields it returns and how credits are charged for each lookup.

## What it does

Fetches a public web page and returns its title, metadata, readable text and links.

## What you send

Send these fields in the JSON body of the request.

Request fields for Website Scraper

| Field | Type | Required | Limits |
| --- | --- | --- | --- |
| url | string | Required | up to 2,048 characters |
| format | "markdown" or "text" or "html" | Optional | no extra limit |

## What you get back

The `data` object of a successful response carries these fields. Every response also lists its `sources`, the `credits_charged` and whether it was a `cache_hit`.

Each field is described in the [API reference](https://lookvalid.com/docs/api/website-scraper.md).

Response fields for Website Scraper

| Field | Type |
| --- | --- |
| final_url | string |
| status | integer |
| title | string |
| description | string |
| canonical | string |
| language | string |
| headings | list |
| format | "markdown" or "text" or "html" |
| content | string |
| content_truncated | boolean |
| links | object |
| images | integer |
| word_count | integer |
| fetched_at | string |

## What it costs

10 credits per successful scrape (errors, empty and blocked pages are free).

What each outcome costs

| Case | Charge |
| --- | --- |
| Found | 10 credits |
| Nothing found | 0 credits |
| Repeat inside 7 days | 0 credits |
| Errors and invalid requests | 0 credits |

## Run it

From code, send a POST request to `https://YOUR_API_HOST/v1/website-scraper` with your API key.

A request to Website Scraper

```bash
curl -X POST https://YOUR_API_HOST/v1/website-scraper \
  -H "Authorization: Bearer $LOOKVALID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","format":"markdown"}'
```

Full parameters and response fields are in the [API reference](https://lookvalid.com/docs/api/website-scraper.md). To run a list of values, use a [bulk CSV job](https://lookvalid.com/help/api/bulk-csv-jobs.md).

## Good to know

- A repeat of the same lookup within 7 days is served from your cache and costs 0 credits.
- When the lookup finds nothing it returns `found: false` and costs 0 credits.
- Invalid input and errors are never charged.
- The API allows 200 requests per 10 seconds per key.

## Related

- [How to use Domain Authority](https://lookvalid.com/help/products/domain-authority.md)
- [How to use Domain Age](https://lookvalid.com/help/products/domain-age.md)
- [How to use Website Contacts Scraper](https://lookvalid.com/help/products/website-contacts-scraper.md)
- [Plans, credits and how they are spent](https://lookvalid.com/help/billing/plans-and-credits.md)