Get API key
Website Scraper

Website Scraper

Fetches a public web page and returns its title, metadata, readable text and links.

Get API keyRead the docs
POST/v1/website-scraper
curl -X POST https://YOUR_API_HOST/v1/website-scraper \
  -H "Authorization: Bearer $LOOKVALID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","format":"markdown"}'
Read docs
  • 10 credits per successful scrape (errors, empty and blocked pages are free)
  • Charged only when it finds something
  • Cached 7 days

10 credits per successful scrape (errors, empty and blocked pages are free)

Charged only when it finds something. A repeat inside 7 days is free.

Every LookValid product draws on one shared balance. See pricing.

From key to answer in three steps

One key, one POST to /v1/website-scraper and a JSON answer back. The same three steps work in any language that can send HTTPS.

  1. 01

    Create a key

    Sign up and copy a key from the dashboard. The same key works for every LookValid product and for the MCP server.

    Terminal
    export LOOKVALID_API_KEY="lv_live_..."
  2. 02

    Send the request

    POST a JSON body to /v1/website-scraper. 10 credits per successful scrape (errors, empty and blocked pages are free).

    request.sh
    curl -X POST https://YOUR_API_HOST/v1/website-scraper \
  -H "Authorization: Bearer $LOOKVALID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","format":"markdown"}'
  3. 03

    Read the answer

    A real run of this lookup on 2026-10-18. The data object has 14 named fields.

    response.json
    {
  "product": "website-scraper",
  "found": true,
  "data": {
    "final_url": "https://example.com/",
    "status": 200,
    "title": "Example Domain",
    "description": null,
    "canonical": null,
    "language": "en",
    "headings": [],
    "format": "markdown",
    "content": "This domain is for use in documentation examples without needing permission. This is not a service; avoid relying on it for testing and monitoring purposes.",
    "content_truncated": false,
    "links": {
  ...

A structured answer, not a page of text

The data object has 14 named fields. Every response also lists the sources behind the result, the credits charged and whether it was served from your cache.

  • FieldType
    final_urlstring
    statusinteger
    titlestring or null
    descriptionstring or null
    canonicalstring or null

    And 9 more fields in the API reference.

    Named fields. Every field is listed in the API reference.

    1. Your requestone API key
    2. Your cache7 daysRepeat: 0 credits
    3. Data sourcefirst lookupFound: 10 credits
    4. ResultJSON

    A repeat lookup is free. Results are cached per account for 7 days. Ask the same question again inside that window and the response comes back with cache_hit: true and no charge.

  • Terminal
    # Sent with every request, for every product
Authorization: Bearer $LOOKVALID_API_KEY

    One key for your code and your agents. Send your API key as a Bearer token. The same key and the same credit balance cover every other LookValid product. AI agents can call it as a tool on the MCP server at https://YOUR_API_HOST/v1/mcp.

14

named fields in every answer

7

days a repeat lookup is free

14

lookups on the same key and balance

Latest from the changelog

All changes

Priced in credits

Every LookValid product draws on one shared balance. Website Scraper uses 10 credits per successful scrape (errors, empty and blocked pages are free).

See pricingGet API key

Cost

10credits

Per successful scrape (errors, empty and blocked pages are free)

  • Found10 credits
  • Nothing found0 credits
  • Repeat inside 7 days0 credits
  • Errors and invalid requests0 credits

Questions about Website Scraper

01How much does Website Scraper cost?

10 credits per successful scrape (errors, empty and blocked pages are free). Credits come out of the one balance shared by every LookValid product.

02Am I charged when nothing is found?

No. When the lookup runs and finds nothing, it returns found: false and costs 0 credits. An error costs nothing either.

03How long are results cached?

For 7 days, per account. Repeating the same lookup inside that window returns cache_hit: true and costs 0 credits.

04Which API key do I use?

The same key as every other product. Send it as a Bearer token in the Authorization header. Email hello@lookvalid.com and we set up your account and send the key.