Playground Sign in Start free
E-commerce · amazon.com

How to scrape Amazon

Amazon is an online store accessible at amazon.com. Developers typically collect product information from search results, listings, and detail pages.

Mostly working

21 of 34 of our checks passed in the last 7 days (61.8%).

Last check 2026-11-02 22:35 UTC · last pass 2026-11-02 15:03 UTC · checked with our own requests, never customer data.

Try it in the Playground

Run the code on this page with your own key: 5,000 free credits for 7 days, no card. Get a free API key →

Extraction recipe

Search and listing pages contain product overviews and filtering options. Detail pages provide individual product information. The recipe below is a set of Scrape API extract rules: we ran it through our API on two real Amazon pages with the settings on this page and kept only the fields that came back on both. It is checked again every week, and hidden if it stops working.

Search and listing pages

Validated 2026-10-30
FieldTypeExample
productslist of 3+ items
products[].urlURLhttps://www.amazon.com/Bluetooth-Headphones-Cancelling-Earphones-Wa...
products[].titletextWireless Earbuds, 2026 Bluetooth 5.4 Headphones Bass Stereo Ear Bud...
products[].imageimage URLhttps://m.media-amazon.com/images/I/61aSuH86kYL._AC_UY218_.jpg
products[].ratingnumber (as text)4.7

Examples from www.amazon.com/s on 2026-10-30, shortened.

Sample output (real, trimmed)

{
    "products": [
        {
            "url": "https://www.amazon.com/Apple-Cancellation-Translation-Headphones-High-Fidelity/dp/B0FQFB8FMG/ref=sr_1_1?dib=eyJ2IjoiMSJ9.9r8IGamzvSO3jL0UEWb1BaWP1X08eynVu6CR...",
            "title": "Apple AirPods Pro 3 Wireless Earbuds with Active Noise Cancellation",
            "image": "https://m.media-amazon.com/images/I/61solmQSSlL._AC_UY218_.jpg",
            "rating": "4.4"
        },
        {
            "url": "https://www.amazon.com/JBL-Vibe-Beam-Wireless-Headphones/dp/B0BQPNMXQV/ref=sr_1_2?dib=eyJ2IjoiMSJ9.9r8IGamzvSO3jL0UEWb1BaWP1X08eynVu6CRNJ7f9P6EzmT-l2dMsWUvYB...",
            "title": "JBL Vibe Beam - True Wireless Earbuds - Black",
            "image": "https://m.media-amazon.com/images/I/41+1Csr1pSL._AC_UY218_.jpg",
            "rating": "4.2"
        },
        {
            "url": "https://www.amazon.com/HAOYUYAN-Bluetooth-Headphones-Waterproof-Running%EF%BC%88Black%EF%BC%89/dp/B0HJ1QBMNL/ref=sr_1_3?dib=eyJ2IjoiMSJ9.9r8IGamzvSO3jL0UEWb1...",
            "title": "HAOYUYAN Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones fo...",
            "image": "https://m.media-amazon.com/images/I/71QZW38j75L._AC_UY218_.jpg",
            "rating": "4.5"
        }
    ]
}
extract_rules (1 rule)
{
    "products": {
        "selector": "div.sg-col-20-of-24.s-result-item",
        "type": "obj",
        "multiple": true,
        "children": {
            "url": {
                "selector": "a.a-link-normal",
                "type": "link"
            },
            "title": {
                "selector": "h2.a-size-medium span",
                "type": "text"
            },
            "image": {
                "selector": "img.s-image",
                "type": "image"
            },
            "rating": {
                "selector": "span.a-size-small.a-color-base",
                "type": "text"
            }
        }
    }
}

Code

Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one sends the settings on this page and the extraction recipe, prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.

Search and listing pages

Pages through 3 result pages, one at a time, and stops early when a page has no results.

amazon_listing_sdk.py pip install ujeebu-python==0.1.5
# Scrape Amazon search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 amazon_listing_sdk.py

import json
import os
import sys
import time
from urllib.parse import parse_qsl, urlencode, urlsplit, urlunsplit

import requests
from ujeebu_python import UjeebuClient

API_KEY = os.environ.get("UJEEBU_API_KEY")
START_URL = "https://www.amazon.com/s?k=wireless+earbuds"
PAGES = 3
SETTINGS = {
    "js": True,
}
EXTRACT_RULES = {
    "products": {
        "selector": "div.sg-col-20-of-24.s-result-item",
        "type": "obj",
        "multiple": True,
        "children": {
            "url": {
                "selector": "a.a-link-normal",
                "type": "link",
            },
            "title": {
                "selector": "h2.a-size-medium span",
                "type": "text",
            },
            "image": {
                "selector": "img.s-image",
                "type": "image",
            },
            "rating": {
                "selector": "span.a-size-small.a-color-base",
                "type": "text",
            },
        },
    },
}


def page_url(page):
    if page == 1:
        return START_URL
    parts = urlsplit(START_URL)
    query = dict(parse_qsl(parts.query))
    query["page"] = str(page)
    return urlunsplit(parts._replace(query=urlencode(query)))


def scrape(client, url):
    # with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
    try:
        response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
    except requests.RequestException as error:
        sys.exit(f"Request failed for {url}: {error}")
    if response.status_code != 200:
        try:
            message = response.json().get("message", response.text)
        except ValueError:
            message = response.text
        sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
    print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
    return response.json()["result"]


if not API_KEY:
    sys.exit("Set the UJEEBU_API_KEY environment variable.")

client = UjeebuClient(api_key=API_KEY)

for page in range(1, PAGES + 1):
    result = scrape(client, page_url(page))
    print(json.dumps(result, indent=2, ensure_ascii=False))
    if not result.get("products"):
        break
    time.sleep(2)  # be polite: one page at a time

SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/amazon.json.

Try it yourself

Run this on Amazon with your own key

Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card.

URL patterns and pagination

What the URLs look like, read from the pages our checks fetched.

Search and listing pages

Search or listing URL
https://www.amazon.com/s?k={query}
Next pages
add page=2, page=3 and so on. Page 2: https://www.amazon.com/s?k=wireless+earbuds&page=2
Validated on
https://www.amazon.com/s?k=wireless+earbudshttps://www.amazon.com/s?k=backpack

Settings that work today

From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.

Endpoint/scrape
jstrue
proxy_typeadvanced
wait_for8000
devicemobile
Costup to 10 credits a request (only HTTP 200 and 404 are billed)
Learnedjs + wait 8000 + mobile on advanced (found by our retry layer)

Our engineers are looking at this site.

For search and listing pages, change the query or the page parameter in the URL to paginate, and fetch the pages one after another rather than in bursts. Collect detail page URLs from listing pages first, then fetch each detail page. Our checks pass with JavaScript rendering on (js=true) and a wait of 8 seconds (wait_for=8000) before the snapshot: keep both.

Try it in the Playground

Troubleshooting

The failures our own checks of amazon.com ran into over the last 7 days, and what got the page in the same check.

What happenedTimesWhat fixed it
A different page than expected 17 None of the settings we tried got past it in 7 days.
The site blocked the request (HTTP 403 or a block page) 1 None of the settings we tried got past it in 7 days.

A failed request is not billed: only HTTP 200 and 404 responses cost credits.

What people build with Amazon data

  • Catalog and assortment trackingFollow which products appear for a search or a category, and in which position.More on this use case
  • Ratings and reviews trackingWatch how ratings and review counts move over time for your products and competitors.More on this use case

Limits and etiquette

  • Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
  • Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
  • robots.txt of www.amazon.com (read 2026-10-27): public pages allowed for generic crawlers; no crawl delay set.
  • Read Amazon's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.

Questions

Can you scrape Amazon with Ujeebu?

Partly. 21 of 34 checks of public Amazon pages passed in the last 7 days; most failures were a different page than expected. Retry failed pages later, and use the settings on this page.

Which settings work for Amazon?

Call /scrape with js=true, proxy_type=advanced, wait_for=8000, device=mobile. Our retry layer found that this site needs "js + wait 8000 + mobile on advanced".

How many credits does a Amazon request cost?

With these settings a request costs up to 10 credits. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.

Which fields can I extract from Amazon?

With the extraction recipes on this page, validated on real Amazon pages through our API: search and listing pages: url, title, image, rating. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.

Is it allowed to scrape Amazon?

Its robots.txt allows generic crawlers on the page types in this guide. Collect public pages only, read Amazon's terms of service, keep your request rate modest and do not collect personal data you have no basis to process. This is not legal advice.

How fresh is this page?

The status and settings come from our own health checks of amazon.com, which run around the clock. Last check: 2026-11-02 22:35:47 UTC; last pass: 2026-11-02 15:03:59 UTC.