How to scrape Alibaba
Alibaba is an online store where you can browse and purchase products. Developers typically collect product information, pricing, availability, and category hierarchies from its public pages.
Ujeebu scrapes any public website. Not listed here? Try any URL in the Playground or ask us about a site.
26 of 33 of our checks passed in the last 7 days (78.8%).
Last check 2026-11-03 14:02 UTC · last pass 2026-11-03 14:02 UTC · checked with our own requests, never customer data.
No one-call recipe yet for Alibaba: the extract rules below do the same job in your request, or ask us.
Run the code on this page with your own key: 5,000 free credits for 7 days, no card. Get a free API key →
Recipe
Search and listing pages contain product data including name, image, description, SKU, MPN, brand name, offer URL, offer count, availability status, and price currency. Image objects provide content URL, credit text, and creator information. Breadcrumb lists show category hierarchy with position, name, and item details. Each recipe was run on two real Alibaba pages and keeps only the fields that came back on both; it is checked again every week, and hidden if it stops working.
Public pages
Validated 2026-10-30What these rules extract
| Field | Type | Example |
|---|---|---|
product.availability | text | InStock |
product.brand | text | Foshan Shunde Stelang Electric Appliance Co., Ltd. |
product.currency | text | USD |
product.image | image URL | https://sc04.alicdn.com/kf/H837dbfcd1d6c4382bbc9ab102ef4e199z.jpg |
product.price | number (as text) | 33 |
product.sku | number (as text) | 1600273939968 |
product.url | URL | //indonesian.alibaba.com/product-detail/Italian-Coffee-15bar-Espres... |
Examples from www.alibaba.com/product-detail/_1600273939968.html on 2026-10-30, shortened.
Sample output (real, trimmed)
{
"product": {
"availability": "InStock",
"brand": "Foshan Shunde Stelang Electric Appliance Co., Ltd.",
"currency": "USD",
"image": "https://sc04.alicdn.com/kf/H837dbfcd1d6c4382bbc9ab102ef4e199z.jpg",
"price": "33",
"sku": "1600273939968",
"url": "//indonesian.alibaba.com/product-detail/Italian-Coffee-15bar-Espresso-Maker-Coff-1600273939968.html"
}
}
extract_rules (1 rule)
{
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };"
}
}
Code
Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one sends the settings on this page and the extraction recipe, prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.
Public pages
Runs the recipe on the two pages it was validated on, one after the other.
pip install ujeebu-python==0.1.5 # Scrape Alibaba public pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 alibaba_page_sdk.py
import json
import os
import sys
import time
import requests
from ujeebu_python import UjeebuClient
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://www.alibaba.com/product-detail/_1600273939968.html",
"https://www.alibaba.com/product-detail/_1600477260152.html",
]
SETTINGS = {
"js": True,
"wait_for": 8000,
"auto_captcha_solve": True,
"timeout": 150,
}
EXTRACT_RULES = {
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };",
},
}
def scrape(client, url):
# with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
try:
response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
except requests.RequestException as error:
sys.exit(f"Request failed for {url}: {error}")
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
client = UjeebuClient(api_key=API_KEY, timeout=180)
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(client, url), indent=2, ensure_ascii=False))
npm install @ujeebu-org/ujeebu-sdk@0.1.2 // Scrape Alibaba public pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node alibaba_page_sdk.mjs
import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://www.alibaba.com/product-detail/_1600273939968.html",
"https://www.alibaba.com/product-detail/_1600477260152.html",
];
const SETTINGS = {
js: true,
wait_for: 8000,
auto_captcha_solve: true,
timeout: 150,
};
const EXTRACT_RULES = {
product: {
type: "fn",
fn: "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };",
},
};
async function scrape(client, url) {
let res;
try {
// client.scrape POSTs JSON when extract_rules is set (scrapeWithRules would send it as a GET query, which the API ignores)
res = await client.scrape(url, { ...SETTINGS, extract_rules: EXTRACT_RULES });
} catch (err) {
const status = err.response?.status ?? 'error';
const message = err.response?.data?.message ?? err.message;
console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers['ujb-credits']}`);
return res.data.result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(client, url), null, 2));
}
pip install requests # Scrape Alibaba public pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key python3 alibaba_page.py (pip install requests)
import json
import os
import sys
import time
import requests
API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://www.alibaba.com/product-detail/_1600273939968.html",
"https://www.alibaba.com/product-detail/_1600477260152.html",
]
SETTINGS = {
"js": True,
"wait_for": 8000,
"auto_captcha_solve": True,
"timeout": 150,
}
EXTRACT_RULES = {
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };",
},
}
def scrape(url):
response = requests.post(
API_URL,
headers={"ApiKey": API_KEY},
json={"url": url, **SETTINGS, "extract_rules": EXTRACT_RULES},
timeout=180,
)
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(url), indent=2, ensure_ascii=False))
// Scrape Alibaba public pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key node alibaba_page.mjs (Node.js 18 or later)
const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://www.alibaba.com/product-detail/_1600273939968.html",
"https://www.alibaba.com/product-detail/_1600477260152.html",
];
const SETTINGS = {
js: true,
wait_for: 8000,
auto_captcha_solve: true,
timeout: 150,
};
const EXTRACT_RULES = {
product: {
type: "fn",
fn: "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };",
},
};
async function scrape(url) {
const res = await fetch(API_URL, {
method: 'POST',
headers: { ApiKey: API_KEY, 'Content-Type': 'application/json' },
body: JSON.stringify({ url, ...SETTINGS, extract_rules: EXTRACT_RULES }),
signal: AbortSignal.timeout(180000),
});
const text = await res.text();
if (res.status !== 200) {
let message = text;
try {
message = JSON.parse(text).message ?? text;
} catch {}
console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}`);
return JSON.parse(text).result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(url), null, 2));
}
#!/usr/bin/env bash
# Scrape Alibaba public pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key bash alibaba_page.sh (curl 7.76 or later)
set -euo pipefail
curl -sS --fail-with-body --max-time 180 -D headers.txt \
-X POST 'https://api.ujeebu.com/scrape' \
-H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
-H 'Content-Type: application/json' \
--data-binary @- <<'JSON'
{
"url": "https://www.alibaba.com/product-detail/_1600273939968.html",
"js": true,
"wait_for": 8000,
"auto_captcha_solve": true,
"timeout": 150,
"extract_rules": {
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };"
}
}
}
JSON
echo
grep -i '^ujb-credits' headers.txt >&2
<?php
// Scrape Alibaba public pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key php alibaba_page.php (PHP 7.4 or later with curl)
$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$urls = [
'https://www.alibaba.com/product-detail/_1600273939968.html',
'https://www.alibaba.com/product-detail/_1600477260152.html',
];
$settings = [
'js' => true,
'wait_for' => 8000,
'auto_captcha_solve' => true,
'timeout' => 150,
];
$extractRules = [
'product' => [
'type' => 'fn',
'fn' => 'const T = [\'Product\', \'ProductGroup\', \'IndividualProduct\', \'Vehicle\', \'Car\']; const n = [...document.querySelectorAll(\'script[type="application/ld+json"]\')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x[\'@graph\'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x[\'@type\']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split(\'|\').map(q => q.split(\'.\').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== \'\'); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(\', \') : (v && typeof v === \'object\' ? (v.name ?? v[\'@id\'] ?? null) : (typeof v === \'string\' ? v.replace(\'https://schema.org/\', \'\').replace(\'http://schema.org/\', \'\') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g(\'offers.availability\')), brand: one(g(\'brand.name|brand\')), currency: all(g(\'offers.priceCurrency|offers.priceSpecification.priceCurrency\')), image: one(g(\'image.url|image\')), price: all(g(\'offers.price|offers.lowPrice|offers.priceSpecification.price\')), sku: one(g(\'sku|mpn|productID\')), url: one(g(\'url|offers.url\')) };',
],
];
function scrape(string $url, string $apiKey, array $settings, array $extractRules)
{
$ch = curl_init('https://api.ujeebu.com/scrape');
$headers = [];
curl_setopt_array($ch, [
CURLOPT_POST => true,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 180,
CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey, 'Content-Type: application/json'],
CURLOPT_POSTFIELDS => json_encode(['url' => $url] + $settings + ['extract_rules' => $extractRules]),
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
if (strpos($line, ':') !== false) {
[$k, $v] = explode(':', $line, 2);
$headers[strtolower(trim($k))] = trim($v);
}
return strlen($line);
},
]);
$body = curl_exec($ch);
if ($body === false) {
fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
exit(1);
}
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
if ($status !== 200) {
$message = json_decode($body, true)['message'] ?? $body;
fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
exit(1);
}
fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . "\n");
return json_decode($body, true)['result'];
}
foreach ($urls as $i => $url) {
if ($i > 0) {
sleep(2); // be polite: one page at a time
}
echo json_encode(scrape($url, $apiKey, $settings, $extractRules), JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
}
go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8 // Scrape Alibaba public pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-30 (Ujeebu site guide).
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run alibaba_page.go
package main
import (
"encoding/json"
"errors"
"fmt"
"os"
"time"
ujeebu "github.com/ujeebu/ujeebu-go"
)
var urls = []string{
"https://www.alibaba.com/product-detail/_1600273939968.html",
"https://www.alibaba.com/product-detail/_1600477260152.html",
}
// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), brand: one(g('brand.name|brand')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };"
}
}`
var extractRules map[string]any
func fail(format string, args ...any) {
fmt.Fprintf(os.Stderr, format+"\n", args...)
os.Exit(1)
}
func short(s string) string {
if len(s) > 300 {
return s[:300]
}
return s
}
func params(target string) ujeebu.ScrapeParams {
p := ujeebu.ScrapeParams{URL: target}
p.JS = true
p.WaitFor = "8000"
p.Timeout = 150
// auto_captcha_solve: the Go SDK v0.1.8 has no field for it, so this script runs
// without it (the CAPTCHA solver is off). The cURL, Python, Node.js and PHP scripts send it.
p.ExtractRules = extractRules
return p
}
func scrape(client *ujeebu.Client, target string) map[string]any {
// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
resp, credits, err := client.Scrape(params(target))
if err != nil {
var apiErr *ujeebu.APIError
if errors.As(err, &apiErr) {
fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
}
fail("Request failed for %s: %v", target, err)
}
fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
result, _ := resp.Result.(map[string]any)
return result
}
func printJSON(v any) {
enc := json.NewEncoder(os.Stdout)
enc.SetEscapeHTML(false)
enc.SetIndent("", " ")
if err := enc.Encode(v); err != nil {
fail("Cannot print the result: %v", err)
}
}
func main() {
apiKey := os.Getenv("UJEEBU_API_KEY")
if apiKey == "" {
fail("Set the UJEEBU_API_KEY environment variable.")
}
if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
fail("Bad extract rules: %v", err)
}
client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
if err != nil {
fail("%v", err)
}
for i, target := range urls {
if i > 0 {
time.Sleep(2 * time.Second) // be polite: one page at a time
}
printJSON(scrape(client, target))
}
}
SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/alibaba.json.
Try it yourself
Run this on Alibaba with your own key
Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card.
URL patterns and pagination
What the URLs look like, read from the pages our checks fetched.
Public pages
- Pattern
https://www.alibaba.com/product-detail/{id}.html- Validated on
https://www.alibaba.com/product-detail/_1600273939968.htmlhttps://www.alibaba.com/product-detail/_1600477260152.html
Settings that work today
From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.
| Endpoint | /scrape |
|---|---|
js | true |
wait_for | 8000 |
auto_captcha_solve | true |
timeout | 150 |
| Cost | up to 10 credits a request (only HTTP 200 and 404 are billed; blocked, timed-out and failed requests are free) |
| Learned | js + wait 8000 + captcha solver (found by our retry layer) |
Pages of this site show a CAPTCHA. With auto_captcha_solve the API solved it in 96 of 110 checks over the last 30 days, in about 16 seconds a request. Each request with auto_captcha_solve costs 5 extra credits.
Our engineers are looking at this site.
For search and listing pages, change the query or the page parameter in the URL to paginate, and fetch the pages one after another rather than in bursts. Our checks pass with JavaScript rendering on (js=true) and a wait of 8 seconds (wait_for=8000) before the snapshot: keep both. Start with the default (rotating) proxy, the cheapest one that passed most of its attempts in our checks.
Proxies we tried on Alibaba (1), attempts and passes over 7 days
| Proxy | Attempts | Passed |
|---|---|---|
| Default (rotating) | 37 | 27 |
Highlighted: the cheapest proxy that passes most of our checks of this site.
Troubleshooting
The failures our own checks of alibaba.com ran into over the last 7 days, and what got the page in the same check.
| What happened | Times | What fixed it |
|---|---|---|
| A captcha page instead of the content | 9 | Turning on auto_captcha_solve=true (the CAPTCHA solver): it got the page in 96 of 110 checks over 30 days.
|
| A different page than expected | 1 | None of the settings we tried got past it in 7 days. |
What people build with Alibaba data
- Price monitoringTrack the price and availability of the products you follow, and alert on changes.More on this use case
- Catalog and assortment trackingFollow which products appear for a search or a category, and in which position.More on this use case
Limits and etiquette
- Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
- Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
- robots.txt of www.alibaba.com (read 2026-10-28): public pages asked to stay away (Disallow: /trade/); no crawl delay set.
- Read Alibaba's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.
Questions
Can you scrape Alibaba with Ujeebu?
Partly. 26 of 33 checks of public Alibaba pages passed in the last 7 days; most failures were a captcha page instead of the content. Retry failed pages later, and use the settings on this page.
Which settings work for Alibaba?
Call /scrape with js=true, wait_for=8000, auto_captcha_solve=true, timeout=150. On the default (rotating) proxy, 27 of 37 attempts passed in the last 7 days. Our retry layer found that this site needs "js + wait 8000 + captcha solver".
How many credits does a Alibaba request cost?
With these settings a request costs up to 10 credits, including 5 extra credits for auto_captcha_solve. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.
Which fields can I extract from Alibaba?
With the extraction recipes on this page, validated on real Alibaba pages through our API: public pages: availability, brand, currency, image, price, sku, url. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.
Is it allowed to scrape Alibaba?
Its robots.txt asks generic crawlers to stay away from public pages (Disallow: /trade/). Collect public pages only, read Alibaba's terms of service, keep your request rate modest and do not collect personal data you have no basis to process. This is not legal advice.
How fresh is this page?
The status and settings come from our own health checks of alibaba.com, which run around the clock. Last check: 2026-11-03 14:02:57 UTC; last pass: 2026-11-03 14:02:57 UTC.