How to scrape Gumtree
Gumtree is a marketplace and classifieds site where you can find listings for various products and services. Developers typically collect product information, pricing, availability, and category data from its public pages.
Ujeebu scrapes any public website. Not listed here? Try any URL in the Playground or ask us about a site.
14 of 14 of our checks passed in the last 7 days (100%).
Last check 2026-11-22 19:02 UTC · last pass 2026-11-22 19:02 UTC · checked with our own requests, never customer data.
Recipe one call
Use the Gumtree recipe: send the URL, get JSON
curl -G 'https://api.ujeebu.com/scrape' \
-H "ApiKey: $UJEEBU_API_KEY" \
--data-urlencode 'url=https://www.gumtree.com/search?search_category=all&q=bike' \
--data-urlencode 'recipe=gumtree/listing'
The answer is {"result": {...}} with the fields of the recipe. Billed like any /scrape call: successful responses cost credits; blocked, timed-out and failed requests are free.
Run the code on this page with your own key: 5,000 free credits for 7 days, no card. Get a free API key →
Recipes
Call a recipe by name with the recipe parameter: the Scrape API applies its extract rules and the settings that work on Gumtree. Each recipe was run on two real Gumtree pages and keeps only the fields that came back on both; it is checked again every week, and hidden if it stops working.
Search and listing pages
Validated 2026-11-21One call: recipe=gumtree/listing 25 credits (JS) a page
curl -G 'https://api.ujeebu.com/scrape' \
-H "ApiKey: $UJEEBU_API_KEY" \
--data-urlencode 'url=https://www.gumtree.com/search?search_category=all&q=bike' \
--data-urlencode 'recipe=gumtree/listing'
The answer is {"result": {...}} with the fields below; the Ujb-Recipe header names the version (for example gumtree/listing@v1) and Ujb-Credits the cost.
Search with parameters: query, page
No URL needed: send recipe=gumtree/search with the parameters below. The API builds the search URL (returned in the Ujb-Url header and the url field), applies the gumtree/listing recipe and answers the same JSON, at the same credits.
| Parameter | Type | What it is |
|---|---|---|
query * | text | Search words, as typed in the Gumtree search box. |
page | number 1 to 10 | Result page, 1 is the first page. Default: 1. |
One call, for {"query":"bike"}:
curl -G 'https://api.ujeebu.com/scrape' \
-H 'ApiKey: YOUR_API_KEY' \
-d 'recipe=gumtree/search' \
-d 'query=bike'
A missing or invalid parameter answers 400 with param naming it (not billed). Try it in the Playground or the Request builder (Search mode). Have the URL already? url=https://www.gumtree.com/search?search_category=all&q=bike with recipe=gumtree/listing works too. Search in the docs
What this recipe extracts
| Field | Type | Example |
|---|---|---|
ads | list of 3+ items | |
ads[].url | URL | https://www.gumtree.com/p/yamaha-motorbikes/yamaha-xjr1200-naked-mu... |
ads[].title | text | YAMAHA XJR1200 NAKED MUSCLE BIKE |
ads[].price | number (as text) | 2,895 |
Examples from www.gumtree.com/search on 2026-11-21, shortened.
Sample output (real, trimmed)
{
"ads": [
{
"url": "https://www.gumtree.com/p/other-bikes/bargin-brand-new-never-used-claud-butler-explorer-1.0-eq-hybrid-bike/1804242608",
"title": "Bargin! Brand New, NEVER USED Claud Butler Explorer 1.0 EQ Hybrid Bike",
"price": "250"
},
{
"url": "https://www.gumtree.com/p/other-bikes/shimono-mountain-bike-/1513755211",
"title": "Shimono mountain bike",
"price": "160"
},
{
"url": "https://www.gumtree.com/p/other-bikes/carrera-crossfire-e-spec-electric-bike-as-new-condition-cost-%C2%A31250-with-receipt-to-prove-bargain-525/1804384554",
"title": "Carrera crossfire e spec electric bike as new condition cost £1250 with receipt to prove bargain 525",
"price": "525"
}
]
}
extract_rules (1 rule): the rules behind the recipe
The API applies these rules and the settings js=true, proxy_country=GB for you when you send recipe=gumtree/listing. To change what comes back, send your own extract_rules (they replace the recipe's) or any setting (yours always win). Sites without a recipe work the same way with extract rules.
{
"ads": {
"selector": "div[data-testid=\"rh-standard-card-listing\"]",
"type": "obj",
"multiple": true,
"children": {
"url": {
"selector": "a.e25keea35",
"type": "link"
},
"title": {
"selector": "h2[data-testid='rh-standard-card-title']",
"type": "text"
},
"price": {
"selector": "span[data-testid='rh-standard-card-price-amount']",
"type": "text"
}
}
}
}
Ad pages
Validated 2026-11-06One call: recipe=gumtree/detail 25 credits (JS) a page
curl -G 'https://api.ujeebu.com/scrape' \
-H "ApiKey: $UJEEBU_API_KEY" \
--data-urlencode 'url=https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679' \
--data-urlencode 'recipe=gumtree/detail'
The answer is {"result": {...}} with the fields below; the Ujb-Recipe header names the version (for example gumtree/detail@v1) and Ujb-Credits the cost.
What this recipe extracts
| Field | Type | Example |
|---|---|---|
product.availability | text | InStock |
product.condition | text | UsedCondition |
product.currency | text | GBP |
product.image | URL | https://img.gumtree.com/ePR8PyKf84wPHx7_RYmEag/700096c647c44679b6_9... |
product.name | text | Trek roscoe 8 |
product.price | number (as text) | 250.00 |
product.sku | number (as text) | 1803797679 |
product.url | URL | https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679 |
Examples from www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679 on 2026-11-06, shortened.
Sample output (real, trimmed)
{
"product": {
"availability": "InStock",
"condition": "UsedCondition",
"currency": "GBP",
"image": "https://img.gumtree.com/ePR8PyKf84wPHx7_RYmEag/700096c647c44679b6_928077a6e7e4/86",
"name": "Trek roscoe 8",
"price": "250.00",
"sku": "1803797679",
"url": "https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679"
}
}
extract_rules (1 rule): the rules behind the recipe
The API applies these rules and the settings js=true, proxy_country=GB for you when you send recipe=gumtree/detail. To change what comes back, send your own extract_rules (they replace the recipe's) or any setting (yours always win). Sites without a recipe work the same way with extract rules.
{
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), condition: all(g('offers.itemCondition')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), name: all(g('name')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };"
}
}
Code
Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one calls the recipe by name (the Go SDK has no recipe field, so the Go script sends the recipe's rules and settings itself), prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.
Search and listing pages
Pages through 3 result pages, one at a time, and stops early when a page has no results.
pip install ujeebu-python==0.1.5 # Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 gumtree_listing_sdk.py
import json
import os
import sys
import time
from urllib.parse import parse_qsl, urlencode, urlsplit, urlunsplit
import requests
from ujeebu_python import UjeebuClient
API_KEY = os.environ.get("UJEEBU_API_KEY")
START_URL = "https://www.gumtree.com/search?search_category=all&q=bike"
PAGES = 3
RECIPE = "gumtree/listing" # rules and settings come from the recipe; add your own to override them
def page_url(page):
if page == 1:
return START_URL
parts = urlsplit(START_URL)
query = dict(parse_qsl(parts.query))
query["page"] = str(page)
return urlunsplit(parts._replace(query=urlencode(query)))
def scrape(client, url):
# a GET with recipe=: the API applies the recipe and answers {"result": {...}}
try:
response = client.scrape(url, params={"recipe": RECIPE})
except requests.RequestException as error:
sys.exit(f"Request failed for {url}: {error}")
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}, Ujb-Recipe: {response.headers.get('Ujb-Recipe')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
client = UjeebuClient(api_key=API_KEY)
for page in range(1, PAGES + 1):
result = scrape(client, page_url(page))
for item in result.get("ads") or []:
print(item.get("title"), item.get("price"))
# Example output:
# Bargin! Brand New, NEVER USED Claud B... 250
# Shimono mountain bike 160
# every field: print(json.dumps(result, indent=2, ensure_ascii=False))
if not result.get("ads"):
break
time.sleep(2) # be polite: one page at a time
npm install @ujeebu-org/ujeebu-sdk@0.1.2 // Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node gumtree_listing_sdk.mjs
import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';
const API_KEY = process.env.UJEEBU_API_KEY;
const START_URL = "https://www.gumtree.com/search?search_category=all&q=bike";
const PAGES = 3;
const RECIPE = "gumtree/listing"; // rules and settings come from the recipe; add your own to override them
function pageUrl(page) {
if (page === 1) return START_URL;
const url = new URL(START_URL);
url.searchParams.set("page", String(page));
return url.toString();
}
async function scrape(client, url) {
let res;
try {
// a GET with recipe=: the API applies the recipe and answers { result: {...} }
res = await client.scrape(url, { recipe: RECIPE });
} catch (err) {
const status = err.response?.status ?? 'error';
const message = err.response?.data?.message ?? err.message;
console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers['ujb-credits']}, Ujb-Recipe: ${res.headers['ujb-recipe']}`);
return res.data.result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (let page = 1; page <= PAGES; page++) {
const result = await scrape(client, pageUrl(page));
for (const item of (result?.ads ?? [])) {
console.log(item.title, item.price);
}
// Example output:
// Bargin! Brand New, NEVER USED Claud B... 250
// Shimono mountain bike 160
// every field: console.log(JSON.stringify(result, null, 2));
if (!result?.ads?.length) break;
await pause(2000); // be polite: one page at a time
}
pip install requests # Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
# Run: UJEEBU_API_KEY=your_key python3 gumtree_listing.py (pip install requests)
import json
import os
import sys
import time
from urllib.parse import parse_qsl, urlencode, urlsplit, urlunsplit
import requests
API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
START_URL = "https://www.gumtree.com/search?search_category=all&q=bike"
PAGES = 3
RECIPE = "gumtree/listing" # rules and settings come from the recipe; add your own to override them
def page_url(page):
if page == 1:
return START_URL
parts = urlsplit(START_URL)
query = dict(parse_qsl(parts.query))
query["page"] = str(page)
return urlunsplit(parts._replace(query=urlencode(query)))
def scrape(url):
response = requests.get(
API_URL,
headers={"ApiKey": API_KEY},
params={"url": url, "recipe": RECIPE},
timeout=180,
)
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}, Ujb-Recipe: {response.headers.get('Ujb-Recipe')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
for page in range(1, PAGES + 1):
result = scrape(page_url(page))
for item in result.get("ads") or []:
print(item.get("title"), item.get("price"))
# Example output:
# Bargin! Brand New, NEVER USED Claud B... 250
# Shimono mountain bike 160
# every field: print(json.dumps(result, indent=2, ensure_ascii=False))
if not result.get("ads"):
break
time.sleep(2) # be polite: one page at a time
// Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
// Run: UJEEBU_API_KEY=your_key node gumtree_listing.mjs (Node.js 18 or later)
const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const START_URL = "https://www.gumtree.com/search?search_category=all&q=bike";
const PAGES = 3;
const RECIPE = "gumtree/listing"; // rules and settings come from the recipe; add your own to override them
function pageUrl(page) {
if (page === 1) return START_URL;
const url = new URL(START_URL);
url.searchParams.set("page", String(page));
return url.toString();
}
async function scrape(url) {
const params = new URLSearchParams({ url, recipe: RECIPE });
const res = await fetch(`${API_URL}?${params}`, {
headers: { ApiKey: API_KEY },
signal: AbortSignal.timeout(180000),
});
const text = await res.text();
if (res.status !== 200) {
let message = text;
try {
message = JSON.parse(text).message ?? text;
} catch {}
console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}, Ujb-Recipe: ${res.headers.get('ujb-recipe')}`);
return JSON.parse(text).result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (let page = 1; page <= PAGES; page++) {
const result = await scrape(pageUrl(page));
for (const item of (result?.ads ?? [])) {
console.log(item.title, item.price);
}
// Example output:
// Bargin! Brand New, NEVER USED Claud B... 250
// Shimono mountain bike 160
// every field: console.log(JSON.stringify(result, null, 2));
if (!result?.ads?.length) break;
await pause(2000); // be polite: one page at a time
}
#!/usr/bin/env bash
# Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
# Run: UJEEBU_API_KEY=your_key bash gumtree_listing.sh (curl 7.76 or later)
set -euo pipefail
curl -sS --fail-with-body --max-time 180 -D headers.txt -G 'https://api.ujeebu.com/scrape' \
-H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
--data-urlencode 'url=https://www.gumtree.com/search?search_category=all&q=bike' \
--data-urlencode 'recipe=gumtree/listing'
echo
grep -i -E '^ujb-(credits|recipe)' headers.txt >&2
<?php
// Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/listing: the API applies its extract rules and validated settings (validated 2026-11-21). Send extract_rules or any setting to override them.
// Run: UJEEBU_API_KEY=your_key php gumtree_listing.php (PHP 7.4 or later with curl)
$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$startUrl = 'https://www.gumtree.com/search?search_category=all&q=bike';
$pages = 3;
$recipe = 'gumtree/listing'; // rules and settings come from the recipe; add your own to override them
function scrape(string $url, string $apiKey, string $recipe)
{
$ch = curl_init('https://api.ujeebu.com/scrape?' . http_build_query(['url' => $url, 'recipe' => $recipe]));
$headers = [];
curl_setopt_array($ch, [
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 180,
CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey],
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
if (strpos($line, ':') !== false) {
[$k, $v] = explode(':', $line, 2);
$headers[strtolower(trim($k))] = trim($v);
}
return strlen($line);
},
]);
$body = curl_exec($ch);
if ($body === false) {
fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
exit(1);
}
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
if ($status !== 200) {
$message = json_decode($body, true)['message'] ?? $body;
fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
exit(1);
}
fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . ', Ujb-Recipe: ' . ($headers['ujb-recipe'] ?? '?') . "\n");
return json_decode($body, true)['result'];
}
for ($page = 1; $page <= $pages; $page++) {
$parts = parse_url($startUrl);
parse_str($parts['query'] ?? '', $query);
$query['page'] = (string) ($page);
$url = $page === 1 ? $startUrl : $parts['scheme'] . '://' . $parts['host'] . ($parts['path'] ?? '/') . '?' . http_build_query($query);
$result = scrape($url, $apiKey, $recipe);
foreach ($result['ads'] ?? [] as $item) {
echo implode(' ', [$item['title'] ?? '', $item['price'] ?? '']), "\n";
}
// Example output:
// Bargin! Brand New, NEVER USED Claud B... 250
// Shimono mountain bike 160
// every field: echo json_encode($result, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
if (empty($result['ads'])) {
break;
}
sleep(2); // be polite: one page at a time
}
go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8 // Scrape Gumtree search and listing pages with the Ujeebu Scrape API.
// Sends the extract rules and settings of the recipe gumtree/listing itself: the Go SDK v0.1.8 has no recipe field and always sends js, which would override the recipe.
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run gumtree_listing.go
package main
import (
"encoding/json"
"errors"
"fmt"
"net/url"
"os"
"strconv"
"time"
ujeebu "github.com/ujeebu/ujeebu-go"
)
const startURL = "https://www.gumtree.com/search?search_category=all&q=bike"
const pages = 3
// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
"ads": {
"selector": "div[data-testid=\"rh-standard-card-listing\"]",
"type": "obj",
"multiple": true,
"children": {
"url": {
"selector": "a.e25keea35",
"type": "link"
},
"title": {
"selector": "h2[data-testid='rh-standard-card-title']",
"type": "text"
},
"price": {
"selector": "span[data-testid='rh-standard-card-price-amount']",
"type": "text"
}
}
}
}`
var extractRules map[string]any
func fail(format string, args ...any) {
fmt.Fprintf(os.Stderr, format+"\n", args...)
os.Exit(1)
}
func short(s string) string {
if len(s) > 300 {
return s[:300]
}
return s
}
func params(target string) ujeebu.ScrapeParams {
p := ujeebu.ScrapeParams{URL: target}
p.JS = true
p.ProxyCountry = "GB"
p.ExtractRules = extractRules
return p
}
func pageURL(page int) string {
if page == 1 {
return startURL
}
u, err := url.Parse(startURL)
if err != nil {
fail("Bad start URL: %v", err)
}
q := u.Query()
q.Set("page", strconv.Itoa(page))
u.RawQuery = q.Encode()
return u.String()
}
func scrape(client *ujeebu.Client, target string) map[string]any {
// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
resp, credits, err := client.Scrape(params(target))
if err != nil {
var apiErr *ujeebu.APIError
if errors.As(err, &apiErr) {
fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
}
fail("Request failed for %s: %v", target, err)
}
fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
result, _ := resp.Result.(map[string]any)
return result
}
func printJSON(v any) {
enc := json.NewEncoder(os.Stdout)
enc.SetEscapeHTML(false)
enc.SetIndent("", " ")
if err := enc.Encode(v); err != nil {
fail("Cannot print the result: %v", err)
}
}
func main() {
apiKey := os.Getenv("UJEEBU_API_KEY")
if apiKey == "" {
fail("Set the UJEEBU_API_KEY environment variable.")
}
if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
fail("Bad extract rules: %v", err)
}
client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
if err != nil {
fail("%v", err)
}
for page := 1; page <= pages; page++ {
result := scrape(client, pageURL(page))
printJSON(result)
items, _ := result["ads"].([]any)
if len(items) == 0 {
break
}
time.Sleep(2 * time.Second) // be polite: one page at a time
}
}
Ad pages
Runs the recipe on the two pages it was validated on, one after the other.
pip install ujeebu-python==0.1.5 # Scrape Gumtree ad pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 gumtree_detail_sdk.py
import json
import os
import sys
import time
import requests
from ujeebu_python import UjeebuClient
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679",
"https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888",
]
RECIPE = "gumtree/detail" # rules and settings come from the recipe; add your own to override them
def scrape(client, url):
# a GET with recipe=: the API applies the recipe and answers {"result": {...}}
try:
response = client.scrape(url, params={"recipe": RECIPE})
except requests.RequestException as error:
sys.exit(f"Request failed for {url}: {error}")
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}, Ujb-Recipe: {response.headers.get('Ujb-Recipe')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
client = UjeebuClient(api_key=API_KEY)
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
result = scrape(client, url)
product = result.get("product") or {}
print(product.get("name"), product.get("price"), product.get("condition"), product.get("currency"))
# Example output: Trek roscoe 8 250.00 UsedCondition GBP
# every field: print(json.dumps(result, indent=2, ensure_ascii=False))
npm install @ujeebu-org/ujeebu-sdk@0.1.2 // Scrape Gumtree ad pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node gumtree_detail_sdk.mjs
import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679",
"https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888",
];
const RECIPE = "gumtree/detail"; // rules and settings come from the recipe; add your own to override them
async function scrape(client, url) {
let res;
try {
// a GET with recipe=: the API applies the recipe and answers { result: {...} }
res = await client.scrape(url, { recipe: RECIPE });
} catch (err) {
const status = err.response?.status ?? 'error';
const message = err.response?.data?.message ?? err.message;
console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers['ujb-credits']}, Ujb-Recipe: ${res.headers['ujb-recipe']}`);
return res.data.result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
const result = await scrape(client, url);
const product = result?.product ?? {};
console.log(product.name, product.price, product.condition, product.currency);
// Example output: Trek roscoe 8 250.00 UsedCondition GBP
// every field: console.log(JSON.stringify(result, null, 2));
}
pip install requests # Scrape Gumtree ad pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
# Run: UJEEBU_API_KEY=your_key python3 gumtree_detail.py (pip install requests)
import json
import os
import sys
import time
import requests
API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679",
"https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888",
]
RECIPE = "gumtree/detail" # rules and settings come from the recipe; add your own to override them
def scrape(url):
response = requests.get(
API_URL,
headers={"ApiKey": API_KEY},
params={"url": url, "recipe": RECIPE},
timeout=180,
)
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}, Ujb-Recipe: {response.headers.get('Ujb-Recipe')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
result = scrape(url)
product = result.get("product") or {}
print(product.get("name"), product.get("price"), product.get("condition"), product.get("currency"))
# Example output: Trek roscoe 8 250.00 UsedCondition GBP
# every field: print(json.dumps(result, indent=2, ensure_ascii=False))
// Scrape Gumtree ad pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
// Run: UJEEBU_API_KEY=your_key node gumtree_detail.mjs (Node.js 18 or later)
const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679",
"https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888",
];
const RECIPE = "gumtree/detail"; // rules and settings come from the recipe; add your own to override them
async function scrape(url) {
const params = new URLSearchParams({ url, recipe: RECIPE });
const res = await fetch(`${API_URL}?${params}`, {
headers: { ApiKey: API_KEY },
signal: AbortSignal.timeout(180000),
});
const text = await res.text();
if (res.status !== 200) {
let message = text;
try {
message = JSON.parse(text).message ?? text;
} catch {}
console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}, Ujb-Recipe: ${res.headers.get('ujb-recipe')}`);
return JSON.parse(text).result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
const result = await scrape(url);
const product = result?.product ?? {};
console.log(product.name, product.price, product.condition, product.currency);
// Example output: Trek roscoe 8 250.00 UsedCondition GBP
// every field: console.log(JSON.stringify(result, null, 2));
}
#!/usr/bin/env bash
# Scrape Gumtree ad pages with the Ujeebu Scrape API.
# Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
# Run: UJEEBU_API_KEY=your_key bash gumtree_detail.sh (curl 7.76 or later)
set -euo pipefail
curl -sS --fail-with-body --max-time 180 -D headers.txt -G 'https://api.ujeebu.com/scrape' \
-H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
--data-urlencode 'url=https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679' \
--data-urlencode 'recipe=gumtree/detail'
echo
grep -i -E '^ujb-(credits|recipe)' headers.txt >&2
<?php
// Scrape Gumtree ad pages with the Ujeebu Scrape API.
// Calls the recipe gumtree/detail: the API applies its extract rules and validated settings (validated 2026-11-06). Send extract_rules or any setting to override them.
// Run: UJEEBU_API_KEY=your_key php gumtree_detail.php (PHP 7.4 or later with curl)
$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$urls = [
'https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679',
'https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888',
];
$recipe = 'gumtree/detail'; // rules and settings come from the recipe; add your own to override them
function scrape(string $url, string $apiKey, string $recipe)
{
$ch = curl_init('https://api.ujeebu.com/scrape?' . http_build_query(['url' => $url, 'recipe' => $recipe]));
$headers = [];
curl_setopt_array($ch, [
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 180,
CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey],
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
if (strpos($line, ':') !== false) {
[$k, $v] = explode(':', $line, 2);
$headers[strtolower(trim($k))] = trim($v);
}
return strlen($line);
},
]);
$body = curl_exec($ch);
if ($body === false) {
fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
exit(1);
}
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
if ($status !== 200) {
$message = json_decode($body, true)['message'] ?? $body;
fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
exit(1);
}
fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . ', Ujb-Recipe: ' . ($headers['ujb-recipe'] ?? '?') . "\n");
return json_decode($body, true)['result'];
}
foreach ($urls as $i => $url) {
if ($i > 0) {
sleep(2); // be polite: one page at a time
}
$result = scrape($url, $apiKey, $recipe);
$product = $result['product'] ?? [];
echo implode(' ', [$product['name'] ?? '', $product['price'] ?? '', $product['condition'] ?? '', $product['currency'] ?? '']), "\n";
// Example output: Trek roscoe 8 250.00 UsedCondition GBP
// every field: echo json_encode($result, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
}
go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8 // Scrape Gumtree ad pages with the Ujeebu Scrape API.
// Sends the extract rules and settings of the recipe gumtree/detail itself: the Go SDK v0.1.8 has no recipe field and always sends js, which would override the recipe.
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run gumtree_detail.go
package main
import (
"encoding/json"
"errors"
"fmt"
"os"
"time"
ujeebu "github.com/ujeebu/ujeebu-go"
)
var urls = []string{
"https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679",
"https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888",
}
// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
"product": {
"type": "fn",
"fn": "const T = ['Product', 'ProductGroup', 'IndividualProduct', 'Vehicle', 'Car']; const n = [...document.querySelectorAll('script[type=\"application/ld+json\"]')].flatMap(s => { try { return [].concat(JSON.parse(s.textContent)).flatMap(x => x['@graph'] || [x]); } catch (e) { return []; } }).find(x => x && [].concat(x['@type']).some(t => T.includes(t))); if (!n) return null; const g = p => p.split('|').map(q => q.split('.').reduce((v, k) => v == null ? v : (Array.isArray(v) ? v[0] : v)?.[k], n)).find(v => v != null && v !== ''); const all = v => Array.isArray(v) ? v.map(all).filter(x => x != null).join(', ') : (v && typeof v === 'object' ? (v.name ?? v['@id'] ?? null) : (typeof v === 'string' ? v.replace('https://schema.org/', '').replace('http://schema.org/', '') : v ?? null)); const one = v => all(Array.isArray(v) ? v[0] : v); return { availability: all(g('offers.availability')), condition: all(g('offers.itemCondition')), currency: all(g('offers.priceCurrency|offers.priceSpecification.priceCurrency')), image: one(g('image.url|image')), name: all(g('name')), price: all(g('offers.price|offers.lowPrice|offers.priceSpecification.price')), sku: one(g('sku|mpn|productID')), url: one(g('url|offers.url')) };"
}
}`
var extractRules map[string]any
func fail(format string, args ...any) {
fmt.Fprintf(os.Stderr, format+"\n", args...)
os.Exit(1)
}
func short(s string) string {
if len(s) > 300 {
return s[:300]
}
return s
}
func params(target string) ujeebu.ScrapeParams {
p := ujeebu.ScrapeParams{URL: target}
p.JS = true
p.ProxyCountry = "GB"
p.ExtractRules = extractRules
return p
}
func scrape(client *ujeebu.Client, target string) map[string]any {
// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
resp, credits, err := client.Scrape(params(target))
if err != nil {
var apiErr *ujeebu.APIError
if errors.As(err, &apiErr) {
fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
}
fail("Request failed for %s: %v", target, err)
}
fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
result, _ := resp.Result.(map[string]any)
return result
}
func printJSON(v any) {
enc := json.NewEncoder(os.Stdout)
enc.SetEscapeHTML(false)
enc.SetIndent("", " ")
if err := enc.Encode(v); err != nil {
fail("Cannot print the result: %v", err)
}
}
func main() {
apiKey := os.Getenv("UJEEBU_API_KEY")
if apiKey == "" {
fail("Set the UJEEBU_API_KEY environment variable.")
}
if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
fail("Bad extract rules: %v", err)
}
client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
if err != nil {
fail("%v", err)
}
for i, target := range urls {
if i > 0 {
time.Sleep(2 * time.Second) // be polite: one page at a time
}
printJSON(scrape(client, target))
}
}
SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/gumtree.json.
Try it yourself
Run this on Gumtree with your own key
Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card. These settings use proxy_country, which is available on paid plans and top-up packs.
URL patterns and pagination
What the URLs look like, read from the pages our checks fetched.
Search and listing pages
- Search or listing URL
https://www.gumtree.com/search?search_category=all&q={query}- Next pages
- add
page=2,page=3and so on. Page 2:https://www.gumtree.com/search?search_category=all&q=bike&page=2 - Validated on
https://www.gumtree.com/search?search_category=all&q=bikehttps://www.gumtree.com/search?search_category=all&q=sofa
Ad pages
- Pattern
https://www.gumtree.com/p/mountain-bikes/{slug}/{id}- Validated on
https://www.gumtree.com/p/mountain-bikes/trek-roscoe-8/1803797679https://www.gumtree.com/p/mountain-bikes/mountain-bikes-for-sale-/1803775888
Settings that work today
From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.
| Endpoint | /scrape |
|---|---|
js | true |
proxy_country | GB (paid plans and top-up packs) |
| Cost | up to 5 credits a request |
These settings use proxy_country. Proxy country (geo-targeting) is available on paid plans and top-up packs, so they need a paid plan or a top-up pack: the free trial alone does not include it.
For search and listing pages, change the query or the page parameter in the URL to paginate, and fetch the pages one after another rather than in bursts. Collect detail page URLs from listing pages first, then fetch each detail page. Our checks run with JavaScript rendering on (js=true): keep it on.
Troubleshooting
The failures our own checks of gumtree.com ran into over the last 7 days, and what got the page in the same check.
| What happened | Times | What fixed it |
|---|---|---|
| Page not found | 2 | The page was gone (HTTP 404). Not billed as a failure of the site: drop the URL. |
What people build with Gumtree data
- Price researchSee what similar items sell for, by condition and location.More on this use case
- New ads alertsCatch new ads for the searches you care about shortly after they appear.
Limits and etiquette
- Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
- Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
- robots.txt of www.gumtree.com (read 2026-11-17): public pages asked to stay away (Disallow: /search); no crawl delay set.
- Read Gumtree's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.
Questions
Can you scrape Gumtree with Ujeebu?
Yes. 14 of 14 checks of public Gumtree pages passed in the last 7 days with the settings on this page.
Which settings work for Gumtree?
Call /scrape with js=true, proxy_country=GB.
How many credits does a Gumtree request cost?
With these settings a request costs up to 5 credits. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.
Which fields can I extract from Gumtree?
With the extraction recipes on this page, validated on real Gumtree pages through our API: search and listing pages: url, title, price; ad pages: availability, condition, currency, image, name, price, sku, url. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.
Is it allowed to scrape Gumtree?
Its robots.txt asks generic crawlers to stay away from public pages (Disallow: /search). Collect public pages only, read Gumtree's terms of service, keep your request rate modest and do not collect personal data you have no basis to process. This is not legal advice.
How fresh is this page?
The status and settings come from our own health checks of gumtree.com, which run around the clock. Last check: 2026-11-22 19:02:19 UTC; last pass: 2026-11-22 19:02:19 UTC.