How to scrape Craigslist: settings that work today

Extraction recipe

Search and listing pages carry structured data (SearchResultsPage, ItemList). You can read those fields straight from the HTML, or select any other field with extract rules (CSS selectors). The recipe below is a set of Scrape API extract rules: we ran it through our API on two real Craigslist pages with the settings on this page and kept only the fields that came back on both. It is checked again every week, and hidden if it stops working.

Search and listing pages

Validated 2026-10-13

Field	Type	Example
`ads`	list of 3+ items
`ads[].url`	URL	https://www.craigslist.org/view/d/vacaville-marvel-table-and-couch/...
`ads[].title`	text	Marvel table and couch
`ads[].price`	text	$350
`ads[].location`	text	fairfield / vacaville
`ads[].posted`	text	<1hr ago

Examples from sfbay.craigslist.org/search/sss on 2026-10-13, shortened.

Sample output (real, trimmed)

{
    "ads": [
        {
            "url": "https://www.craigslist.org/view/d/vacaville-marvel-table-and-couch/sKqw31UDpr9ULVkWt6eWcm",
            "title": "Marvel table and couch",
            "price": "$350",
            "location": "fairfield / vacaville",
            "posted": "<1hr ago"
        },
        {
            "url": "https://www.craigslist.org/view/d/fairfax-awesome-couch-sofa-for-sale/6TkqDe4BMHrcudjdbiiuvF",
            "title": "Awesome couch/sofa for sale!",
            "price": "$400",
            "location": "fairfax",
            "posted": "<1hr ago"
        },
        {
            "url": "https://www.craigslist.org/view/d/watsonville-heat-remotes-for-rv-couch/q8nBizuFia5MrEhxAPGbWs",
            "title": "Heat remotes for RV couch",
            "price": "$25",
            "location": "watsonville",
            "posted": "<1hr ago"
        }
    ]
}

extract_rules (1 rule)

{
    "ads": {
        "selector": "div.cl-search-result.cl-search-view-mode-gallery",
        "type": "obj",
        "multiple": true,
        "children": {
            "url": {
                "selector": "a.main",
                "type": "link"
            },
            "title": {
                "selector": "a.posting-title span.label",
                "type": "text"
            },
            "price": {
                "selector": "span.priceinfo",
                "type": "text"
            },
            "location": {
                "selector": "span.result-location",
                "type": "text"
            },
            "posted": {
                "selector": "span.result-posted-date",
                "type": "text"
            }
        }
    }
}

Code

Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one sends the settings on this page and the extraction recipe, prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.

Search and listing pages

Runs the recipe on the two pages it was validated on, one after the other.

craigslist_listing_sdk.py pip install ujeebu-python==0.1.5

# Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 craigslist_listing_sdk.py

import json
import os
import sys
import time

import requests
from ujeebu_python import UjeebuClient

API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
    "https://sfbay.craigslist.org/search/sss?query=couch",
    "https://newyork.craigslist.org/search/sss?query=iphone",
]
SETTINGS = {
    "js": True,
}
EXTRACT_RULES = {
    "ads": {
        "selector": "div.cl-search-result.cl-search-view-mode-gallery",
        "type": "obj",
        "multiple": True,
        "children": {
            "url": {
                "selector": "a.main",
                "type": "link",
            },
            "title": {
                "selector": "a.posting-title span.label",
                "type": "text",
            },
            "price": {
                "selector": "span.priceinfo",
                "type": "text",
            },
            "location": {
                "selector": "span.result-location",
                "type": "text",
            },
            "posted": {
                "selector": "span.result-posted-date",
                "type": "text",
            },
        },
    },
}


def scrape(client, url):
    # with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
    try:
        response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
    except requests.RequestException as error:
        sys.exit(f"Request failed for {url}: {error}")
    if response.status_code != 200:
        try:
            message = response.json().get("message", response.text)
        except ValueError:
            message = response.text
        sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
    print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
    return response.json()["result"]


if not API_KEY:
    sys.exit("Set the UJEEBU_API_KEY environment variable.")

client = UjeebuClient(api_key=API_KEY)

for i, url in enumerate(URLS):
    if i:
        time.sleep(2)  # be polite: one page at a time
    print(json.dumps(scrape(client, url), indent=2, ensure_ascii=False))

craigslist_listing_sdk.mjs npm install @ujeebu-org/ujeebu-sdk@0.1.2

// Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node craigslist_listing_sdk.mjs

import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';

const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
  "https://sfbay.craigslist.org/search/sss?query=couch",
  "https://newyork.craigslist.org/search/sss?query=iphone",
];
const SETTINGS = {
  js: true,
};
const EXTRACT_RULES = {
  ads: {
    selector: "div.cl-search-result.cl-search-view-mode-gallery",
    type: "obj",
    multiple: true,
    children: {
      url: {
        selector: "a.main",
        type: "link",
      },
      title: {
        selector: "a.posting-title span.label",
        type: "text",
      },
      price: {
        selector: "span.priceinfo",
        type: "text",
      },
      location: {
        selector: "span.result-location",
        type: "text",
      },
      posted: {
        selector: "span.result-posted-date",
        type: "text",
      },
    },
  },
};

async function scrape(client, url) {
  let res;
  try {
    // client.scrape POSTs JSON when extract_rules is set (scrapeWithRules would send it as a GET query, which the API ignores)
    res = await client.scrape(url, { ...SETTINGS, extract_rules: EXTRACT_RULES });
  } catch (err) {
    const status = err.response?.status ?? 'error';
    const message = err.response?.data?.message ?? err.message;
    console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
    process.exit(1);
  }
  console.error(`Ujb-Credits: ${res.headers['ujb-credits']}`);
  return res.data.result;
}

if (!API_KEY) {
  console.error('Set the UJEEBU_API_KEY environment variable.');
  process.exit(1);
}

const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));

for (const [i, url] of URLS.entries()) {
  if (i) await pause(2000); // be polite: one page at a time
  console.log(JSON.stringify(await scrape(client, url), null, 2));
}

craigslist_listing.py pip install requests

# Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key python3 craigslist_listing.py   (pip install requests)

import json
import os
import sys
import time

import requests

API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
    "https://sfbay.craigslist.org/search/sss?query=couch",
    "https://newyork.craigslist.org/search/sss?query=iphone",
]
SETTINGS = {
    "js": True,
}
EXTRACT_RULES = {
    "ads": {
        "selector": "div.cl-search-result.cl-search-view-mode-gallery",
        "type": "obj",
        "multiple": True,
        "children": {
            "url": {
                "selector": "a.main",
                "type": "link",
            },
            "title": {
                "selector": "a.posting-title span.label",
                "type": "text",
            },
            "price": {
                "selector": "span.priceinfo",
                "type": "text",
            },
            "location": {
                "selector": "span.result-location",
                "type": "text",
            },
            "posted": {
                "selector": "span.result-posted-date",
                "type": "text",
            },
        },
    },
}


def scrape(url):
    response = requests.post(
        API_URL,
        headers={"ApiKey": API_KEY},
        json={"url": url, **SETTINGS, "extract_rules": EXTRACT_RULES},
        timeout=180,
    )
    if response.status_code != 200:
        try:
            message = response.json().get("message", response.text)
        except ValueError:
            message = response.text
        sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
    print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
    return response.json()["result"]


if not API_KEY:
    sys.exit("Set the UJEEBU_API_KEY environment variable.")

for i, url in enumerate(URLS):
    if i:
        time.sleep(2)  # be polite: one page at a time
    print(json.dumps(scrape(url), indent=2, ensure_ascii=False))

craigslist_listing.mjs

// Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key node craigslist_listing.mjs   (Node.js 18 or later)

const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
  "https://sfbay.craigslist.org/search/sss?query=couch",
  "https://newyork.craigslist.org/search/sss?query=iphone",
];
const SETTINGS = {
  js: true,
};
const EXTRACT_RULES = {
  ads: {
    selector: "div.cl-search-result.cl-search-view-mode-gallery",
    type: "obj",
    multiple: true,
    children: {
      url: {
        selector: "a.main",
        type: "link",
      },
      title: {
        selector: "a.posting-title span.label",
        type: "text",
      },
      price: {
        selector: "span.priceinfo",
        type: "text",
      },
      location: {
        selector: "span.result-location",
        type: "text",
      },
      posted: {
        selector: "span.result-posted-date",
        type: "text",
      },
    },
  },
};

async function scrape(url) {
  const res = await fetch(API_URL, {
    method: 'POST',
    headers: { ApiKey: API_KEY, 'Content-Type': 'application/json' },
    body: JSON.stringify({ url, ...SETTINGS, extract_rules: EXTRACT_RULES }),
    signal: AbortSignal.timeout(180000),
  });
  const text = await res.text();
  if (res.status !== 200) {
    let message = text;
    try {
      message = JSON.parse(text).message ?? text;
    } catch {}
    console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
    process.exit(1);
  }
  console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}`);
  return JSON.parse(text).result;
}

if (!API_KEY) {
  console.error('Set the UJEEBU_API_KEY environment variable.');
  process.exit(1);
}

const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));

for (const [i, url] of URLS.entries()) {
  if (i) await pause(2000); // be polite: one page at a time
  console.log(JSON.stringify(await scrape(url), null, 2));
}

craigslist_listing.sh

#!/usr/bin/env bash
# Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key bash craigslist_listing.sh   (curl 7.76 or later)
set -euo pipefail

curl -sS --fail-with-body --max-time 180 -D headers.txt \
  -X POST 'https://api.ujeebu.com/scrape' \
  -H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
  -H 'Content-Type: application/json' \
  --data-binary @- <<'JSON'
{
  "url": "https://sfbay.craigslist.org/search/sss?query=couch",
  "js": true,
  "extract_rules": {
    "ads": {
      "selector": "div.cl-search-result.cl-search-view-mode-gallery",
      "type": "obj",
      "multiple": true,
      "children": {
        "url": {
          "selector": "a.main",
          "type": "link"
        },
        "title": {
          "selector": "a.posting-title span.label",
          "type": "text"
        },
        "price": {
          "selector": "span.priceinfo",
          "type": "text"
        },
        "location": {
          "selector": "span.result-location",
          "type": "text"
        },
        "posted": {
          "selector": "span.result-posted-date",
          "type": "text"
        }
      }
    }
  }
}
JSON
echo
grep -i '^ujb-credits' headers.txt >&2

craigslist_listing.php

<?php
// Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key php craigslist_listing.php   (PHP 7.4 or later with curl)

$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$urls = [
    'https://sfbay.craigslist.org/search/sss?query=couch',
    'https://newyork.craigslist.org/search/sss?query=iphone',
];
$settings = [
    'js' => true,
];
$extractRules = [
    'ads' => [
        'selector' => 'div.cl-search-result.cl-search-view-mode-gallery',
        'type' => 'obj',
        'multiple' => true,
        'children' => [
            'url' => [
                'selector' => 'a.main',
                'type' => 'link',
            ],
            'title' => [
                'selector' => 'a.posting-title span.label',
                'type' => 'text',
            ],
            'price' => [
                'selector' => 'span.priceinfo',
                'type' => 'text',
            ],
            'location' => [
                'selector' => 'span.result-location',
                'type' => 'text',
            ],
            'posted' => [
                'selector' => 'span.result-posted-date',
                'type' => 'text',
            ],
        ],
    ],
];

function scrape(string $url, string $apiKey, array $settings, array $extractRules)
{
    $ch = curl_init('https://api.ujeebu.com/scrape');
    $headers = [];
    curl_setopt_array($ch, [
        CURLOPT_POST => true,
        CURLOPT_RETURNTRANSFER => true,
        CURLOPT_TIMEOUT => 180,
        CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey, 'Content-Type: application/json'],
        CURLOPT_POSTFIELDS => json_encode(['url' => $url] + $settings + ['extract_rules' => $extractRules]),
        CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
            if (strpos($line, ':') !== false) {
                [$k, $v] = explode(':', $line, 2);
                $headers[strtolower(trim($k))] = trim($v);
            }
            return strlen($line);
        },
    ]);
    $body = curl_exec($ch);
    if ($body === false) {
        fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
        exit(1);
    }
    $status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
    if ($status !== 200) {
        $message = json_decode($body, true)['message'] ?? $body;
        fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
        exit(1);
    }
    fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . "\n");
    return json_decode($body, true)['result'];
}

foreach ($urls as $i => $url) {
    if ($i > 0) {
        sleep(2); // be polite: one page at a time
    }
    echo json_encode(scrape($url, $apiKey, $settings, $extractRules), JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
}

craigslist_listing.go go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8

// Scrape Craigslist search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run craigslist_listing.go

package main

import (
	"encoding/json"
	"errors"
	"fmt"
	"os"
	"time"

	ujeebu "github.com/ujeebu/ujeebu-go"
)

var urls = []string{
	"https://sfbay.craigslist.org/search/sss?query=couch",
	"https://newyork.craigslist.org/search/sss?query=iphone",
}

// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
    "ads": {
        "selector": "div.cl-search-result.cl-search-view-mode-gallery",
        "type": "obj",
        "multiple": true,
        "children": {
            "url": {
                "selector": "a.main",
                "type": "link"
            },
            "title": {
                "selector": "a.posting-title span.label",
                "type": "text"
            },
            "price": {
                "selector": "span.priceinfo",
                "type": "text"
            },
            "location": {
                "selector": "span.result-location",
                "type": "text"
            },
            "posted": {
                "selector": "span.result-posted-date",
                "type": "text"
            }
        }
    }
}`

var extractRules map[string]any

func fail(format string, args ...any) {
	fmt.Fprintf(os.Stderr, format+"\n", args...)
	os.Exit(1)
}

func short(s string) string {
	if len(s) > 300 {
		return s[:300]
	}
	return s
}

func params(target string) ujeebu.ScrapeParams {
	p := ujeebu.ScrapeParams{URL: target}
	p.JS = true
	p.ExtractRules = extractRules
	return p
}

func scrape(client *ujeebu.Client, target string) map[string]any {
	// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
	resp, credits, err := client.Scrape(params(target))
	if err != nil {
		var apiErr *ujeebu.APIError
		if errors.As(err, &apiErr) {
			fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
		}
		fail("Request failed for %s: %v", target, err)
	}
	fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
	result, _ := resp.Result.(map[string]any)
	return result
}

func printJSON(v any) {
	enc := json.NewEncoder(os.Stdout)
	enc.SetEscapeHTML(false)
	enc.SetIndent("", "  ")
	if err := enc.Encode(v); err != nil {
		fail("Cannot print the result: %v", err)
	}
}

func main() {
	apiKey := os.Getenv("UJEEBU_API_KEY")
	if apiKey == "" {
		fail("Set the UJEEBU_API_KEY environment variable.")
	}
	if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
		fail("Bad extract rules: %v", err)
	}
	client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
	if err != nil {
		fail("%v", err)
	}

	for i, target := range urls {
		if i > 0 {
			time.Sleep(2 * time.Second) // be polite: one page at a time
		}
		printJSON(scrape(client, target))
	}
}

SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/craigslist.json.

Try it yourself

Run this on Craigslist with your own key

Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card.

Get a free API key or try these settings in the Playground first →

URL patterns and pagination

What the URLs look like, read from the pages our checks fetched.

Search and listing pages

Search or listing URL: https://newyork.craigslist.org/search/sss?query={query}
Next pages: We did not see a next-page link on the pages we fetched. Results may load as you scroll: try scroll_down.
Validated on: https://sfbay.craigslist.org/search/sss?query=couchhttps://newyork.craigslist.org/search/sss?query=iphone

Settings that work today

From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.

Endpoint	`/scrape`
`js`	`true`
Cost	up to 5 credits a request (only HTTP 200 and 404 are billed)

For search and listing pages, change the query or the page parameter in the URL to paginate, and fetch the pages one after another rather than in bursts. Collect detail page URLs from listing pages first, then fetch each detail page. Our checks run with JavaScript rendering on (js=true): keep it on. Start with the default (rotating) proxy, the cheapest one that passed most of its attempts in our checks.

Try it in the Playground

Proxy	Attempts	Passed
Default (rotating)	7	7

The cheapest proxy that passes most of our checks of this site.

Troubleshooting

The failures our own checks of craigslist.org ran into over the last 7 days, and what got the page in the same check.

What happened	Times	What fixed it
The page did not load in time	2	Nothing we tried in the same check. Retry later, one request at a time.

A failed request is not billed: only HTTP 200 and 404 responses cost credits.

What people build with Craigslist data

Price researchSee what similar items sell for, by condition and location.More on this use case
New ads alertsCatch new ads for the searches you care about shortly after they appear.

Limits and etiquette

Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
Read Craigslist's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.

Questions

Can you scrape Craigslist with Ujeebu?

Yes. 19 of 21 checks of public Craigslist pages passed in the last 7 days with the settings on this page.

Which settings work for Craigslist?

Call /scrape with js=true. On the default (rotating) proxy, 7 of 7 attempts passed in the last 7 days.

How many credits does a Craigslist request cost?

With these settings a request costs up to 5 credits. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.

Which fields can I extract from Craigslist?

With the extraction recipes on this page, validated on real Craigslist pages through our API: search and listing pages: url, title, price, location, posted. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.

How fresh is this page?

The status and settings come from our own health checks of craigslist.org, which run around the clock. Last check: 2026-10-13 18:34:12 UTC; last pass: 2026-10-13 18:34:12 UTC.

Related site guides

All site guides