How to scrape Lever
Lever (lever.co) is a jobs site. This guide is built from our own checks of its public pages: what the pages contain, whether our requests get through right now, and the request settings that worked.
17 of 19 of our checks passed in the last 7 days (89.5%).
Last check 2026-10-13 17:34 UTC · last pass 2026-10-13 17:34 UTC · checked with our own requests, never customer data.
Run the code on this page with your own key: 5,000 free credits for 7 days, no card. Get a free API key →
Extraction recipe
The API returns the rendered HTML of the page. Select the fields you need with extract rules (CSS selectors) or parse the HTML on your side. The recipe below is a set of Scrape API extract rules: we ran it through our API on two real Lever pages with the settings on this page and kept only the fields that came back on both. It is checked again every week, and hidden if it stops working.
Search and listing pages
Validated 2026-10-13| Field | Type | Example |
|---|---|---|
jobs | list of 3+ items | |
jobs[].url | URL | https://jobs.lever.co/matchgroup/849c888a-0348-4794-9c8d-5e4da7e76b2d |
jobs[].title | text | Analytics Engineer, Data Enabling |
jobs[].employment_type | text | Full-time |
jobs[].location | text | Tokyo |
Examples from jobs.lever.co/matchgroup on 2026-10-13, shortened.
Sample output (real, trimmed)
{
"jobs": [
{
"url": "https://jobs.lever.co/matchgroup/849c888a-0348-4794-9c8d-5e4da7e76b2d",
"title": "Analytics Engineer, Data Enabling",
"employment_type": "Full-time",
"location": "Tokyo"
},
{
"url": "https://jobs.lever.co/matchgroup/1deea0b0-c0c9-4541-972e-2a437b64b023",
"title": "Back-end Engineer, Platform (Go)",
"employment_type": "Full-time",
"location": "Tokyo"
},
{
"url": "https://jobs.lever.co/matchgroup/4f3e70ea-d843-4666-844a-c0ba07f2033f",
"title": "Back-end Engineer, Product (Go)",
"employment_type": "Full-time",
"location": "Tokyo"
}
]
}
extract_rules (1 rule)
{
"jobs": {
"selector": "div.posting",
"type": "obj",
"multiple": true,
"children": {
"url": {
"selector": "a.posting-btn-submit",
"type": "link"
},
"title": {
"selector": "h5[data-qa='posting-name']",
"type": "text"
},
"employment_type": {
"selector": "span.commitment",
"type": "text"
},
"location": {
"selector": "span.location",
"type": "text"
}
}
}
}
Job postings
Validated 2026-10-13| Field | Type | Example |
|---|---|---|
title | text | Spotify - Senior Applied Research Scientist - Personalization |
description | text | The Personalization team makes deciding what to play next easier an... |
remote | text | Remote |
department | text | Data and Analytics – Personalization / |
Examples from jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256 on 2026-10-13, shortened.
Sample output (real, trimmed)
{
"title": "Spotify - Senior Applied Research Scientist - Personalization",
"description": "The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we're behind some of S...",
"remote": "Remote",
"department": "Data and Analytics – Personalization /"
}
extract_rules (4 rules)
{
"title": {
"selector": "meta[property=\"og:title\"]",
"type": "attr",
"attribute": "content"
},
"description": {
"selector": "meta[property=\"og:description\"]",
"type": "attr",
"attribute": "content"
},
"remote": {
"selector": ".posting-categories .workplaceTypes",
"type": "text"
},
"department": {
"selector": ".posting-categories .department",
"type": "text"
}
}
Code
Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one sends the settings on this page and the extraction recipe, prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.
Search and listing pages
Runs the recipe on the two pages it was validated on, one after the other.
pip install ujeebu-python==0.1.5 # Scrape Lever search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 lever_listing_sdk.py
import json
import os
import sys
import time
import requests
from ujeebu_python import UjeebuClient
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://jobs.lever.co/matchgroup",
"https://jobs.lever.co/palantir",
]
SETTINGS = {
"js": True,
}
EXTRACT_RULES = {
"jobs": {
"selector": "div.posting",
"type": "obj",
"multiple": True,
"children": {
"url": {
"selector": "a.posting-btn-submit",
"type": "link",
},
"title": {
"selector": "h5[data-qa='posting-name']",
"type": "text",
},
"employment_type": {
"selector": "span.commitment",
"type": "text",
},
"location": {
"selector": "span.location",
"type": "text",
},
},
},
}
def scrape(client, url):
# with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
try:
response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
except requests.RequestException as error:
sys.exit(f"Request failed for {url}: {error}")
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
client = UjeebuClient(api_key=API_KEY)
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(client, url), indent=2, ensure_ascii=False))
npm install @ujeebu-org/ujeebu-sdk@0.1.2 // Scrape Lever search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node lever_listing_sdk.mjs
import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://jobs.lever.co/matchgroup",
"https://jobs.lever.co/palantir",
];
const SETTINGS = {
js: true,
};
const EXTRACT_RULES = {
jobs: {
selector: "div.posting",
type: "obj",
multiple: true,
children: {
url: {
selector: "a.posting-btn-submit",
type: "link",
},
title: {
selector: "h5[data-qa='posting-name']",
type: "text",
},
employment_type: {
selector: "span.commitment",
type: "text",
},
location: {
selector: "span.location",
type: "text",
},
},
},
};
async function scrape(client, url) {
let res;
try {
// client.scrape POSTs JSON when extract_rules is set (scrapeWithRules would send it as a GET query, which the API ignores)
res = await client.scrape(url, { ...SETTINGS, extract_rules: EXTRACT_RULES });
} catch (err) {
const status = err.response?.status ?? 'error';
const message = err.response?.data?.message ?? err.message;
console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers['ujb-credits']}`);
return res.data.result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(client, url), null, 2));
}
pip install requests # Scrape Lever search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key python3 lever_listing.py (pip install requests)
import json
import os
import sys
import time
import requests
API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://jobs.lever.co/matchgroup",
"https://jobs.lever.co/palantir",
]
SETTINGS = {
"js": True,
}
EXTRACT_RULES = {
"jobs": {
"selector": "div.posting",
"type": "obj",
"multiple": True,
"children": {
"url": {
"selector": "a.posting-btn-submit",
"type": "link",
},
"title": {
"selector": "h5[data-qa='posting-name']",
"type": "text",
},
"employment_type": {
"selector": "span.commitment",
"type": "text",
},
"location": {
"selector": "span.location",
"type": "text",
},
},
},
}
def scrape(url):
response = requests.post(
API_URL,
headers={"ApiKey": API_KEY},
json={"url": url, **SETTINGS, "extract_rules": EXTRACT_RULES},
timeout=180,
)
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(url), indent=2, ensure_ascii=False))
// Scrape Lever search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key node lever_listing.mjs (Node.js 18 or later)
const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://jobs.lever.co/matchgroup",
"https://jobs.lever.co/palantir",
];
const SETTINGS = {
js: true,
};
const EXTRACT_RULES = {
jobs: {
selector: "div.posting",
type: "obj",
multiple: true,
children: {
url: {
selector: "a.posting-btn-submit",
type: "link",
},
title: {
selector: "h5[data-qa='posting-name']",
type: "text",
},
employment_type: {
selector: "span.commitment",
type: "text",
},
location: {
selector: "span.location",
type: "text",
},
},
},
};
async function scrape(url) {
const res = await fetch(API_URL, {
method: 'POST',
headers: { ApiKey: API_KEY, 'Content-Type': 'application/json' },
body: JSON.stringify({ url, ...SETTINGS, extract_rules: EXTRACT_RULES }),
signal: AbortSignal.timeout(180000),
});
const text = await res.text();
if (res.status !== 200) {
let message = text;
try {
message = JSON.parse(text).message ?? text;
} catch {}
console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}`);
return JSON.parse(text).result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(url), null, 2));
}
#!/usr/bin/env bash
# Scrape Lever search and listing pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key bash lever_listing.sh (curl 7.76 or later)
set -euo pipefail
curl -sS --fail-with-body --max-time 180 -D headers.txt \
-X POST 'https://api.ujeebu.com/scrape' \
-H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
-H 'Content-Type: application/json' \
--data-binary @- <<'JSON'
{
"url": "https://jobs.lever.co/matchgroup",
"js": true,
"extract_rules": {
"jobs": {
"selector": "div.posting",
"type": "obj",
"multiple": true,
"children": {
"url": {
"selector": "a.posting-btn-submit",
"type": "link"
},
"title": {
"selector": "h5[data-qa='posting-name']",
"type": "text"
},
"employment_type": {
"selector": "span.commitment",
"type": "text"
},
"location": {
"selector": "span.location",
"type": "text"
}
}
}
}
}
JSON
echo
grep -i '^ujb-credits' headers.txt >&2
<?php
// Scrape Lever search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key php lever_listing.php (PHP 7.4 or later with curl)
$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$urls = [
'https://jobs.lever.co/matchgroup',
'https://jobs.lever.co/palantir',
];
$settings = [
'js' => true,
];
$extractRules = [
'jobs' => [
'selector' => 'div.posting',
'type' => 'obj',
'multiple' => true,
'children' => [
'url' => [
'selector' => 'a.posting-btn-submit',
'type' => 'link',
],
'title' => [
'selector' => 'h5[data-qa=\'posting-name\']',
'type' => 'text',
],
'employment_type' => [
'selector' => 'span.commitment',
'type' => 'text',
],
'location' => [
'selector' => 'span.location',
'type' => 'text',
],
],
],
];
function scrape(string $url, string $apiKey, array $settings, array $extractRules)
{
$ch = curl_init('https://api.ujeebu.com/scrape');
$headers = [];
curl_setopt_array($ch, [
CURLOPT_POST => true,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 180,
CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey, 'Content-Type: application/json'],
CURLOPT_POSTFIELDS => json_encode(['url' => $url] + $settings + ['extract_rules' => $extractRules]),
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
if (strpos($line, ':') !== false) {
[$k, $v] = explode(':', $line, 2);
$headers[strtolower(trim($k))] = trim($v);
}
return strlen($line);
},
]);
$body = curl_exec($ch);
if ($body === false) {
fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
exit(1);
}
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
if ($status !== 200) {
$message = json_decode($body, true)['message'] ?? $body;
fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
exit(1);
}
fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . "\n");
return json_decode($body, true)['result'];
}
foreach ($urls as $i => $url) {
if ($i > 0) {
sleep(2); // be polite: one page at a time
}
echo json_encode(scrape($url, $apiKey, $settings, $extractRules), JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
}
go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8 // Scrape Lever search and listing pages with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run lever_listing.go
package main
import (
"encoding/json"
"errors"
"fmt"
"os"
"time"
ujeebu "github.com/ujeebu/ujeebu-go"
)
var urls = []string{
"https://jobs.lever.co/matchgroup",
"https://jobs.lever.co/palantir",
}
// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
"jobs": {
"selector": "div.posting",
"type": "obj",
"multiple": true,
"children": {
"url": {
"selector": "a.posting-btn-submit",
"type": "link"
},
"title": {
"selector": "h5[data-qa='posting-name']",
"type": "text"
},
"employment_type": {
"selector": "span.commitment",
"type": "text"
},
"location": {
"selector": "span.location",
"type": "text"
}
}
}
}`
var extractRules map[string]any
func fail(format string, args ...any) {
fmt.Fprintf(os.Stderr, format+"\n", args...)
os.Exit(1)
}
func short(s string) string {
if len(s) > 300 {
return s[:300]
}
return s
}
func params(target string) ujeebu.ScrapeParams {
p := ujeebu.ScrapeParams{URL: target}
p.JS = true
p.ExtractRules = extractRules
return p
}
func scrape(client *ujeebu.Client, target string) map[string]any {
// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
resp, credits, err := client.Scrape(params(target))
if err != nil {
var apiErr *ujeebu.APIError
if errors.As(err, &apiErr) {
fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
}
fail("Request failed for %s: %v", target, err)
}
fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
result, _ := resp.Result.(map[string]any)
return result
}
func printJSON(v any) {
enc := json.NewEncoder(os.Stdout)
enc.SetEscapeHTML(false)
enc.SetIndent("", " ")
if err := enc.Encode(v); err != nil {
fail("Cannot print the result: %v", err)
}
}
func main() {
apiKey := os.Getenv("UJEEBU_API_KEY")
if apiKey == "" {
fail("Set the UJEEBU_API_KEY environment variable.")
}
if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
fail("Bad extract rules: %v", err)
}
client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
if err != nil {
fail("%v", err)
}
for i, target := range urls {
if i > 0 {
time.Sleep(2 * time.Second) // be polite: one page at a time
}
printJSON(scrape(client, target))
}
}
Job postings
Runs the recipe on the two pages it was validated on, one after the other.
pip install ujeebu-python==0.1.5 # Scrape Lever job postings with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 lever_detail_sdk.py
import json
import os
import sys
import time
import requests
from ujeebu_python import UjeebuClient
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply",
]
SETTINGS = {
"js": True,
}
EXTRACT_RULES = {
"title": {
"selector": "meta[property=\"og:title\"]",
"type": "attr",
"attribute": "content",
},
"description": {
"selector": "meta[property=\"og:description\"]",
"type": "attr",
"attribute": "content",
},
"remote": {
"selector": ".posting-categories .workplaceTypes",
"type": "text",
},
"department": {
"selector": ".posting-categories .department",
"type": "text",
},
}
def scrape(client, url):
# with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
try:
response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
except requests.RequestException as error:
sys.exit(f"Request failed for {url}: {error}")
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
client = UjeebuClient(api_key=API_KEY)
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(client, url), indent=2, ensure_ascii=False))
npm install @ujeebu-org/ujeebu-sdk@0.1.2 // Scrape Lever job postings with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK @ujeebu-org/ujeebu-sdk 0.1.2: npm install @ujeebu-org/ujeebu-sdk@0.1.2
// Run: UJEEBU_API_KEY=your_key node lever_detail_sdk.mjs
import { UjeebuClient } from '@ujeebu-org/ujeebu-sdk';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply",
];
const SETTINGS = {
js: true,
};
const EXTRACT_RULES = {
title: {
selector: "meta[property=\"og:title\"]",
type: "attr",
attribute: "content",
},
description: {
selector: "meta[property=\"og:description\"]",
type: "attr",
attribute: "content",
},
remote: {
selector: ".posting-categories .workplaceTypes",
type: "text",
},
department: {
selector: ".posting-categories .department",
type: "text",
},
};
async function scrape(client, url) {
let res;
try {
// client.scrape POSTs JSON when extract_rules is set (scrapeWithRules would send it as a GET query, which the API ignores)
res = await client.scrape(url, { ...SETTINGS, extract_rules: EXTRACT_RULES });
} catch (err) {
const status = err.response?.status ?? 'error';
const message = err.response?.data?.message ?? err.message;
console.error(`HTTP ${status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers['ujb-credits']}`);
return res.data.result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const client = new UjeebuClient(API_KEY);
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(client, url), null, 2));
}
pip install requests # Scrape Lever job postings with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key python3 lever_detail.py (pip install requests)
import json
import os
import sys
import time
import requests
API_URL = "https://api.ujeebu.com/scrape"
API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
"https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply",
]
SETTINGS = {
"js": True,
}
EXTRACT_RULES = {
"title": {
"selector": "meta[property=\"og:title\"]",
"type": "attr",
"attribute": "content",
},
"description": {
"selector": "meta[property=\"og:description\"]",
"type": "attr",
"attribute": "content",
},
"remote": {
"selector": ".posting-categories .workplaceTypes",
"type": "text",
},
"department": {
"selector": ".posting-categories .department",
"type": "text",
},
}
def scrape(url):
response = requests.post(
API_URL,
headers={"ApiKey": API_KEY},
json={"url": url, **SETTINGS, "extract_rules": EXTRACT_RULES},
timeout=180,
)
if response.status_code != 200:
try:
message = response.json().get("message", response.text)
except ValueError:
message = response.text
sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
return response.json()["result"]
if not API_KEY:
sys.exit("Set the UJEEBU_API_KEY environment variable.")
for i, url in enumerate(URLS):
if i:
time.sleep(2) # be polite: one page at a time
print(json.dumps(scrape(url), indent=2, ensure_ascii=False))
// Scrape Lever job postings with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key node lever_detail.mjs (Node.js 18 or later)
const API_URL = 'https://api.ujeebu.com/scrape';
const API_KEY = process.env.UJEEBU_API_KEY;
const URLS = [
"https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply",
];
const SETTINGS = {
js: true,
};
const EXTRACT_RULES = {
title: {
selector: "meta[property=\"og:title\"]",
type: "attr",
attribute: "content",
},
description: {
selector: "meta[property=\"og:description\"]",
type: "attr",
attribute: "content",
},
remote: {
selector: ".posting-categories .workplaceTypes",
type: "text",
},
department: {
selector: ".posting-categories .department",
type: "text",
},
};
async function scrape(url) {
const res = await fetch(API_URL, {
method: 'POST',
headers: { ApiKey: API_KEY, 'Content-Type': 'application/json' },
body: JSON.stringify({ url, ...SETTINGS, extract_rules: EXTRACT_RULES }),
signal: AbortSignal.timeout(180000),
});
const text = await res.text();
if (res.status !== 200) {
let message = text;
try {
message = JSON.parse(text).message ?? text;
} catch {}
console.error(`HTTP ${res.status} for ${url}: ${String(message).slice(0, 300)}`);
process.exit(1);
}
console.error(`Ujb-Credits: ${res.headers.get('ujb-credits')}`);
return JSON.parse(text).result;
}
if (!API_KEY) {
console.error('Set the UJEEBU_API_KEY environment variable.');
process.exit(1);
}
const pause = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
for (const [i, url] of URLS.entries()) {
if (i) await pause(2000); // be polite: one page at a time
console.log(JSON.stringify(await scrape(url), null, 2));
}
#!/usr/bin/env bash
# Scrape Lever job postings with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Run: UJEEBU_API_KEY=your_key bash lever_detail.sh (curl 7.76 or later)
set -euo pipefail
curl -sS --fail-with-body --max-time 180 -D headers.txt \
-X POST 'https://api.ujeebu.com/scrape' \
-H "ApiKey: ${UJEEBU_API_KEY:?Set the UJEEBU_API_KEY environment variable.}" \
-H 'Content-Type: application/json' \
--data-binary @- <<'JSON'
{
"url": "https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"js": true,
"extract_rules": {
"title": {
"selector": "meta[property=\"og:title\"]",
"type": "attr",
"attribute": "content"
},
"description": {
"selector": "meta[property=\"og:description\"]",
"type": "attr",
"attribute": "content"
},
"remote": {
"selector": ".posting-categories .workplaceTypes",
"type": "text"
},
"department": {
"selector": ".posting-categories .department",
"type": "text"
}
}
}
JSON
echo
grep -i '^ujb-credits' headers.txt >&2
<?php
// Scrape Lever job postings with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Run: UJEEBU_API_KEY=your_key php lever_detail.php (PHP 7.4 or later with curl)
$apiKey = getenv('UJEEBU_API_KEY') ?: exit("Set the UJEEBU_API_KEY environment variable.\n");
$urls = [
'https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256',
'https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply',
];
$settings = [
'js' => true,
];
$extractRules = [
'title' => [
'selector' => 'meta[property="og:title"]',
'type' => 'attr',
'attribute' => 'content',
],
'description' => [
'selector' => 'meta[property="og:description"]',
'type' => 'attr',
'attribute' => 'content',
],
'remote' => [
'selector' => '.posting-categories .workplaceTypes',
'type' => 'text',
],
'department' => [
'selector' => '.posting-categories .department',
'type' => 'text',
],
];
function scrape(string $url, string $apiKey, array $settings, array $extractRules)
{
$ch = curl_init('https://api.ujeebu.com/scrape');
$headers = [];
curl_setopt_array($ch, [
CURLOPT_POST => true,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 180,
CURLOPT_HTTPHEADER => ['ApiKey: ' . $apiKey, 'Content-Type: application/json'],
CURLOPT_POSTFIELDS => json_encode(['url' => $url] + $settings + ['extract_rules' => $extractRules]),
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$headers) {
if (strpos($line, ':') !== false) {
[$k, $v] = explode(':', $line, 2);
$headers[strtolower(trim($k))] = trim($v);
}
return strlen($line);
},
]);
$body = curl_exec($ch);
if ($body === false) {
fwrite(STDERR, 'Request failed: ' . curl_error($ch) . "\n");
exit(1);
}
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
if ($status !== 200) {
$message = json_decode($body, true)['message'] ?? $body;
fwrite(STDERR, "HTTP $status for $url: " . substr((string) $message, 0, 300) . "\n");
exit(1);
}
fwrite(STDERR, 'Ujb-Credits: ' . ($headers['ujb-credits'] ?? '?') . "\n");
return json_decode($body, true)['result'];
}
foreach ($urls as $i => $url) {
if ($i > 0) {
sleep(2); // be polite: one page at a time
}
echo json_encode(scrape($url, $apiKey, $settings, $extractRules), JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), "\n";
}
go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8 // Scrape Lever job postings with the Ujeebu Scrape API.
// Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
// Uses the official SDK github.com/ujeebu/ujeebu-go v0.1.8: go mod init scraper && go get github.com/ujeebu/ujeebu-go@v0.1.8
// Run: UJEEBU_API_KEY=your_key go run lever_detail.go
package main
import (
"encoding/json"
"errors"
"fmt"
"os"
"time"
ujeebu "github.com/ujeebu/ujeebu-go"
)
var urls = []string{
"https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256",
"https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply",
}
// The extract rules of the recipe, as the JSON the API takes.
const extractRulesJSON = `{
"title": {
"selector": "meta[property=\"og:title\"]",
"type": "attr",
"attribute": "content"
},
"description": {
"selector": "meta[property=\"og:description\"]",
"type": "attr",
"attribute": "content"
},
"remote": {
"selector": ".posting-categories .workplaceTypes",
"type": "text"
},
"department": {
"selector": ".posting-categories .department",
"type": "text"
}
}`
var extractRules map[string]any
func fail(format string, args ...any) {
fmt.Fprintf(os.Stderr, format+"\n", args...)
os.Exit(1)
}
func short(s string) string {
if len(s) > 300 {
return s[:300]
}
return s
}
func params(target string) ujeebu.ScrapeParams {
p := ujeebu.ScrapeParams{URL: target}
p.JS = true
p.ExtractRules = extractRules
return p
}
func scrape(client *ujeebu.Client, target string) map[string]any {
// the int is the credits the request cost (the Ujb-Credits header), not an HTTP status
resp, credits, err := client.Scrape(params(target))
if err != nil {
var apiErr *ujeebu.APIError
if errors.As(err, &apiErr) {
fail("HTTP %d for %s: %s", apiErr.StatusCode, target, short(apiErr.Message))
}
fail("Request failed for %s: %v", target, err)
}
fmt.Fprintf(os.Stderr, "Ujb-Credits: %d\n", credits)
result, _ := resp.Result.(map[string]any)
return result
}
func printJSON(v any) {
enc := json.NewEncoder(os.Stdout)
enc.SetEscapeHTML(false)
enc.SetIndent("", " ")
if err := enc.Encode(v); err != nil {
fail("Cannot print the result: %v", err)
}
}
func main() {
apiKey := os.Getenv("UJEEBU_API_KEY")
if apiKey == "" {
fail("Set the UJEEBU_API_KEY environment variable.")
}
if err := json.Unmarshal([]byte(extractRulesJSON), &extractRules); err != nil {
fail("Bad extract rules: %v", err)
}
client, err := ujeebu.NewClient(apiKey, ujeebu.WithTimeout(180*time.Second))
if err != nil {
fail("%v", err)
}
for i, target := range urls {
if i > 0 {
time.Sleep(2 * time.Second) // be polite: one page at a time
}
printJSON(scrape(client, target))
}
}
SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/lever.json.
Try it yourself
Run this on Lever with your own key
Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card.
URL patterns and pagination
What the URLs look like, read from the pages our checks fetched.
Search and listing pages
- Search or listing URL
https://jobs.lever.co/{query}- Next pages
- We did not see a next-page link on the pages we fetched. Results may load as you scroll: try
scroll_down. - Validated on
https://jobs.lever.co/matchgrouphttps://jobs.lever.co/palantir
Job postings
- Validated on
https://jobs.lever.co/spotify/a4c49acb-a095-4452-ad9e-69e4b778c256https://jobs.lever.co/spotify/4852ad53-b028-4161-b53b-24c62759257f/apply
Settings that work today
From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.
| Endpoint | /scrape |
|---|---|
js | true |
| Cost | up to 5 credits a request (only HTTP 200 and 404 are billed) |
Each public page is one request: change the path in the URL to fetch another one. Collect detail page URLs from listing pages first, then fetch each detail page. Our checks run with JavaScript rendering on (js=true): keep it on. Start with the default (rotating) proxy, the cheapest one that passed most of its attempts in our checks.
| Proxy | Attempts | Passed |
|---|---|---|
| Default (rotating) | 7 | 7 |
The cheapest proxy that passes most of our checks of this site.
Troubleshooting
The failures our own checks of lever.co ran into over the last 7 days, and what got the page in the same check.
| What happened | Times | What fixed it |
|---|---|---|
| The page did not load in time | 2 | Nothing we tried in the same check. Retry later, one request at a time. |
A failed request is not billed: only HTTP 200 and 404 responses cost credits.
What people build with Lever data
- Job market analyticsCount open roles by company, location and type to see who is hiring and where.More on this use case
- Job aggregationCollect new postings into your own job board or alerts, with the link back to the original posting.
Limits and etiquette
- Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
- Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
- robots.txt of jobs.lever.co (read 2026-10-13): public pages allowed for generic crawlers; crawl delay 1 s.
- Read Lever's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.
Questions
Can you scrape Lever with Ujeebu?
Yes. 17 of 19 checks of public Lever pages passed in the last 7 days with the settings on this page.
Which settings work for Lever?
Call /scrape with js=true. On the default (rotating) proxy, 7 of 7 attempts passed in the last 7 days.
How many credits does a Lever request cost?
With these settings a request costs up to 5 credits. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.
Which fields can I extract from Lever?
With the extraction recipes on this page, validated on real Lever pages through our API: search and listing pages: url, title, employment_type, location; job postings: title, description, remote, department. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.
Is it allowed to scrape Lever?
Its robots.txt allows generic crawlers on the page types in this guide. It asks for 1 seconds between requests. Collect public pages only, read Lever's terms of service, keep your request rate modest and do not collect personal data you have no basis to process. This is not legal advice.
How fresh is this page?
The status and settings come from our own health checks of lever.co, which run around the clock. Last check: 2026-10-13 17:34:34 UTC; last pass: 2026-10-13 17:34:34 UTC.