Playground Sign in Start free
Live site guides

How to scrape popular websites

One guide per site, built from our own health checks of public pages around the clock: whether requests get through right now, the proxy and rendering settings that worked, code to copy and the data the pages carry. Statuses change with every check.

Sites

171

listed while at least 10% of checks pass

Working or mostly working

160

over the last 7 days

For agents

sites.json

status and working parameters, one JSON per site

Automotive 2

Developer and reference 6

E-commerce 23

Entertainment, books and games 4

Food delivery 6

Freelance and agencies 7

Government, public data and academic 2

Grocery 1

Jobs 13

Local and reviews 4

Marketplaces and classifieds 8

News and finance 57

Other search and answer engines 5

Real estate 8

Recipes 1

Social and video 8

Software reviews and apps 4

Sports 2

Travel 10

Working: at least 80% of checks passed in 7 days. Mostly working: 40% to 80%. Intermittent: 10% to 40%, so plan for retries. We list a site while at least 10% of its checks pass; a site below that for three days in a row leaves this list until its checks pass again. Each check uses our own API key on public pages and climbs from the cheapest proxy to the most expensive one.