Every week we ask Gemini, Google AI Overviews and ChatGPT the questions buyers ask, through our own AI answer APIs, and publish which brands get named and which sites get cited.

Learn more: Who AI answers recommend

Free to cite

Charts built on our own scrapes.

Original datasets from the open web, with the method, a CSV sample and an embed code. Reuse them under CC BY 4.0.

Learn more: Charts built on our own scrapes

Free check

Is your brand in AI answers?

Name your brand and one competitor. We ask the engines 10 buyer questions and email you how often each one gets named, and which sites they cite.

Learn more: Is your brand in AI answers?

By outcome

Price monitoring

Competitor prices, tracked in real time

E-commerce product data

Prices, reviews & specs from any store

Lead generation

B2B leads from directories & listings

SEO monitoring

Daily ranks & SERP-change tracking

Market research

Reviews & ratings into intel reports

Social monitoring

Brand mentions across every platform

Structured data for LLMs

Schema-validated JSON for AI training

Markdown for LLMs

Any page → clean Markdown for RAG

Article extraction for AI

Clean article content for LLMs & RAG

Site guides

Working settings for 100+ sites

How to scrape Amazon

Working · amazon.com

How to scrape Booking.com

Working · booking.com

How to scrape GitHub

Working · github.com

All use cases

See all our supported workloads

B2B + commerce

Turn the open web into structured rows.

Pricing, leads, products. Schema-stable extraction with anti-bot baked in.

Learn more: Turn the open web into structured rows

Live intel

See it the moment it changes.

SERPs, sentiment, brand mentions. Alerts on diffs, not on hours-old snapshots.

Learn more: See it the moment it changes

For models

Build pipelines on clean web data.

Markdown + structured JSON + citations. The data layer agents and RAG actually want.

Learn more: Build pipelines on clean web data

Site guides

Settings that work, per site.

Live status from our own checks, the proxy and rendering settings that pass today, and extraction recipes validated on real pages, with code.

Learn more: Settings that work, per site

Everything

All our workloads.

Opinionated pipelines for every category. Copy the one closest to what you ship.

Learn more: All our workloads

Explore

AI Citation Index

Which brands AI answers recommend, every week

Methodology

What we ask, where, and how we count

Check your brand Free

Free: is your brand in AI answers?

Help desk and AI customer service software

Ticketing help desks and the new AI support agents, asked the way buyers ask.

Personal loans

National lenders and loan marketplaces, by credit score, purpose and speed.

Project management software

Work and project management tools for teams, agencies, developers and enterprises.

Cruise lines

Ocean cruise lines, by trip type, budget and who is travelling.

Email marketing software

Newsletter and automation tools for creators, stores and small teams.

Online degree programs (universities)

Online bachelor's, master's and doctoral programs from US colleges and universities.

All industries

All 25 industries we track, every week

Data charts

Original datasets from the open web, free to cite

Brand snapshot

Your brand vs 5 competitors, as a PDF

For agencies

White-label weekly AI visibility reports

Data access

The raw weekly answers, citations and metrics

AI Citation Index

See who AI answers recommend.

Which brands ChatGPT, Gemini and Google AI Overviews name for real buyer questions, and the sites they cite.

Learn more: See who AI answers recommend

Industries

Leaderboards per industry.

Top brands per engine, the sites AI trusts and who moved this week.

Learn more: Leaderboards per industry

Data and reports

Original data, ready to use.

Charts you can cite and embed, brand snapshots, agency reports and raw data access.

Learn more: Original data, ready to use

Integrations Pricing How To Docs

Playground Sign in Start free

Blog

Notes from the team.

Practical writeups on web scraping, anti-bot tactics, structured extraction, SERPs and the messy realities of building data pipelines for AI.

Filtering by serp-api Clear ×

web scraping SERP API Google News

How to Scrape Google News Results with a SERP API: Python Tutorial

Scraping Google News with BeautifulSoup breaks the moment Google changes its layout. This tutorial shows how to scrape Google News and get structured JSON in a single API call, filter by language and location, and pipe the results into a RAG pipeline.

Sam Oct 23, 2026 12 min read