Playground Sign in Start free
News and finance · morningstar.com

How to scrape Morningstar

Morningstar (morningstar.com) is a news and finance site. This guide is built from our own checks of its public pages: what the pages contain, whether our requests get through right now, and the request settings that worked.

Intermittent

6 of 20 of our checks passed in the last 7 days (30%).

Last check 2026-10-13 19:04 UTC · last pass 2026-10-13 19:04 UTC · checked with our own requests, never customer data.

Try it in the Playground

Run the code on this page with your own key: 5,000 free credits for 7 days, no card. Get a free API key →

Extraction recipe

The API returns the rendered HTML of the page. Select the fields you need with extract rules (CSS selectors) or parse the HTML on your side. The recipe below is a set of Scrape API extract rules: we ran it through our API on two real Morningstar pages with the settings on this page and kept only the fields that came back on both. It is checked again every week, and hidden if it stops working.

Public pages

Validated 2026-10-13
FieldTypeExample
titletextNVIDIA Corp NVDA
descriptiontextNVDA stock price (NASDAQ: NVDA), stock rating, related news, valuat...
urlURLhttps://www.morningstar.com/stocks/xnas/nvda/quote
headlinetextNvidia: Acquires Hugging Face for $12.9 Billion to Support the Open...
summarytextNvidia formally announced the acquisition of Hugging Face, a large...
publisheddate2026-09-03
sectiontextCompany Report

Examples from www.morningstar.com/stocks/xnas/nvda/quote on 2026-10-13, shortened.

Sample output (real, trimmed)

{
    "title": "NVIDIA Corp NVDA",
    "description": "NVDA stock price (NASDAQ: NVDA), stock rating, related news, valuation, dividends and more to help you make your investing decisions.",
    "url": "https://www.morningstar.com/stocks/xnas/nvda/quote",
    "headline": "Nvidia: Acquires Hugging Face for $12.9 Billion to Support the Open-Source Model Ecosystem",
    "summary": "Nvidia formally announced the acquisition of Hugging Face, a large language model platform, for $12.9 billion. Nvidia intends to support and scale up Hugging...",
    "published": "2026-09-03",
    "section": "Company Report"
}
extract_rules (7 rules)
{
    "title": {
        "selector": "h1",
        "type": "text"
    },
    "description": {
        "selector": "meta[name=\"description\"]",
        "type": "attr",
        "attribute": "content"
    },
    "url": {
        "selector": "link[rel=\"canonical\"]",
        "type": "attr",
        "attribute": "href"
    },
    "headline": {
        "selector": ".mdc-stock-analysis-summary__heading__mdc a",
        "type": "text"
    },
    "summary": {
        "selector": ".mdc-stock-analysis-summary__snippet__mdc",
        "type": "text"
    },
    "published": {
        "selector": ".mdc-stock-analysis-summary__header__mdc time",
        "type": "attr",
        "attribute": "datetime"
    },
    "section": {
        "selector": ".mdc-report-section__header__mdc h2",
        "type": "text"
    }
}

Code

Complete scripts: set the UJEEBU_API_KEY environment variable and run them as they are. Each one sends the settings on this page and the extraction recipe, prints the extracted JSON, and prints the credits the request cost (the Ujb-Credits response header) on stderr. A non-200 answer stops the script with the API's error message.

Public pages

Runs the recipe on the two pages it was validated on, one after the other.

morningstar_page_sdk.py pip install ujeebu-python==0.1.5
# Scrape Morningstar public pages with the Ujeebu Scrape API.
# Settings and extract rules validated on real pages on 2026-10-13 (Ujeebu site guide).
# Uses the official SDK ujeebu-python 0.1.5: pip install ujeebu-python==0.1.5
# Run: UJEEBU_API_KEY=your_key python3 morningstar_page_sdk.py

import json
import os
import sys
import time

import requests
from ujeebu_python import UjeebuClient

API_KEY = os.environ.get("UJEEBU_API_KEY")
URLS = [
    "https://www.morningstar.com/stocks/xnas/nvda/quote",
    "https://www.morningstar.com/stocks/xnys/jpm/quote",
]
SETTINGS = {
    "js": True,
    "wait_for": 2000,
}
EXTRACT_RULES = {
    "title": {
        "selector": "h1",
        "type": "text",
    },
    "description": {
        "selector": "meta[name=\"description\"]",
        "type": "attr",
        "attribute": "content",
    },
    "url": {
        "selector": "link[rel=\"canonical\"]",
        "type": "attr",
        "attribute": "href",
    },
    "headline": {
        "selector": ".mdc-stock-analysis-summary__heading__mdc a",
        "type": "text",
    },
    "summary": {
        "selector": ".mdc-stock-analysis-summary__snippet__mdc",
        "type": "text",
    },
    "published": {
        "selector": ".mdc-stock-analysis-summary__header__mdc time",
        "type": "attr",
        "attribute": "datetime",
    },
    "section": {
        "selector": ".mdc-report-section__header__mdc h2",
        "type": "text",
    },
}


def scrape(client, url):
    # with extract_rules, client.scrape sends a JSON POST and the API answers {"result": {...}}
    try:
        response = client.scrape(url, params={**SETTINGS, "extract_rules": EXTRACT_RULES})
    except requests.RequestException as error:
        sys.exit(f"Request failed for {url}: {error}")
    if response.status_code != 200:
        try:
            message = response.json().get("message", response.text)
        except ValueError:
            message = response.text
        sys.exit(f"HTTP {response.status_code} for {url}: {str(message)[:300]}")
    print(f"Ujb-Credits: {response.headers.get('Ujb-Credits')}", file=sys.stderr)
    return response.json()["result"]


if not API_KEY:
    sys.exit("Set the UJEEBU_API_KEY environment variable.")

client = UjeebuClient(api_key=API_KEY)

for i, url in enumerate(URLS):
    if i:
        time.sleep(2)  # be polite: one page at a time
    print(json.dumps(scrape(client, url), indent=2, ensure_ascii=False))

SDK tabs use the official Ujeebu SDKs (ujeebu-python 0.1.5, @ujeebu-org/ujeebu-sdk 0.1.2, github.com/ujeebu/ujeebu-go v0.1.8); there is no PHP SDK, so the PHP tab calls the API with curl. For agents and scripts, the same status and settings are at /scrape/morningstar.json.

Try it yourself

Run this on Morningstar with your own key

Get a free API key, set UJEEBU_API_KEY and run any script above as it is. 5,000 free credits for 7 days, no card.

URL patterns and pagination

What the URLs look like, read from the pages our checks fetched.

Public pages

Pattern
https://www.morningstar.com/stocks/{slug}/{slug}/quote
Validated on
https://www.morningstar.com/stocks/xnas/nvda/quotehttps://www.morningstar.com/stocks/xnys/jpm/quote

Settings that work today

From our health checks over the last 7 days: the cheapest settings that return the real page most of the time.

Endpoint/scrape
jstrue
wait_for2000
Costup to 5 credits a request (only HTTP 200 and 404 are billed)

Each public page is one request: change the path in the URL to fetch another one. Our checks pass with JavaScript rendering on (js=true) and a wait of 2 seconds (wait_for=2000) before the snapshot: keep both. Start with the default (rotating) proxy, the cheapest one that passed most of its attempts in our checks.

Try it in the Playground
ProxyAttemptsPassed
Default (rotating)66

The cheapest proxy that passes most of our checks of this site.

Troubleshooting

The failures our own checks of morningstar.com ran into over the last 7 days, and what got the page in the same check.

What happenedTimesWhat fixed it
The site blocked the request (HTTP 403 or a block page) 1 None of the settings we tried got past it in 7 days.
The page did not load in time 1 Nothing we tried in the same check. Retry later, one request at a time.

A failed request is not billed: only HTTP 200 and 404 responses cost credits.

What people build with Morningstar data

  • Media monitoringTrack the articles published on the topics and companies you follow.More on this use case
  • Content for AI and RAGCollect headlines, dates and summaries as structured input for search and LLM pipelines.More on this use case
  • Publishing timelineMeasure when and how often a site publishes, by section.

Limits and etiquette

  • Public pages only. Pages behind a login, and data shown only to signed-in users, are out of scope.
  • Keep the rate modest: fetch pages one after another or with low concurrency, and cache what you already have.
  • robots.txt of www.morningstar.com (read 2026-10-13): public pages allowed for generic crawlers; no crawl delay set.
  • Read Morningstar's terms of service before you collect data at scale, and do not collect personal data you have no basis to process. This guide is not legal advice.

Questions

Can you scrape Morningstar with Ujeebu?

Partly. 6 of 20 checks of public Morningstar pages passed in the last 7 days; most failures were the site blocked the request (HTTP 403 or a block page). Retry failed pages later, and use the settings on this page.

Which settings work for Morningstar?

Call /scrape with js=true, wait_for=2000. On the default (rotating) proxy, 6 of 6 attempts passed in the last 7 days.

How many credits does a Morningstar request cost?

With these settings a request costs up to 5 credits. Only responses with HTTP 200 or 404 are billed: a blocked or timed-out request is free.

Which fields can I extract from Morningstar?

With the extraction recipes on this page, validated on real Morningstar pages through our API: public pages: title, description, url, headline, summary, published, section. Pass the recipe as extract_rules in a POST to /scrape and the API returns those fields as JSON.

Is it allowed to scrape Morningstar?

Its robots.txt allows generic crawlers on the page types in this guide. Collect public pages only, read Morningstar's terms of service, keep your request rate modest and do not collect personal data you have no basis to process. This is not legal advice.

How fresh is this page?

The status and settings come from our own health checks of morningstar.com, which run around the clock. Last check: 2026-10-13 19:04:26 UTC; last pass: 2026-10-13 19:04:26 UTC.