Playground Sign in Start free
Use case · Content aggregation

News, blogs, journals. One pipeline.

Manual content curation does not scale. The Ujeebu Extract API turns any article URL into clean JSON (title, text, author, date, images), so you can build your own aggregation pipeline across hundreds of sources.

5,000 free credits · no card · blocked requests not billed
The challenge

The content aggregation challenge.

Information overload is the problem. The fix isn’t more sources, it’s a pipeline that keeps the signal and drops the noise.

Manual waste

Marketing teams spend hours daily copy-pasting from disparate sources just to keep the curated feed alive.

Falling behind

Research analysts can’t track rapidly evolving industry developments with manual workflows.

Missed opportunities

Delayed awareness of market trends costs competitive advantage, and lost windows are hard to reclaim.

Incomplete intelligence

Fragmented sources create gaps in analysis. The story is in the cross-source view, not in any single feed.

Use cases

What teams build with content aggregation.

News platforms

News aggregation that scales.

Pull articles from hundreds of news sites, tech blogs and industry publications. Headlines, body text, publish dates, authors and hero images come back in one JSON format, ready for your feed.

Business outcomes
  • One JSON format across every source
  • Far less time spent copying and cleaning content
  • New stories in your feed on your own polling schedule
  • Coverage limited only by the sources you add
Marketing curation

Content marketing without the content treadmill.

Collect content from industry leaders and authoritative sources to power newsletters, social feeds and content hubs. Clean text means less editing before you publish a summary or a link.

Business outcomes
  • Curated newsletters built from clean extracted text
  • Research time cut from hours to minutes
  • More relevant third-party content for your audience
  • Summaries and links with author and date attached
Market trends

See category-wide shifts early.

Aggregate industry publications, financial news and academic journals. Feed the extracted text into your own analysis or LLM to track topic volume, regulatory changes and emerging technology.

Business outcomes
  • Hundreds of industry sources in one dataset
  • Topic and trend analysis with your own models
  • Market reports in hours, not weeks
  • A continuous record of category news
Competitor watch

Follow what competitors publish.

Track competitor blogs, press releases and media coverage. Extract every new piece your poller finds and build a competitor content database that you own.

Business outcomes
  • Competitor announcements captured on your polling schedule
  • Content themes and publishing cadence you can analyse
  • Faster response to competitive moves
  • Competitor content gaps you can target
Sources

Aggregate from any source on the web.

Article extraction works on any URL you send, from major publishers to niche blogs. Use the Scrape API with extract_rules for pages that are not articles.

News websites

Articles from major publishers such as CNN, BBC and Reuters. Headlines, full text, authors and images.

Tech blogs

TechCrunch, The Verge and hundreds of tech publications. Articles, reviews and analysis.

Industry publications

Specialised finance, healthcare and manufacturing publications. Expert analysis, reports, regulatory updates.

RSS feeds

Go beyond feed summaries: send each feed item’s URL to the Extract API to get the full text and images.

Social media

Public posts and discussions from Twitter, LinkedIn and Reddit for trend analysis.

Forums

Reddit, Stack Overflow, Hacker News. Questions, answers and emerging discussions for customer and product intel.

Review sites

Yelp, TripAdvisor, G2, Trustpilot. Reviews, ratings and reviewer info for reputation and competitive analysis.

Academic journals

Research papers and abstracts, with author and topic metadata for research intelligence and literature reviews.

Start aggregating No credit card required.
How it works

Three steps to a content pipeline you control.

1

Choose sources

List the sites, sections or RSS feeds you want to follow. The Extract API returns title, body, author, date and images; use extract_rules on the Scrape API for custom fields.

2

Run collection on your schedule

Your own cron job or queue finds new URLs (from feeds, sitemaps or section pages) and sends them to the API: every 15 minutes for breaking news, daily for industry pubs. Ads and navigation are stripped; JavaScript rendering and proxies are handled.

3

Store and deliver

Save the JSON in your database, CMS or vector store. Dedup, categorise and alert in your own code, or with the LLM of your choice.

Try it

Drop an article URL into the playground.

See structured article data (title, body, author, date, hero image) extracted cleanly.

curl 'https://api.ujeebu.com/extract' \
  -H 'ApiKey: YOUR_API_KEY' \
  -G \
  --data-urlencode 'url=https://www.theverge.com/tech/935898/asus-rog-zephyrus-g14-2026-intel-nvidia-review'
No API key required for testing in the playground. Powered by /extract
Features

Built for production content pipelines.

Article extraction

Headlines, body text, authors, dates, images. Navigation and ads stripped, with an is_article score to filter out pages that are not articles.

Dedup-ready output

Clean text, canonical URL, title and publish date make it easy to hash, compare and drop syndicated duplicates on your side.

LLM-ready text

Send clean text or Markdown to your own model for topic tags, summaries or sentiment, with no boilerplate to strip first.

Multi-source at scale

Send requests in parallel up to your plan’s rate limit. Every source comes back in the same JSON format.

Feed discovery

Set feeds=true to get the RSS feeds a site publishes, then poll them on your own schedule to find new articles.

Clean text extraction

HTML, scripts and navigation stripped. Article structure preserved. Output ready for display or analysis. 5 credits per article, 10 with JavaScript rendering.

FAQ

Frequently asked.

Is content aggregation legal?
Aggregating publicly available news headlines, summaries, and factual information for indexing, research, and fair use is generally lawful. Full article text is copyrighted: best practice is to link to original sources, attribute properly, respect robots.txt, and consider fair use for substantial quotes. Many successful aggregators operate legally; for commercial republishing, consult counsel.
How do I filter for quality content?
Filter on your side. The Extract API returns an is_article score (0 to 1) and full text, so you can drop non-articles and thin content, then apply your own source, keyword and topic rules.
How often should I update?
It depends on the source: every 5 to 15 minutes for breaking news, hourly for fast blogs, daily for industry sites, weekly for journals. You run the schedule (cron, cloud functions) and call the Extract API per URL.
How does duplicate detection work?
Do it on your side: hash the extracted text for exact duplicates, use fuzzy matching or title similarity for near-duplicates, and normalise URLs. The Extract API returns clean text, title and publish date to make this straightforward.
What languages are supported?
Extraction works on pages in any language, including multi-byte scripts and right-to-left text. Output is returned as UTF-8.
Do I need to provide attribution?
It is good practice and often expected. Credit the publisher, link to the source and keep author and date in your metadata. Excerpts are safer than full text. The Extract API returns author, date and URL so you can add attribution.
5,000 free credits to start.
No credit card. Blocked and timed-out requests are not billed.
Start free

Start aggregating content today.

Join content platforms, media companies and marketing teams that build aggregation pipelines on Ujeebu’s Extract API.

No credit card required.