Geonode logo

Unlimited Google News scraper for AI agents.

A Google News scraper for top stories, topic feeds, search results, publication pages and story clusters. Unlimited requests for one flat bill from $50/mo, no credits, and a blocked request is free.

Start 48-hour free trial

No card. Unlimited pages. 5 threads. Failed requests $0

Unlimited web scraper
01

Images

02

Title

  • Title
  • Condition
03

Price & bidding

  • Price
  • Bids
  • Time left
  • Watchers
04

Seller

  • Seller rating
  • Sold listings
05

Specifics & shipping

  • Item specifics
  • Shipping
  • Item location

JavaScript rendered, parsed to JSON or Markdown, and a fetch that fails after three retries is never billed

Call it on Google News

curl -X POST "https://scraper.geonode.io/v1/extract" \
  -H "X-Api-Key: $GEONODE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "url": "https://news.google.com/search?q=artificial%20intelligence&hl=en-US&gl=US&ceid=US%3Aen",
  "formats": [
    "json",
    "markdown"
  ],
  "render_js": true,
  "proxy": {
    "country": "US"
  }
}'

You came for an Google News scraper. The key opens everything.

100% first-pass success

you’re here

Top stories: Headline, Source name, Published time, Article URL, Thumbnail, Cluster position

Story cluster: Lead headline, Related headlines, Source per headline, Full coverage link, Local coverage flag, Opinion label

Topic feed: Topic name, Topic ID, Section tabs, Headline list, Source list, Timestamps

Search results: Query, Result headline, Source, Snippet, Relative time, Decoded article URL, Result count

Publication page: Publication name, Publication ID, Logo, Latest headlines, Section list, Follow count

One subscription, from $50 a month flat. Everything after the first line adds $0

The hard part is getting in. That's our part.

  • $50/moflat, priced by concurrency, not per request

  • 0credits, meters or per-page charges

  • $0for any Google News request that still fails after 3 retries

  • 48 hfree trial on your own Google News URLs

  • Cloudflare98%

  • Akamai97%

  • Imperva Incapsula97%

  • DataDome96%

  • PerimeterX / HUMAN95%

  • reCAPTCHA v395%

  • Kasada94%

  • hCaptcha93%

First-pass success by anti-bot vendor, measured by us over 30 days, so of course it flatters us. The 48-hour trial exists so you can count against your own URLs. Full benchmark

What unlimited changes for Google News data

  • Sold-comps pricing

    Completed listings are the real price of anything. Pull them at scale and price with evidence.

  • Arbitrage sourcing

    Sweep categories for mispriced inventory continuously instead of when the credit budget allows

  • Demand research

    Bids, watchers and sell-through, across a whole category, on one flat bill

  • Collection tracking

    Every listing of the thing you care about, the moment it appears

Cheap is supposed to be the trade-off

  • Michael T.

    Switched from Bright Data. Same quality, fraction of the cost. Their wholesale model actually makes sense.

  • Kristina Halvorson

    Finally a proxy provider that actually feels built for developers

  • Edgar Weissnat

    We run multiple large-scale data collection pipelines across several regions, and proxy reliability has always been one of the biggest bottlenecks. After switching to Geonode we noticed two immediate improvements: connection stability and predictable pricing. Previously we had to constantly optimize traffic to avoid massive proxy bills. With Geonode’s wholesale pricing model we can focus on building products instead of worrying about proxy usage. Integration with our Python stack and Playwright automation was straightforward and took less than a day.

  • Gladys Paucek

    Best proxy infrastructure I've used. The MCP integration with our AI agents was seamless.

  • Gladys Paucek

    Finally something that doesn’t feel like enterprise sales software.

Pick your thread count. That's the only decision.

Nothing is metered. Plans price threads (how many requests run at once), and pages stay unlimited on every one. An Google News page that needs an anti-bot bypass costs exactly what a plain page costs

Roughly what each plan clears in a month, by endpoint

Starter

2 threads

$50 /mo

~470K
~280K
~1.1M
~610K
~120K
~400K
Start free

Growth

5 threads

$100 /mo

Popular
~1.2M
~700K
~2.8M
~1.5M
~300K
~1M
Start free

Scale

25 threads

$400 /mo

~5.9M
~3.5M
~13.8M
~7.6M
~1.5M
~5M
Start free

Pro

100 threads

$1,250 /mo

~23.5M
~14M
~55M
~30M
~5.9M
~20M
Start free

Max

250 threads

$2,500 /mo

~59M
~35M
~137M
~76M
~15M
~50M
Start free

The 48-hour trial runs at five threads, no card. Custom terms past 250 threads.

Yeah, but...

We do not yet publish a benchmark number for news.google.com, so there is no pass rate on this page. The defence is specific: Google News is a single-page app that returns an almost empty shell without JavaScript, redirects EU and UK addresses to consent.google.com before any feed loads, and serves an "unusual traffic" page to datacenter ranges that fetch many queries in a row. The Google News scraper renders the page, resolves the consent redirect, and uses residential IPs so the headline feed is what comes back, not the shell. Three retries are automatic, and a request that fails after three retries is never billed, on any plan.

The home feed at /home with its top stories blocks, topic feeds at /topics/{id} such as Business or Technology, search results at /search?q= with hl, gl and ceid controlling language and edition, publication pages at /publications/{id}, and story clusters at /stories/{id} where every outlet's headline on one event is grouped. Each has its own target_param so the Google News scraper applies the right parser and returns a stable JSON object. Pass a country and the Google News scraper reads from a residential IP there, so the edition, language and local stories match what a reader in Berlin or Mumbai sees rather than the US feed served abroad.

Yes. Google News does not link to the publisher directly; every headline points to an encoded ./articles/{token} or ./read/{token} path that redirects after a client-side step, and the token format has changed more than once. The Google News scraper follows that step and returns both the raw Google link and the decoded publisher URL, plus the source name and favicon, so you are not maintaining your own decoder. Timestamps are returned as ISO 8601 alongside the "3 hours ago" label. When the encoding changes again, the Google News scraper parser is updated on our side rather than in your pipeline, which is the point of a typed target instead of raw HTML.

Headlines, snippets and source names on news.google.com are visible to a logged-out visitor, and in the US the hiQ v. LinkedIn decisions treat collecting public pages as outside the Computer Fraud and Abuse Act; Google's Terms of Service still forbid automated access, so contract risk is separate from criminal risk. The Google News scraper never uses a Google account, so personalized For You feeds and followed topics are out of scope. Search returns roughly one hundred headlines per query with no page two; split by date range or edition to go deeper. The article body belongs to the publisher, so the Google News scraper returns the link, and the publisher page is a separate request.

No request credits and no per-page meter. Plans are priced by concurrency, which is the number of requests in flight at once, from $50 a month. Run as many requests through that concurrency as you can, around the clock, for the same bill. A request that fails after three retries is not counted against anything.

Yes. Pass a country code and the request routes through a residential IP there, so marketplaces return local prices and currency, search engines return local results, and geo-restricted pages open. City and ASN targeting are available on the residential pool where a site is sensitive to it.

Typed JSON with the field table on this page, clean Markdown for feeding an LLM context window, or raw rendered HTML if you run your own parser. For pages without a dedicated parser you can pass a JSON schema and get AI-extracted fields back in that shape.

48 hours. Your worst Google News URLs.

Five threads, no card, and the clock starts at your first API call. If it doesn’t earn the switch, don’t switch.

Start the trial