Digital shelf analytics proxies for rank, content and share-of-shelf tracking

Quick answer

Digital shelf analytics proxies must show your product pages exactly as a shopper in each market sees them, because retailer search results, stock flags and content vary by location and session. Geonode residential proxies provide country, state and city targeting with sticky sessions, and the Scraper API renders retailer pages into HTML, Markdown or JSON, so audits reflect real shelves.

Why digital shelf analytics breaks without the right proxies

Retailer search is personalised and localised. The rank of your SKU for a keyword depends on the shopper's region, the fulfilment centre assigned to the session and sometimes prior browsing. A crawler from a datacenter range gets a generic, often cached result set that does not match your target market, so share-of-shelf numbers drift.

Retailers also protect their search and product APIs. Repeated keyword queries from one IP trigger HTTP 429, CAPTCHA walls or a degraded result page with sponsored slots removed. These degraded pages parse successfully but produce wrong ranks, which is worse than a hard failure.

Content and stock checks have the same problem in a different form. Availability is computed per region and sometimes per session postcode, and rich content such as A+ modules or videos may load only after client-side rendering. Without region-accurate IPs and a rendering step, your audit reports a product as out of stock or missing content when a local shopper sees neither issue.

Which Geonode proxy type fits

The recommended product is Residential proxies, with the Scraper API as the rendering layer. The pool has 2.5M IPs online and 30–50M unique IPs rotating monthly across 195+ countries, targetable by country, state, city, ASN and OS where available. That lets you run a rank check for the same keyword from each market and compare the shelves side by side.

Sticky sessions hold an IP for up to 24 hours, keeping the fulfilment region and postcode constant across a keyword list. For rank sampling, drop the session parameter so each query looks like a fresh shopper.

The Scraper API complements the proxies for rendered product pages. It returns HTML, Markdown or JSON with JavaScript rendering, and the unlimited plan has ready targets for Amazon, eBay and other retailers.

ISP proxies at $1.25 per IP suit authorised seller-portal checks from a stable IP. Datacenter proxies at $0.14/GB are fine for taxonomies and image downloads, not for location-dependent rank or stock.

Residential — Best for: Search rank, stock, content and ratings per market; IP source: Real household devices, 195+ countries; Session: Rotating or sticky up to 24 h; Price from: $0.27/GB at volume
ISP (static residential) — Best for: Authorised seller-portal checks from a fixed IP; IP source: Static IPs from real ISPs; Session: Unlimited, same IP; Price from: $1.25/IP
Datacenter — Best for: Taxonomies, help pages, image assets; IP source: Rotating datacenter ranges; Session: Rotating; Price from: $0.14/GB

How to set it up

Build the keyword and SKU matrix per retailer and market: category keywords, your product ids and the competitor ids that define share of shelf.
Create residential credentials and generate one username per market with country and city targeting. Use a session id for content and stock audits, and no session for rank sampling.
Run keyword searches per market, capture the first pages of organic and sponsored results, and record the position of every tracked SKU with page, slot and badge information.
Fetch each product page through the Scraper API with rendering enabled, then diff title, bullets, images, rich content and variant list against your master product content.
Store ratings, review counts, buy-box owner and stock status per market and date, retry throttled queries with back-off, and alert on rank drops or content mismatches.

# verify endpoint against docs.geonode.com before publishing
import requests

USER = "USERNAME-country-de-city-berlin-session-shelf-de"
PASS = "PASSWORD"
proxy = f"http://{USER}:{PASS}@premium-residential.geonode.com:9000"
proxies = {"http": proxy, "https": proxy}

r = requests.get(
    "https://example-retailer.de/s",
    params={"k": "protein powder", "page": 1},
    proxies=proxies,
    headers={"Accept-Language": "de-DE"},
    timeout=30,
)
print(r.status_code, r.url)

Get the exact snippet for your language from the API Code Generator in the dashboard.

Digital shelf analytics-specific settings that matter

Rotating for rank, sticky for audits

Rank sampling should look like independent shoppers, so rotate per request and sample each keyword several times to average out personalisation. Content, stock and ratings checks need a consistent postcode and fulfilment region, so use one sticky session per market and keep it for the whole product list.

Market and city targeting

Retailers compute stock and delivery promises per region. Target the city your shoppers live in, not just the country, and keep in mind that state and city targeting cannot be combined. Where a retailer uses a postcode field, set it at the start of the session and verify it in the page header.

Concurrency and back-off

Geonode sets no fixed thread limit, but retailer search endpoints throttle per IP quickly. Keep per-session rates low and scale by adding sessions across markets. Back off exponentially on HTTP 429 and CAPTCHA pages, and never retry the same keyword on the same session immediately.

What to log

Log market, session id, keyword, page, result count, sponsored slot count, response status and render time. For product pages add buy-box owner, stock text and module count. A page with no sponsored slots or missing modules is likely degraded, so re-fetch it through a new session.

What Geonode gives you for digital shelf analytics

Country, state, city, ASN and OS targeting across 195+ countries for market-accurate shelves.
Sticky sessions up to 24 hours for consistent content, stock and ratings audits.
Scraper API with JavaScript rendering, returning HTML, Markdown or JSON.
Unlimited Scraper ready targets for Amazon, eBay and other major retailers.
Pay-as-you-go residential traffic from $0.27/GB at volume, no contract.

Pricing for digital shelf analytics

Residential traffic is pay-as-you-go with no contract: 10 GB for $7.92 per month ($0.792/GB), 50 GB for $34.65, and $0.27/GB at volume. A 3-day trial costs $5. The Scraper API gives 1.5K free requests per month, then from $3.50 per 10K requests, with unlimited plans from $47 to $1,799 per month by thread count. ISP proxies start at $1.25 per IP and datacenter traffic at $0.14/GB. Compare tiers on the pricing page.

FAQ

How is digital shelf analytics different from price compliance monitoring?

Price compliance checks whether sellers respect your minimum advertised price. Digital shelf analytics measures discoverability and presentation: search rank, share of shelf, content accuracy, ratings and stock. Both use the same proxies but different crawl patterns and output schemas.

Why do digital shelf analytics proxies need city targeting?

Stock, delivery promises and sometimes search rank are computed per region or postcode. A country-level IP lands in one metro and misreports every other market. City targeting lets you reproduce the view of shoppers in each city you sell to.

How many times should I sample a keyword for rank?

Retailer search includes personalisation and A/B variants, so a single result is noisy. Sample each keyword several times per market through rotating IPs and store the median position, along with the spread, so your dashboards show real movement rather than variance.

Do digital shelf analytics proxies work with rendered product pages?

Yes. Pair residential proxies with the Scraper API, which renders JavaScript and returns HTML, Markdown or JSON. Use it for product pages with rich content modules and variant selectors, and use raw proxy requests for lighter search result pages.

Is this kind of retailer monitoring compliant?

Collect only publicly visible search results, product content and ratings, respect each retailer's terms, robots policies and rate limits, and use seller accounts only where you own them or have authorisation. Geonode's acceptable use policy prohibits fraud, spam and credential abuse.

Can I track competitor share of shelf too?

Yes. Share of shelf is the proportion of result slots held by each brand for a keyword, so you record every tracked SKU on the page, not just yours. The same crawl produces competitor rank, ratings and stock without additional requests.

Start

Audit one market and keyword set on the 3-day trial, then expand by retailer and country. Get started with pay-as-you-go traffic or Contact sales for multi-retailer programmes.