Geonode logo
Available

n8n integration

Bring web data into self-hosted n8n agents and workflows with Geonode’s community node. Extract pages, crawl sites, discover URLs, search the web and run batches. Use extraction and crawl completion triggers to continue your own AI processing, research or record-update steps.

Version 0.2.4Self-hosted n8n · Node.js 20.15+GitHub

What You'll Need

  • Self-hosted n8n · Node.js 20.15+

  • A Geonode API key and an active plan for authenticated requests.

Get started

Add extraction to a self-hosted n8n workflow with the Scraper API node, or start a workflow when an extraction or crawl finishes with Scraper API Trigger.

  1. Test the credentials before building the workflow

    1. Open Credentials → Add credential and choose Scraper API.
    2. Enter your Geonode API key. Keep Base URL set to https://scraper.geonode.io.
    3. Select Test. The node calls GET /v1/statistics; a successful test confirms the key is accepted for that request.
  2. Extract your first page

    1. Add a Scraper API node. Choose Resource: Extract and Operation: Run Extraction.
    2. Set URL to https://example.com and Output Formats to Markdown.
    3. Keep Processing Mode on Sync (Block Until Done), then select Execute step.
    4. Use data.markdown in the next node. tokens_charged reports the extraction cost.

    A successful node execution returns the extracted content. Connect that output to the next step in your workflow after checking it with a single URL.

  3. Wait for a job or react to its completion

    For asynchronous extraction and batches, enable Wait for Completion where offered. For a crawl, start the crawl, then use Get Status with Wait for Completion enabled.

    For event-driven workflows, use Scraper API Trigger with Extract Completed or Crawl Completed. Keep Verify Signature on. Activating the workflow registers its webhook URL; deactivating it removes that registration.

  4. Installation and retry limits

    This is a self-hosted community node, not an n8n-verified Cloud integration. Update it through Settings → Community Nodes.

    The node retries HTTP 429 and 5xx responses with increasing pauses, up to five total attempts, and respects Retry-After. Other errors stop the node and display the API message.

Developer documentation

Get the full setup guide, authentication details and technical reference.

Read the developer docs

Capabilities

  • Extract page content as Markdown or HTML, with optional JavaScript rendering.

  • Run batch extraction and bounded website crawls as background jobs.

  • Discover website URLs before choosing which pages to extract.

  • Run web search jobs and inspect usage statistics.

  • Start follow-up workflows when extraction or crawling completes.

Example workflows

  • Feed a knowledge base

    Extract source pages as Markdown, then connect your own chunking, embedding and storage nodes.

  • Refresh a website dataset

    Start a bounded crawl and process the returned content after the job completes.

  • React to completed extraction

    Use Scraper API Trigger to start follow-up processing for extraction or crawl completion.

Runtime and access

Runtime

Self-hosted n8n · Node.js 20.15+

Account and access

Keep API keys on the server or in your client’s credential store. Usage is charged to your Geonode plan.

Troubleshooting

  • My API key is not accepted.

    Check the key in the Geonode dashboard and send it using X-Api-Key. Keep it out of browser bundles, URLs and version control.

  • The request is rate limited.

    Respect the Retry-After response and your plan’s concurrency limits. Avoid automatically retrying a job submission when its outcome is unknown.

Related integrations

Start building with n8n

Web search and content collection for self-hosted n8n.