Apply
Web Scrape
Fetch full web page content from URLs in document fields
Note: This playground provides simulated output to showcase functionality. No data is processed on our servers. Use this demo to explore the stage's configuration options before integrating it into your retriever pipeline.
Configuration
string
Required
REQUIRED. Dot-path to the field containing the URL to scrape.
string
Required
REQUIRED. Dot-path where scraped content is stored.
integer
Scrape timeout in seconds.
string
Content extraction mode: 'text', 'html', or 'markdown'.
Output
No output yet
Configure the stage parameters and click "Run Stage" to see the simulated output.
Related to web_scrape
Pages on the same stages, extractors and patterns.
Retriever
Json Transform
Transform documents using Jinja2 templates that render to JSON
Learn more
Retriever
Rag Prepare
Prepare documents for LLM context windows with token management
Learn more
Retriever
External Web Search
Enrich documents with web search results using Exa AI
Learn more
Retriever
Api Call
Enrich documents with external API calls
Learn more
Retriever
Sql Lookup
Enrich documents with SQL query results from external databases
Learn more
Retriever
Llm Enrich
Enrich documents with LLM-generated fields using natural language prompts
Learn more