Building Blocks
| Stage | Examples | Use in Research |
|---|---|---|
| Search (filter) | feature_search, query_expand | Gather candidate documents across modalities; expand queries for recall |
| Narrow (filter) | attribute_filter, llm_filter | Restrict to relevant time ranges, entities, or sentiment |
| Web (apply) | external_web_search, web_scrape | Pull public sources from the open web |
| Enrich | document_enrich, taxonomy_enrich, llm_enrich | Attach related docs, taxonomy tags, or LLM-extracted facts |
| Synthesize (reduce) | summarize | Aggregate results into a single synthesized brief with citations |
| Compose (apply) | api_call, cross_compare | Call external services (e.g., fact-check APIs) or compare across collections |
Common Patterns
Literature Review
- Seed search using
feature_searchto retrieve recent papers across text and figures. - Narrow by publication date and venue with
attribute_filter. - Classify by research area with
taxonomy_enrich. - Synthesize findings with citations using
summarize. - Store summaries alongside
feature_idreferences for auditability.
Competitive Intelligence
- Use
external_web_search+web_scrapestages to pull public announcements. - Join with internal product docs via
document_enrichto compare specs. - Apply an
attribute_filterto spotlight price or feature gaps. - Generate a briefing memo with the
summarizestage.
Incident Investigation
- Collect relevant runbooks/logs via
feature_searchover internal collections. - Use
attribute_filterto isolate the incident window. - Enrich with taxonomy-based tags (
taxonomy_enrich) for impacted systems. - Summarize timeline and root cause via
summarize, keeping citations.
Orchestrating Multi-Retriever Flows
Leverage thedocument_enrich stage to call a sub-retriever based on previous stage output:
Capturing Feedback
- Record user signals with the Interactions API (
click,long_view,positive_feedback, etc.). - Feed interactions back into auto-tuning or
attribute_filterstages (“hide documents seen in this session”). - Use Observability to optimize parameter choices (e.g., increase a
feature_searchstage’sfinal_top_kif users often tap beyond the top 10).
Operational Tips
- Persist execution IDs – each
executeresponse includes an execution id; link it to your research session for audit trails. - Monitor stage telemetry –
stage_statisticsidentifies bottlenecks (e.g., LLM stages dominating latency). - Budget controls – set
budget_limitson retrievers to cap time or spend for exploratory workflows. - Cache intermediate results – cache expensive discovery steps, especially when analysts reiterate queries.
- Leverage tasks – schedule enrichment batches (clusters, taxonomies) ahead of time so research pipelines stay low-latency.
Suggested Architecture
Next Steps
- Review Retrievers for stage configuration details.
- Learn how Filters and Taxonomies contribute structure to exploratory pipelines.
- Use Operations → Observability to monitor research workloads in production.

