RAG Frameworks

LangChain

LLM Orchestration

Framework for developing applications powered by language models, providing tools for chains, agents, retrieval, and memory management.

LlamaIndex

Data Framework

Data framework for connecting custom data sources to large language models with indexing, retrieval, and query engine capabilities.

Haystack

Search Framework

Open-source framework by deepset for building production-ready LLM applications, RAG pipelines, and semantic search systems.

DSPy

Prompt Programming

Framework by Stanford NLP for programming with foundation models using declarative modules, optimizers, and assertions instead of prompt engineering.

Vectara

Enterprise RAG

Trusted AI platform for enterprise RAG providing semantic search, retrieval, and grounded generation with built-in hallucination detection.

Ragas

RAG Evaluation

Open-source framework for evaluating RAG pipelines with metrics for faithfulness, answer relevancy, context precision, and context recall.

Embedchain

RAG Framework

Open-source RAG framework that simplifies creating AI-powered chatbots from any data source with automatic chunking, embedding, and retrieval.

txtai

Embeddings Framework

All-in-one open-source embeddings database combining vector search, LLM orchestration, and language model workflows in a single library.

Semantic Kernel

LLM Orchestration

Open-source SDK by Microsoft for integrating LLMs into applications with plugin architecture, planners, and memory for building AI agents and RAG.

Cognita

RAG Framework

Open-source RAG framework by TrueFoundry for building modular, production-ready retrieval augmented generation applications with customizable pipelines.