The RAG stack that actually scales
Twelve pieces — embedding, vector store, retrieval, eval, framework — that hold up past a prototype.
The RAG hello-world looks easy. The production RAG stack is a different beast: you need an embedding model, a vector store, a retrieval framework, a reranker, and an eval harness that catches regressions before users do. These twelve tools cover every layer. Pick one from each — don't pick two from the same.
Pinecone
FeaturedPinecone is a fully managed vector database built for AI.
Weaviate
Open-source AI-native vector database supporting hybrid search, multi-tenancy, and RAG.
Chroma
Open-source search infrastructure for AI
Vespa
Yahoo's open-source search engine with vector + sparse retrieval.
LlamaIndex
FeaturedData framework for connecting LLMs to your data.
LangChain
The broad LLM application framework — chains, agents, retrievers.
Feast
Feast is an open source feature store that delivers structured data to AI and LLM applications at high scale during training and inference.
RAGFlow
Open-source RAG engine combining retrieval and agent capabilities to create a context layer for LLMs.
Humata.ai
AI agent that turns documents into a knowledge base for instant analysis, insights, and answers.
Exa
Search API for AI agents providing real-time web data, deep research, and structured content.
NotebookLM
Google's source-grounded research notebook that turns your documents into chats, briefs, and AI-hosted podcasts.
Scite
AI research assistant that provides answers grounded in the scientific literature.
Cohere
Cohere North is a complete agentic enterprise AI platform that users control and deploy on their terms.