Skip to content

Part V — Advanced Retrieval-Augmented Generation

Move beyond basic vector search and learn how to design, evaluate and operate reliable RAG systems.

Advanced Retrieval-Augmented Generation Banner

Overview

Part IV introduced the basic RAG flow: retrieve relevant information, add it to the model's context, and generate an answer.

Real-world systems need more. A query may use unfamiliar wording, require exact terms, depend on metadata, or span several documents and data sources. Even when retrieval works, the system still needs to select useful context, produce grounded answers and behave reliably under production conditions.

This part builds those capabilities in a practical sequence. You will explore retrieval patterns, see how they are implemented with LlamaIndex, study specialised RAG architectures, and then move into production engineering.

Learning path

flowchart TD
    A["Core Retrieval"] --> B["Advanced Retrieval"]
    B --> C["LlamaIndex Implementations"]
    C --> D["Specialised RAG Architectures"]
    D --> E["Production RAG Engineering"]

What you'll learn

  • Choose retrieval strategies based on the problem being solved.
  • Combine semantic and keyword search, and improve result ranking.
  • Use query expansion, metadata filters and hierarchical retrieval.
  • Understand how LlamaIndex implements common retrieval patterns.
  • Explore Graph RAG, SQL RAG, multimodal RAG and Agentic RAG.
  • Design production pipelines for context selection, validation and citations.
  • Evaluate retrieval quality and monitor system behaviour.
  • Address performance, cost, deployment, caching, tenant isolation and failure handling.

1. Core Retrieval Engineering

Start with the retriever patterns that extend basic vector similarity search.

Chapter Topic
01 VectorStore Retriever
02 Multi-Query Retriever
03 Self-Query Retriever
04 Parent-Document Retriever
05 Retriever Comparison

These chapters move from a straightforward vector retriever to query expansion, metadata-aware retrieval and parent-document context.

2. Enterprise Retrieval Engineering

Learn how to improve relevance, coverage and context quality by combining retrieval techniques.

Chapter Topic
01 Contextual Compression Retriever
02 Ensemble Retriever
03 Multi-Vector Retriever
04 Time-Weighted Retriever
05 Hybrid Search Retriever
06 HyDE Retriever
07 Router Retriever
08 Multi-Stage Retrieval
09 Agentic Retrieval
10 Re-ranking Techniques
11 MMR & Diversity-Aware Retrieval
12 Metadata-Aware Retrieval
13 Advanced Query Rewriting

The key idea is to match the retrieval strategy to the query. Hybrid search can help with exact terminology; reranking can improve the order of retrieved candidates; and compression can remove context that does not help answer the question.

3. LlamaIndex Retrieval Engineering

Apply retrieval concepts using LlamaIndex. The focus here is on retrieval implementation, not a general introduction to the framework.

Chapter Topic
01 LlamaIndex Retrievers Overview
02 LlamaIndex Indexes
03 Vector Index Retriever
04 BM25 Retriever
05 Document Summary Retriever
06 Recursive Retriever
07 Query Fusion Retriever
08 Auto-Merging Retriever

4. Multimodal AI Engineering

RAG is not limited to text. Enterprise knowledge may also include audio, images, tables, charts and video. This section broadens the view to multimodal systems and their engineering considerations.

Chapter Topic
01 Multimodal AI Fundamentals and Architecture
02 Enterprise Speech AI: STT, TTS and Voice Pipelines
03 Vision-Language Models and Image Understanding
04 Generative Media Engineering: Text-to-Image and Video
05 Production Multimodal Applications and Orchestration
06 Multimodal AI Risks, Evaluation and Governance

5. Advanced RAG Architectures

Explore architectures that go beyond conventional text-based vector retrieval.

Chapter Topic
01 Advanced RAG Architecture
02 Graph RAG
03 Knowledge Graphs for RAG
04 SQL RAG
05 Multimodal RAG
06 Agentic RAG

These patterns address different kinds of knowledge and query complexity. Choose them when the data or retrieval problem calls for them—not simply to make the architecture more elaborate.

6. Production RAG Engineering

A retrieval pipeline is not production-ready just because it returns relevant documents. The following chapters cover the engineering needed to assemble, validate, evaluate, deploy and operate a dependable system.

Chapter Topic
01 Prompt Assembly
02 Context Selection & Context Engineering
03 Response Validation
04 Citation & Source Attribution
05 Enterprise Response
06 RAG Evaluation & Benchmarking
07 RAG Observability
08 RAG Performance Optimization
09 RAG Cost Optimization
10 Production Retrieval Architecture
11 Building Production RAG Systems
12 RAG Deployment Patterns
13 RAG Caching Strategies
14 Multi-Tenant RAG
15 RAG Testing Frameworks
16 RAG Failure Patterns

The production mindset

As you work through the final section, keep a few principles in mind:

  • Start with the simplest retrieval that works. Add hybrid search, reranking or agentic retrieval when evaluation shows a need.
  • Measure retrieval separately from generation. A fluent answer cannot compensate for missing or irrelevant evidence.
  • Treat security as an application responsibility. Prompts are not authorization controls; enforce access before data reaches the model.
  • Measure trade-offs. Retrieval quality, latency, cost and operational complexity need to be considered together.
  • Design for failure. Account for stale indexes, unavailable dependencies, timeouts, invalid outputs and recovery.

How this part fits into the handbook

Part IV established the foundations of RAG. Part V builds on them with advanced retrieval and production engineering. The next part moves from retrieving knowledge to systems that can reason, use tools and take actions.

Start learning

Begin with 01. VectorStore Retriever and follow the sections in order. You can then use the production chapters as a guide when turning retrieval experiments into a system that is measurable, secure and reliable.


Enterprise AI Engineering Handbook

Building Production-Grade Enterprise AI Systems — One Chapter at a Time.