RAG-Driven Generative AI: Build custom retrieval augmented generation pipelines with LlamaIndex, Deep Lake, and Pinecone

by Denis Rothman

Overview

Minimize AI hallucinations and build accurate, custom generative AI pipelines with RAG using embedded vector databases and integrated human feedback Get With Your Book: PDF Copy, AI Assistant, and Next-Gen Reader Free

Key Features

• Implement RAG’s traceable outputs, linking each response to its source document to build reliable multimodal conversational agents
• Deliver accurate generative AI models in pipelines integrating RAG, real-time human feedback improvements, and knowledge graphs
• Balance cost and performance between dynamic retrieval datasets and fine-tuning static data

Book Description

RAG-Driven Generative AI provides a roadmap for building effective LLM, computer vision, and generative AI systems that balance performance and costs. This book offers a detailed exploration of RAG and how to design, manage, and control multimodal AI pipelines. By connecting outputs to traceable source documents, RAG improves output accuracy and contextual relevance, offering a dynamic approach to managing large volumes of information. This AI book shows you how to build a RAG framework, providing practical knowledge on vector stores, chunking, indexing, and ranking. You’ll discover techniques to optimize your project’s performance and better understand your data, including using adaptive RAG and human feedback to refine retrieval accuracy, balancing RAG with fine-tuning, implementing dynamic RAG to enhance real-time decision-making, and visualizing complex data with knowledge graphs. You’ll be exposed to a hands-on blend of frameworks like LlamaIndex and Deep Lake, vector databases such as Pinecone and Chroma, and models from Hugging Face and OpenAI. By the end of this book, you will have acquired the skills to implement intelligent solutions, keeping you competitive in fields from production to customer service across any project.

What you will learn

• Scale RAG pipelines to handle large datasets efficiently
• Employ techniques that minimize hallucinations and ensure accurate responses
• Implement indexing techniques to improve AI accuracy with traceable and transparent outputs
• Customize and scale RAG-driven generative AI systems across domains
• Find out how to use Deep Lake and Pinecone for efficient and fast data retrieval
• Control and build robust generative AI systems grounded in real-world data
• Combine text and image data for richer, more informative AI responses

Who this book is for

This book is ideal for data scientists, AI engineers, machine learning engineers, and MLOps engineers. If you are a solutions architect, software developer, product manager, or project manager looking to enhance the decision-making process of building RAG applications, then you’ll find this book useful.

Product Details

ISBN-13:	9781836200901
Publisher:	Packt Publishing
Publication date:	09/30/2024
Sold by:	Barnes & Noble
Format:	eBook
Pages:	338
File size:	13 MB
Note:	This product may take a few minutes to download.

About the Author

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.

Table of Contents

Table of Contents

1. Why Retrieval Augmented Generation?
2. RAG Embedding Vector Stores with Deep Lake and OpenAI
3. Building Index-Based RAG with LlamaIndex, Deep Lake, and OpenAI
4. Multimodal Modular RAG for Drone Technology
5. Boosting RAG Performance with Expert Human Feedback
6. Scaling RAG Bank Customer Data with Pinecone
7. Building Scalable Knowledge-Graph-Based RAG with Wikipedia API and LlamaIndex
8. Dynamic RAG with Chroma and Hugging Face Llama
9. Empowering AI Models: Fine-Tuning RAG Data and Human Feedback
10. RAG for Video Stock Production with Pinecone and OpenAI