Photo by
Paris Bilal
on
Unsplash
Crab Island RAG Expedition
RAG in Rust
Building a RAG System in Rust
🏕️ Part 1: Landfall — Setting Up Camp on Crab Island
Project setup, dependencies, and why Rust for RAG
🍾 Part 2: Opening the Bottles — Text Extraction
Extracting text from PDFs, EPUBs, and HTML with kreuzberg
🥥 Part 3: Cracking Coconuts — Chunking Text
Splitting documents into overlapping chunks for embedding
💎 Part 4: The Pearl Forge — Embeddings and Vector Storage
Generating embeddings with Ollama and storing vectors in libSQL
🤿 Part 5: The Pearl Divers — Implementing Vector Search
Implementing vector similarity search with SQL and cosine distance
🦜 Part 6: Asking the Parrot — The Full RAG Pipeline
Wiring sync and chat binaries into a full RAG pipeline
