Simple and cheap RAG - genai-toolbox and pgvector
I recently hit a common architectural fork in the road while building my ADK (Agent Development Kit) application. Initially, I was using Chroma as my RAG (Retrieval-Augmented Generation) backend. I...
Source: DEV Community
I recently hit a common architectural fork in the road while building my ADK (Agent Development Kit) application. Initially, I was using Chroma as my RAG (Retrieval-Augmented Generation) backend. It works perfectly for local development, but things got complicated when moving to the cloud. I needed a production-ready, resilient solution that didn't involve managing stateful assets on a Mac Mini or paying for a separate managed vector database. The solution was already right in front of me: Postgres š. By using pgvector, you can turn your relational database into a powerful vector store. This is especially seamless if you use Supabase, which can host small databases for free or provide a "Pro" tier for a reasonable price. Why I Swapped MCP for genai-toolbox In my previous setup, I used an chroma mcp server. However, for my relational data, I was already relying heavily on genai-toolbox. I realized I could simplify my architecture significantly by dropping the separate MCP server and Ch
