7 min read

How Many Dimensions Is That Vector?

My RAG system stores vectors from three different embedding models. Instead of remembering which database uses which model, I taught it to figure that out from the vector dimensions: 768 means nomic, 1024 means qwen 0.6B, 4096 means qwen 8B.

#rag #embeddings #ai #sqlite #argonaut