TurboQuant on Qdrant Edge: 8× Less Disk? We Tested It.
HiDevs
0:00 / 0:00
TurboQuant on Qdrant Edge: 8× Less Disk? We Tested It.
2 109 просмотров · 2 недели назад
HiDevs
617 подписчиков
2 109 просмотров · 2 недели назад
Can TurboQuant really deliver 8× less disk usage on Qdrant Edge?
In this video, we put it to the test with a real benchmark using 20,000 vectors, 384 dimensions, six configurations, and 200 queries per configuration.
But the benchmark revealed something more interesting: there are two different TurboQuant approaches in Qdrant Edge, and they have very different tradeoffs between storage and recall.
In this video, we:
Benchmark TurboQuant on Qdrant Edge
Compare float32, TurboQuant bit-depths, and Turbo4 datatype
Inspect the actual Qdrant Edge shard files
Explain why some TurboQuant configurations don't significantly reduce disk usage
Break down how rescoring helps preserve recall
Uncover a sparse-file disk measurement issue
Compare recall, disk usage, and latency
Validate results against an independent NumPy ground truth
The key takeaway: the “8× smaller” claim depends on which TurboQuant knob you use.
Everything is based on an actual local benchmark, with the code and results available so you can reproduce the experiment yourself.
Tools & Technologies:
Qdrant Edge · TurboQuant · Vector Search · Quantization · NumPy · Python
#Qdrant #TurboQuant #VectorDatabase #AI #MachineLearning #RAG #VectorSearch #GenerativeAI