IVF with product quantization
Vectors are grouped by nearest centroid, and each group is stored in a file named for its centroid. A query scans only the files for centroids closest to it. Product quantization shrinks vectors for search. Full vectors are about 6 GB per million at 1,536 dimensions. The two steps give about 80% accuracy, and a refinement pass on full vectors gives over 95%.