LightOn LateOn Regularization
STE-regularized ColBERT retrieval model for MUVERA/SMVE-compatible late interaction search.
LateOn Regularization refers to LightOn’s LateOn-regularized ColBERT multi-vector retrieval model/checkpoint. It applies Straight-Through Estimator (STE) regularization during supervised fine-tuning so LateOn-style token embeddings work better with efficient ANN candidate-generation methods such as MUVERA and SMVE while preserving PLAID/MaxSim retrieval performance.
Recent stories
0 linked stories
No linked stories yet.