Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support binary_hamming distance #578

Open
cjnolet opened this issue Jan 16, 2025 · 0 comments
Open

[FEA] Support binary_hamming distance #578

cjnolet opened this issue Jan 16, 2025 · 0 comments
Labels
feature request New feature or request

Comments

@cjnolet
Copy link
Member

cjnolet commented Jan 16, 2025

It's becoming more common that users quantize their vectors using scalar and binary quantization techniques before they hand the vectors off to be indexed. But specifically binary vectors require a version of the hamming distance that uses an XNOR in place of the multiplication.

The distance should support all current input data types for other distances (fp32, fp16, and uint8) as the binary bits can be packed into any of those and needs to be vectorized during the actual load. We will also need to support this for all of our index algorithms, but we should start with CAGRA, since that's the most popular and requested index.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
Development

No branches or pull requests

1 participant