juliuslipp
commited on
Commit
•
69b25ae
1
Parent(s):
8eb1294
Update README.md
Browse files
README.md
CHANGED
@@ -2797,11 +2797,9 @@ Please find more information in our [blog post](https://mixedbread.ai/blog/mxbai
|
|
2797 |
|
2798 |
## Matryoshka and Binary Quantization
|
2799 |
|
2800 |
-
Embeddings in their commonly used form (float arrays) have a high memory footprint when used at scale. Two approaches to solve this problem are Matryoshka Representation Learning (MRL) and (Binary) Quantization.
|
2801 |
|
2802 |
-
|
2803 |
-
|
2804 |
-
You can also take it one step further, and combine these. This combination of binary quantization and MRL allows you to reduce the memory usage of your embeddings significantly. This leads to much lower costs when using a vector database in particular. You can read more about the technology and its advantages in our [blog post](https://www.mixedbread.ai/blog/binary-mrl).
|
2805 |
|
2806 |
## Community
|
2807 |
Please join our [Discord Community](https://discord.gg/jDfMHzAVfU) and share your feedback and thoughts! We are here to help and also always happy to chat.
|
|
|
2797 |
|
2798 |
## Matryoshka and Binary Quantization
|
2799 |
|
2800 |
+
Embeddings in their commonly used form (float arrays) have a high memory footprint when used at scale. Two approaches to solve this problem are Matryoshka Representation Learning (MRL) and (Binary) Quantization. While MRL reduces the number of dimensions of an embedding, binary quantization transforms the value of each dimension from a float32 into a lower precision (int8 or even binary). <b> The model supports both approaches! </b>
|
2801 |
|
2802 |
+
You can also take it one step further, and combine both MRL and quantization. This combination of binary quantization and MRL allows you to reduce the memory usage of your embeddings significantly. This leads to much lower costs when using a vector database in particular. You can read more about the technology and its advantages in our [blog post](https://www.mixedbread.ai/blog/binary-mrl).
|
|
|
|
|
2803 |
|
2804 |
## Community
|
2805 |
Please join our [Discord Community](https://discord.gg/jDfMHzAVfU) and share your feedback and thoughts! We are here to help and also always happy to chat.
|