Skip to content

.Net: [MEVD] Remove the ability to use doubles (float64) as embedding #11654

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
roji opened this issue Apr 20, 2025 · 1 comment
Open

.Net: [MEVD] Remove the ability to use doubles (float64) as embedding #11654

roji opened this issue Apr 20, 2025 · 1 comment
Assignees
Labels
Build Features planned for next Build conference msft.ext.vectordata Related to Microsoft.Extensions.VectorData .NET Issue or Pull requests regarding .NET code

Comments

@roji
Copy link
Member

roji commented Apr 20, 2025

Some of our connectors (Weaviate, Mongo+Azure Mongo, Azure NoSQL, Redis JSON) support ReadOnlyMemory<double> as embedding types. No actual major embedding model supports producing 64-bit floating point numbers AFAIK, and there's apparently no reason for them to.

I'm assuming that doubles were supported in JSON-based connectors, where the number isn't actually typed (in the sense that the number representation is textual in JSON). However, this does not mean we should be exposing double embeddings to users: it's likely that most vector databases will truncate the precision anyway, and this isn't an actual supported scenario anywhere.

@roji roji added .NET Issue or Pull requests regarding .NET code Build Features planned for next Build conference msft.ext.vectordata Related to Microsoft.Extensions.VectorData labels Apr 20, 2025
@roji roji moved this to Backlog: Planned in Semantic Kernel Apr 20, 2025
@github-actions github-actions bot changed the title [MEVD] Remove the ability to use doubles (float64) as embedding .Net: [MEVD] Remove the ability to use doubles (float64) as embedding Apr 20, 2025
@roji roji assigned westey-m and unassigned roji Apr 22, 2025
@westey-m westey-m moved this from Backlog: Planned to Sprint: Planned in Semantic Kernel Apr 22, 2025
@roji
Copy link
Member Author

roji commented Apr 22, 2025

Note: do only after #10492 is done, to avoid conflicts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Build Features planned for next Build conference msft.ext.vectordata Related to Microsoft.Extensions.VectorData .NET Issue or Pull requests regarding .NET code
Projects
Status: Sprint: Planned
Development

No branches or pull requests

3 participants