14× faster embeddings: how we rebuilt the ONNX path in Manticore
- When we shipped Auto Embeddings — the feature that turns any text column into a vector automatically, with no separate model service to run — the most common piece of feedback was about speed.
- So we spent a few weeks rebuilding how Manticore runs ONNX models.
- The new ONNX Runtime backend shipped in Ma
Unverified
- When we shipped Auto Embeddings — the feature that turns any text column into a vector automatically, with no separate model service to run — the most common piece of feedback was about speed.
- So we spent a few weeks rebuilding how Manticore runs ONNX models.
- The new ONNX Runtime backend shipped in Ma
Sources: Manticoresearch