Elastic Adds Support for Cohere High-Performance Embeddings
Developers can now natively use the Elastic vector database to store and search Cohere’s new int8 text embeddings
April 03, 2024
Share this

Elastic, the company behind Elasticsearch®, announced the Elasticsearch open Inference API now supports Cohere’s text embedding models.

This includes Elasticsearch native support for efficient int8 embeddings, which optimize performance and reduce memory cost for semantic search across the large datasets commonly found in enterprise scenarios.

With this integration, Elasticsearch developers can experience immediate performance gains, including up to 4x memory savings and up to 30% faster search, without impacting search quality.

“We’re excited to collaborate with Elastic to bring state-of-the-art search solutions to enterprises,” said Jaron Waldman, chief product officer at Cohere. “Elasticsearch delivers strong vector retrieval performance on large datasets, and their native support for Cohere’s Embed v3 models with int8 compression helps unlock gains in performance, efficiency, and search quality for enterprise-grade deployments of semantic search and retrieval-augmented generation (RAG)."

“Developers who want to build more intuitive and accurate semantic search experiences for enterprise use cases need to look at Elasticsearch and Cohere,” said Shay Banon, founder & chief technology officer at Elastic. “Innovation is rarely insular, and our work with the great team at Cohere showcases how we bring developers the best of both worlds. The Cohere and Elastic communities now have great models to generate embeddings with support for inference workloads and seamless integration into the leading search and analytics platform that has invested in creating the best vector database.”

Support for Cohere embeddings is available in preview with Elastic 8.13 and will soon be generally available in an upcoming Elasticsearch release.

Share this

The Latest

May 02, 2024

A majority (61%) of organizations are forced to evolve or rethink their data and analytics (D&A) operating model because of the impact of disruptive artificial intelligence (AI) technologies, according to a new Gartner survey ...

May 01, 2024

The power of AI, and the increasing importance of GenAI are changing the way people work, teams collaborate, and processes operate ... Gartner identified the top data and analytics (D&A) trends for 2024 that are driving the emergence of a wide range of challenges, including organizational and human issues ...

April 30, 2024

IT and the business are disconnected. Ask the business what IT does and you might hear "they implement infrastructure, write software, and migrate things to cloud," and for some that might be the extent of their knowledge of IT. Similarly, IT might know that the business "markets and sells and develops product," but they may not know what those functions entail beyond the unit they serve the most ...

April 29, 2024

Cloud spending continues to soar. Globally, cloud users spent a mind-boggling $563.6 billion last year on public cloud services, and there's no sign of a slowdown ... CloudZero's State of Cloud Cost Report 2024 found that organizations are still struggling to gain control over their cloud costs and that a lack of visibility is having a significant impact. Among the key findings of the report ...

April 25, 2024

The use of hybrid multicloud models is forecasted to double over the next one to three years as IT decision makers are facing new pressures to modernize IT infrastructures because of drivers like AI, security, and sustainability, according to the Enterprise Cloud Index (ECI) report from Nutanix ...

April 24, 2024

Over the last 20 years Digital Employee Experience has become a necessity for companies committed to digital transformation and improving IT experiences. In fact, by 2025, more than 50% of IT organizations will use digital employee experience to prioritize and measure digital initiative success ...

April 23, 2024

While most companies are now deploying cloud-based technologies, the 2024 Secure Cloud Networking Field Report from Aviatrix found that there is a silent struggle to maximize value from those investments. Many of the challenges organizations have faced over the past several years have evolved, but continue today ...

April 22, 2024

In our latest research, Cisco's The App Attention Index 2023: Beware the Application Generation, 62% of consumers report their expectations for digital experiences are far higher than they were two years ago, and 64% state they are less forgiving of poor digital services than they were just 12 months ago ...

April 19, 2024

In MEAN TIME TO INSIGHT Episode 5, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the network source of truth ...

April 18, 2024

A vast majority (89%) of organizations have rapidly expanded their technology in the past few years and three quarters (76%) say it's brought with it increased "chaos" that they have to manage, according to Situation Report 2024: Managing Technology Chaos from Software AG ...