Elastic democratizes generative AI for proprietary data with the Elasticsearch Relevance Engine

Elastic, the company behind Elasticsearch, is launching the Elasticsearch Relevance Engine (ESRE), an engine designed to augment and power AI-based search applications using proprietary enterprise data. By enabling organizations to unlock the power of generative AI through out-of-the-box semantic search, LLM integration, hybrid search, and third-party transformer models, ESRE democratizes AI and ML for enterprises bogged down by under-utilized structured and unstructured data, according to the company.

Generative AI, and its potential use cases, has absolutely exploded in popularity; while it may present as a new and exciting avenue toward enterprise success, generative AI’s capabilities often remain elusive.

ESRE leverages built-in vector search and transformer models to grant accessibility to generative AI for a wide variety of organizations. Elastic’s latest solution provides enterprises with the tools they need to derive value from proprietary structured and unstructured data through the power of custom generative AI—all while simultaneously enhancing data infrastructures.

“Generative AI is a revolutionary moment in technology and the companies that get it right fast, are tomorrow’s leaders,” said Ash Kulkarni, CEO of Elastic. “The Elasticsearch Relevance Engine is available today, and we’ve already done the hard work of making it easier for companies to do generative AI right.”

ESRE combines numerous technologies—including unified APIs for vector search, BM25f search and hybrid search, and an extremely compact transformer model—to drive enterprise value while optimizing for efficiency and cost. Organizations no longer have to worry about the size and cost of running LLMs with ESRE, according to the vendor.

“Enterprises are excited about the potential for generative AI in their applications and workflows but are all also swamped by the pace of innovation in the field,” said James Governor, co-founder of RedMonk. “ESRE is designed to ease adoption of transformers, homemade, and third-party LLM models, building on the original core strengths of Elastic in search.”

With ESRE allowing enterprises to “bring their own” transformer model, as well as the ability to integrate with third-party transformer models like OpenAI GPT 3/4, any business can create secure deployments that are built upon their unique proprietary data without massive impacts to enterprise resources.

“The expertise of Elastic in enterprise search is evident in the way the company thinks about how to incorporate generative AI into it,” said Julia Liuson, president of Microsoft’s developer division. “We’re working closely together to help companies leverage the power of Azure OpenAI and ChatGPT over all of an organizations' proprietary data in Elasticsearch to help our joint customers deliver a richer and more seamless experience.”

To learn more about the Elasticsearch Relevance Engine, please visit https://www.elastic.co/.