Bringing GenAI applications to users with MITRE at KMWorld 2024

MITRE harnessed the power of ChatGPT in the Azure cloud to develop a range of applications, including chatbots and a feature that allows users to ask questions of their own documents.

At KMWorld 2024 in the Enterprise Search & Discovery track, Pari Rajaram, principal AI architect, MITRE, and Beth Lavender, chief engineer, MITRE, explained how they integrated many private MITRE datasets with ChatGPT using advanced vector search retrieval to ground the context for the chat conversation during their session, “Bringing GenAI Applications to Users.”

MITRE brings systems engineering to government-level systems, Lavendar explained. One of the organizations tenants is to solve complex problems to make sure the nation is safe and stable.

“Knowledge management has been a cornerstone since the 1990s,” Lavendar said. “I would say before GenAI or ChatGPT came along in 2022, we had some problems with our search.”

The organization started to work on a solution that could combine the variety of search engines they were using within the enterprise.

Deploying a MITRE ChatGPT advanced the enterprise toward becoming AI native. It offers managed access to Azure OpenAI GPT models hosted in a secure tenant in Azure Commercial Cloud. It protects company data.

The enterprise also created an agentic AI using the GenAI stack to direct employees to ask any question, and the agent will be able to direct the user to the right search to retrieve the correct answer, Lavendar said.

Rajaram explained the intricacies of the systems and software behind the scenes. The system utilizes a bring your own document approach to train the data on information throughout the enterprise to pinpoint the correct answers to prompts.

“It’s been a fascinating ride and we’re not done yet,” Lavendar said.

KMWorld returned to the J.W. Marriott in Washington D.C. on November 19-21, with pre-conference workshops held on November 18.

KMWorld 2024 is a part of a unique program of five co-located conferences, which also includes Enterprise Search & Discovery, Enterprise AI World, Taxonomy Boot Camp, and Text Analytics Forum.