OpenAI has a free API for vectorizing content. With the proper implementation, organizations can even retrieve the supporting documentation to verify answers, making this methodology ideal for mission-critical deployments for everything from regulatory compliance to data privacy. “Imagine you’re doing your compliance research and you’re looking at regulations,” Aasman mentioned. “You can ask a question, but you really want to know what are the paragraphs where the answers came from.”
In fact, depending on how content is vectorized, searchers talking to their documents can get specific sentences containing their answers, paragraphs, entire documents, chapters in a book, or any other type of codification. “For compliance documents, you have to make a choice: Do you want to do it on a whole sentence basis?” Aasman revealed. “But when you ask ChatGPT to answer a question, the question might be in a whole paragraph. So, maybe it’s better to do whole paragraphs. This is one of the things people are still trying to figure out: How do I chop up my documents so that ChatGPT has the highest chance of getting the right answer?” This lies at the heart of having a useful conversation with your content.