Responses not limited to knowledge base

[mrwadams]

The chat bot provides responses to questions that fall outside of the knowledge base. This is risky as it could be used for malicious purposes. For example, the chat bot will provide code for a basic keylogger, which clearly has nothing to do with AWS documentation.

[alexy201]

@mrwadams This is a great point and is something we're currently working on. Many chatbots right now fall risk to hallucinations, and we are in the process of formulating a method to fine tune the model and perform additional checks on the content we produce!

[anshumankmr]

Would updating the prompt help in any way? ie. tell it to limit the knowledge of AWS to the provided document and nothing else. If it is not available, perhaps it can say "Not Sure" or something.