Couldn't you just make that part of your prompt?

ChatGPT lets you pre-prime your chat sessions with an automagic prompt that basically initializes your session. That seems like the right place to prompt for answers that are akin to hallucinations.

Have you tried increasing the temperature on your model or are you more interested in the theory of such a system?