how do you "inject intuition" in reasoning process of an AI?
- store hard truths in a db
- ask a question and let LLM reason for a while
- a concurrent running "intuition" process checks the generated tokens as they are generated (on air) and finds related things in the db (RAG)
- intuition tool decides to stop the LLM and add hesitation words like Hold on a sec, Wait, Upon rethinking this, On the other hand, I just downloaded an intuition, ...
- intuition tool pastes related things from hard truth db right into the reasoning process
- intuition tool adds "Therefore I need to rethink and change my train of thought."
- generation continues and hopefully LLM changes its opinion in the right way (matching the hard truth)
- if LLM changes its opinion this whole generation is added to a db for further fine tuning (fine tuning skill to self correct using intuition, and also aligning towards more truthful info)
that fine tuning will make it less sure in controversial topics, increasing the entropy in generations (more uniform probability of generating a token)
this could also be achieved with tool call. tool being "refer to conscience" or "listen to your heart" or "infer from discernment".
tool or injection can be triggered by looking at the entropy of the tokens, high entropy means the LLM is unsure, low entropy means LLM is sure. but i am not yet sure about when to do the injection. when LLM is sure and wrong it could be dangerous. but there may be situations where it is sure and correct.
