TRIVIAL TOY MODELHow to transfer a environment value into an agent via acting and learning without loss. This is intuitively related to the Free Energy Principle -- where acting and perception are viewed as two sides of the same coin.
The desired behavior is for the agent to somehow perceive via action -- undoing in some way the loss of information in the environment it caused.
Surely sensing the environment directly is the easiest approach, but we avoid it to explore other possibilities where an agent needs to act optimally on an environment but in so doing changes it as well.
