In this post I try to, with less than stellar success it turns out, unpack how surprise is represented in the formalism of AIF.
A segway into information theory
Information theory may be useful for understanding active inference. As a minimum it offers some alternative perspectives on the quantities used in the active inference theory such as surprise, KL divergence, and entropy. This post provides a very short introduction to information theory.